Find Duplicate Files On Linux With FSlint DistroTube
video description
Date: 2022-03-30
Related videos
Comments and reviews: 10
dkosmari
It's worth mentioning that no userspace tool is a replacement for filesystem-level deduplication. If you hardlink two identical files, they become the same file. If later one is modified, every other file linked to it will be modified too, and that's usually not what you want; at that point, you want one of them to actually be duplicated, then modified. Deduplication at the filesystem level will take care of that, automatically. On Linux, the only filesystem for that is btrfs, as it's not implemented in ext4. So don't go around manually merging duplicate files, before you understand what those files are used for.
reply
It's worth mentioning that no userspace tool is a replacement for filesystem-level deduplication. If you hardlink two identical files, they become the same file. If later one is modified, every other file linked to it will be modified too, and that's usually not what you want; at that point, you want one of them to actually be duplicated, then modified. Deduplication at the filesystem level will take care of that, automatically. On Linux, the only filesystem for that is btrfs, as it's not implemented in ext4. So don't go around manually merging duplicate files, before you understand what those files are used for.
reply
AlucardNoir
I'm fairly certain there are hundreds of unique files on my system that have the exact same name but completely different content. Does it do checksum check or just name check?
And if you're wondering how could I possibly have such files. I play games. Read Me.txt and empty .txt files used to created Mod folders are quite common. Hell, Read Me.txt is one of the most common files you'll encounter ever. The problem is that the name might be the same, but the content, not so much.
reply
I'm fairly certain there are hundreds of unique files on my system that have the exact same name but completely different content. Does it do checksum check or just name check?
And if you're wondering how could I possibly have such files. I play games. Read Me.txt and empty .txt files used to created Mod folders are quite common. Hell, Read Me.txt is one of the most common files you'll encounter ever. The problem is that the name might be the same, but the content, not so much.
reply
Cool
Hi Sir Great vid --. I have a Query (Moved from win7 to mint last week), Where to store the user data, such as documents, photos, music, videos, ebooks etc. in Linux? The main idea is to be able to reinstall & reformat the system drives in Linux without the fear of personal data (MP3, JPGs, PDFs etc., not user config files) loss. What I'm looking for is D: drive like partition and if it is useful in Linux . - Please help! Thanks.
reply
Hi Sir Great vid --. I have a Query (Moved from win7 to mint last week), Where to store the user data, such as documents, photos, music, videos, ebooks etc. in Linux? The main idea is to be able to reinstall & reformat the system drives in Linux without the fear of personal data (MP3, JPGs, PDFs etc., not user config files) loss. What I'm looking for is D: drive like partition and if it is useful in Linux . - Please help! Thanks.
reply
dkosmari
On the command line, use fdupes. Use the options -r for recursive, and -n for ignoring empty files. And just like fslint, think before you go merging or deleting duplicates, specially if they're part of the system. Without further options, fdupes only lists the duplicates, it doesn't touch them.
reply
On the command line, use fdupes. Use the options -r for recursive, and -n for ignoring empty files. And just like fslint, think before you go merging or deleting duplicates, specially if they're part of the system. Without further options, fdupes only lists the duplicates, it doesn't touch them.
reply
itech
It-s been a while but I think I used rsync to find duplicates and replicate data but configured via the GUI and not terminal. I think that is gsync. The beauty was rsync still showed all the commands if you wanted to run in terminal once you put the command together.
reply
It-s been a while but I think I used rsync to find duplicates and replicate data but configured via the GUI and not terminal. I think that is gsync. The beauty was rsync still showed all the commands if you wanted to run in terminal once you put the command together.
reply
Tato-Chip
this is unrelated but anyone know how i can make it so that programs like synaptic ask for a password?
I use awesome WM and i dont want to type sudo synaptic i want to run it and for it to open a menu that asks for a password
reply
this is unrelated but anyone know how i can make it so that programs like synaptic ask for a password?
I use awesome WM and i dont want to type sudo synaptic i want to run it and for it to open a menu that asks for a password
reply
Joe
Nice app Derek. Problem for me is, I have too many that I do not know for sure so I'll lean toward the caution side and leave them until I get more familiar. Many duplicates are Wine and .dll because of Proton. Thanks for the tip.
reply
Nice app Derek. Problem for me is, I have too many that I do not know for sure so I'll lean toward the caution side and leave them until I get more familiar. Many duplicates are Wine and .dll because of Proton. Thanks for the tip.
reply
Star
Thanks you so much for this video. I am about to re-install Pop Os and I will get this one utility installed too. Your Videos are good and stay safe dude
reply
Thanks you so much for this video. I am about to re-install Pop Os and I will get this one utility installed too. Your Videos are good and stay safe dude
reply
Nuke
I don't know why FSlint doesn't put dups you delete in the trash bin... They're just gone so you damn well better be sure you selected the right files.
reply
I don't know why FSlint doesn't put dups you delete in the trash bin... They're just gone so you damn well better be sure you selected the right files.
reply
Eegoal
Distrube, soon you'll realize the truth. There's no linux. theres no windows. it's all in our minds.
Oh btw check fdupes.
reply
Distrube, soon you'll realize the truth. There's no linux. theres no windows. it's all in our minds.
Oh btw check fdupes.
reply
Add a review, comment
Other channel videos
