Open Source Linux Duplicate File Finders
Sort By:
Duplicate File Finders for Linux
View 3 business solutionsBrowse free open source Duplicate File Finders and projects for Linux below. Use the toggles on the left to filter open source Duplicate File Finders by OS, license, language, programming language, and project status.
-
Orchestrate Your AI Agents with ZenflowZenflow orchestrates AI agents like a real engineering system. With parallel execution, spec-driven workflows, and deep multi-repo understanding, agents plan, implement, test, and verify end-to-end. Upgrade to AI workflows that work the way your team does.
-
Auth0 for AI Agents now in GAConnect your AI agents to apps and data more securely, give users control over the actions AI agents can perform and the data they can access, and enable human confirmation for critical agent actions.
-
1
Swiss File Knife
One hundred command line tools in a small and portable binary.
Create zip files, extract zip files, replace text in files, search in files using expressions, stream text editor, instant command line ftp and http server, send folder via network, copy folder excluding sub folders and files, find duplicate files, run a command on all files of a folder, split and join large files, make md5 checksum lists of files, remove tab characters, convert CR/LF, list newest or biggest files of a folder, compare folders, treesize, show first or last lines of a file, find filenames fast using index files, rename many files using expressions, copy part of a file, change times of a file, set file time from filename, print colored text to terminal, convert csv to tab separated, download files from web, send http or udp requests, print tcp or udp traffic, create hexdump of files, join many text files into one, list nested .zip .tar .tar.gz .tar.bz2 archive contents. Fully portable, for USB stick, without installation. For Windows, Linux and Mac OS/X. -
2
dupeGuru
Find duplicate files
dupeGuru is a cross-platform GUI application written in Python (with Qt/Cocoa UI) that quickly detects duplicate files on your computer using flexible scanning modes—including filename fuzzy matching, content comparison, and specialized Music/Picture modes. On some linux systems pyrcc5 is not put on the path when installing python3-pyqt5, this will cause some issues with the resource files (and icons). These systems should have a respective pyqt5-dev-tools package, which should also be installed. The presence of pyrcc5 can be checked with which pyrcc5. Debian based systems need the extra package, and Arch does not. Scanning by filename or content with fuzzy matching to catch similar filenames. -
3
Duplicate Files Finder is a cross-platform application for finding and removing duplicate files by deleting, creating hardlinks or creating symbolic links. A special algorithm minimizes the amount of data read from disk, so the program is very fast.
-
4
MediaFileDuplicateFinder
MediaFileDuplicateFinder finds duplicated video, image, & audio files
Media File Duplicate Finder finds duplicated video and image files based on similarity. Finds duplicates which have different resolution, frame rate, watermark, and video file tags. It's a cross-platform program that supports Windows, Linux and Mac-OS. Please use below link to report bugs, feature-request, or questions. https://github.com/David-Maisonave/MediaFileDuplicateFinder/issues/new/choose For more information, visit the following Wiki page: https://github.com/David-Maisonave/MediaFileDuplicateFinder/wiki -
Financial reporting cloud-based software.The software is cloud based and automates complexities around consolidating and reporting for groups with multiple year ends, currencies and ERP systems with a slice and dice approach to reporting. While retaining the structure, control and validation needed in a financial reporting tool, we’ve managed to keep things flexible.
-
5
GDuplicateFinder
GDuplicateFinder - A FREE Groovy way to find file duplicates!
Unlike other duplicate finders such as Easy Duplicate File Finder, Auslogics Duplicate File Finder, MindGems Fast Duplicate File Finder, Duplicate Cleaner, DupFiles and others, GDuplicateFinder is a FREE cross-platform application, with the ability to search among not just local files, but files on the network, such as a Windows or a Linux share using VFS library. Taking advantage of Groovy facilities and GPars power to process in parallel, GDuplicateFinder will help you get rid of those duplicates you always wanted to dispose in an easy and friendly way. Looking for translators to translate the app! If you'd like to help me, please create a GitHub Issue here (https://github.com/guicamest/GDuplicate-Finder/issues) mentioning the language so that I get notified. Thanks in advance <3 If you want to help me continue improving this app, donate some money through paypal! https://www.paypal.com/cgi-bin/webscr?cmd=_s-xclick&hosted_button_id=fezuqqg9t6j6y -
6
littleutils
Various small and useful command-line utilities
The littleutils include duplicate file finders (repeats, repeats.pl, repeats.py), image optimizers (opt-jpg, opt-png, opt-gif, recomp-jpg), file rename tools (lowercase, uppercase, pren), archive recompressors (to-gzip, to-bzip2, to-bzip3, to-7zip, to-lzma, to-lzip, to-xz), a tempfile utility (tempname), file property tools (filedate, filemode, filenode, fileown, filesize, and lrealpath), and others. See the README file for more details. -
7
dupliFinder
Find duplicate files on your system
dupliFinder is a app that searches your computer for duplicate files by compairing the MD5 sum of each file. You then have the option of deleting any duplicate files found. Great for collections of MP3s, images etc.. Runs on Windows & Linux with Java 1.5 -
8
Command line duplicate file finder for Linux machines, which finds the duplicate files by its content, name & directories by its name. Easy usage and efficient too.
-
9
DupStat
Duplicate/unique file analyzer with at-a-glance statistics.
This tool helps find duplicate files and folders across two selected directories. It can answer questions like, "What files are on my thumb drive that are not on my PC", and can help synchronize different backup copies of a folder structure. It helps you merge backups without accidentally deleting unique files. DupStat compares files across two selected directories (and their subdirectories). It shows duplication statistics across the selected directories to help you see where entire directories are duplicated. Version 0.5 has several new features, including Action menu with copy/move/delete capability, drag-and-drop capability to specify search directories on either side, file counts in the file pane, tooltips for most UI controls and options, directory swap and copy buttons, cleaned up UI options, Several updates and refinements are also included; see the change history section of the Readme file. -
Total Network Visibility for Network Engineers and IT ManagersThis means every device on your network, and every interface on every device is automatically analyzed for performance, errors, QoS, and configuration.
-
10
A Linux/UNIX command line tool to find duplicate files. The tool supports multiple ways to consider a set of files as duplicates to each other (e.g. content, size, name ... etc.).
-
11
-
12
Filekit
File Processing Tools - string search and DOS command execution
Filekit is a set of file processing GUI tools that can be put into an USB flash, so that no installation is required. Aim of the project is to include many file processing tools such as file searching tool, batch rename file, find duplicate files, split and join files and so on ... Release 0.1.0 consist of the multi-threaded file search tool that allow you to select multiple folders and files, then search those files that contains particular strings using regular expression. Release 2.0 includes the DOS command execution function, so that you can apply DOS command to a list of selected folders and files. You can batch rename files using this feature. This release add an option to select files from the result panel and let you do iteration processing. Other features will be provided in future. -
13
fdf
FDF: Find Duplicate Files
Searches a drive (possibly with additional mounted drives) for duplicate files, outputs a potential script for deleting them after editing. -
14
hk-dup-finder
hadi kiamarsi duplicate file finder
hk-dup-finder is a free tool for find duplicate file in your computers . this software is written by Hadi Kiamarsi. -
15
qlsdup
GUI based lightweight duplicate file finder / remover.
Simple GUI based lightweight duplicate file finder and remover. Configurable file search and preview (via external tools) option for file data. No command-line interface available! This is basically a reimplementation of dupfinder as: it doesn't compile on my computer, the executable won't work either, the projects seems dead and I didn't wanna work through the original code. So Look'n'Feel should be somewhat the same, though some changes have been made. Algorithm is simple and suitable for large file sets with few differences: basic set of duplicate candidates is determined by file size, then candidates are compared byte-wise. So for files which don't start to differ by growing at the tail it reduces read operations greatly compared to hash-based comparision (i.e. test case: 40GB of files, 16GB RAM, many differences: initial compare (uncached by OS) around 300sec, subsequent compare (relevant file parts cached by OS) ca. 2sec) Note: this program is not related to lsdup -
16
CloneManager
Allow to find duplicate files
Two goals : Allow to find duplicated files on computer / find files which haven't been backed up yet -
17
Duplicate Agent
Duplicate Files Finder and Cleaner
This program was created to detect and delete unnecessary files on your computer that you've unknowingly created, copied, or backed up in some way. You can find the release notes on my Github address: https://github.com/shampuan/Duplicate-Agent/issues -
18
Duplicate File Finder
Find duplicates of a specified file
When you've been using your computer for quite a long time, often you end up duplicating your files and you don't even know about them. Duplicate File Finder is a Linux/Unix utility than scans your hard drive for finding duplicates of a given file. -
19
Duplicate File Fixer 1.00g
Find Duplicate Files and Manage Them
This software finds duplicate files across all directory levels inside a given folder. -
20
Fast Duplicate File Finder
Superfast, lightweight, simple duplicate file finder
A simple, super-fast, lightweight duplicate file finder written in java. System requirement: Java 1.6+ 20 KB of disk space (lol :D) -
21
HashCatalog is a program that can find duplicate files in one or more folders, or between 2 lists of one or more folders. HashCatalog can also create an xml database file containing a listing of files with hashes.
-
22
JustOneFile help you to find duplicate files and managed them. It's a Free and Open Source software under GNU GPL licence.
-
23
MediaCMN provides tools to create a consistent music library. In detail these tools, index all audio files of certain directories, find duplicate files, tag the files using musicbrainz and organize the audio files in a filesystem.
-
24
Photo Agent
Duplicate Photo Finder and Cleaner for Linux
The program is very easy to use. Simply point to the path and click scan. Mark any unwanted photos and click "Send to Fake Trash." Then, switch to the Fake Trash tab, make sure you've selected the correct files, and select and delete them all (they can no longer be recovered). If you want to return any, simply mark them and recover them (Restore Selected). If the directory you're pointing to is very large or complex, the program may freeze for a moment when you press the scan button. This is normal (pre-scanning and pre-hashing content detection). The scan will then begin, and you'll see the progress bar animate. Once complete, it will display the contents as shown in the image. Github: https://github.com/shampuan/Photo-Agent -
25
Simple Directory Toolbox
Portable collections of directory tools (Unhide etc)
Hi, simple directory tools is another portable software i made. I made this to help people whom work with directory/files using longer method (cmd, etc). I plan to create some tools, but because it's still alpha, there are still few finished. Still, you can use it. 1. Unhidder Finds hidden/Superhidden files/folders and restore it to normal state 2. Duplicate file finder Find duplicated files, and easily removes it 3. Space analyzer Analyze folder, list which file/folder takes how much size in disk Here is the virustotal result https://www.virustotal.com/en/file/a5b742d657293c0563364e28545548afd45501e5ed9a72e69875177e757ace1e/analysis/1391693986
