Showing 759 open source projects for "remove duplicate file"

View related business solutions
  • Add Two Lines of Code. Get Full APM. Icon
    Add Two Lines of Code. Get Full APM.

    AppSignal installs in minutes and auto-configures dashboards, alerts, and error tracking.

    Works out of the box for Rails, Django, Express, Phoenix, and more. Monitoring exceptions and performance in no time.
    Start Free
  • Our Free Plans just got better! | Auth0 Icon
    Our Free Plans just got better! | Auth0

    With up to 25k MAUs and unlimited Okta connections, our Free Plan lets you focus on what you do best—building great apps.

    You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
    Try free now
  • 1
    FDUPES

    FDUPES

    FDUPES is a program for identifying or deleting duplicate files

    FDUPES is a lightweight command-line utility that helps users find and optionally delete duplicate files within specified directories by comparing file contents, which can be extremely useful for cleaning up storage clutter or organizing large collections of files. It works by scanning directories and subdirectories, identifying sets of files with identical content through size and hash comparisons, and then listing them together so users can examine duplicates.
    Downloads: 8 This Week
    Last Update:
    See Project
  • 2
    Swiss File Knife

    Swiss File Knife

    One hundred command line tools in a small and portable binary.

    Create zip files, extract zip files, replace text in files, search in files using expressions, stream text editor, instant command line ftp and http server, send folder via network, copy folder excluding sub folders and files, find duplicate files, run a command on all files of a folder, split and join large files, make md5 checksum lists of files, remove tab characters, convert CR/LF, list newest or biggest files of a folder, compare folders, treesize, show first or last lines of a file, find filenames fast using index files, rename many files using expressions, copy part of a file, change times of a file, set file time from filename, print colored text to terminal, convert csv to tab separated, download files from web, send http or udp requests, print tcp or udp traffic, create hexdump of files, join many text files into one, list nested .zip .tar .tar.gz .tar.bz2 archive contents. ...
    Leader badge
    Downloads: 948 This Week
    Last Update:
    See Project
  • 3
    Czkawka

    Czkawka

    Multi functional app to find duplicates, empty folders, similar images

    Czkawka (Polish for “hiccup”) is a lightning‑fast, multi‑purpose file cleaning tool written in Rust. It helps users declutter storage by finding duplicate files, similar images or audio, empty folders, and unusually large files through CPU‑efficient multithreading. Available with both GUI (GTK‑based) and CLI versions for flexible usage.
    Downloads: 738 This Week
    Last Update:
    See Project
  • 4
    duplicate-file-cleaner

    duplicate-file-cleaner

    Windows GUI application for scan and clean the duplicate files

    This is a GUI application for Windows platform, which can scan all files under the specified directory and use SHA256 signature to ensure the consistency of file content. It also supports deleting or transferring duplicate files with the same SHA256 signature. No installation is required, just run it directly after decompression. It does not rely on the network and supports offline operation.
    Downloads: 0 This Week
    Last Update:
    See Project
  • Gemini 3 and 200+ AI Models on One Platform Icon
    Gemini 3 and 200+ AI Models on One Platform

    Access Google's best plus Claude, Llama, and Gemma. Fine-tune and deploy from one console.

    Build generative AI apps with Vertex AI. Switch between models without switching platforms.
    Start Free
  • 5
    RemoveDuplicate

    RemoveDuplicate

    A software that can helps you remove duplicate files

    RemoveDuplicate is a Windows application designed to help users find and remove duplicate files within folders. It uses MD5 hashing to identify identical files and provides a user-friendly interface to manage and delete duplicates while keeping one copy of each file.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 6
    Video-subtitle-extractor

    Video-subtitle-extractor

    A GUI tool for extracting hard-coded subtitle (hardsub) from videos

    ...(CLI version) No need for users to manually set the subtitle area, the project automatically detects the subtitle area through the text detection model. Filter the text in the non-subtitle area and remove the watermark (station logo) text.
    Downloads: 49 This Week
    Last Update:
    See Project
  • 7
    Allows the removal of the com.apple.quarantine extended attribute from files and folders displayed in a Finder application window. This extend attribute is usually placed on downloads from the internet. In the case of folders, the removal action is recursive (so that every file and subfolder in the folder is acted upon).
    Downloads: 2 This Week
    Last Update:
    See Project
  • 8
    Duplicate Agent

    Duplicate Agent

    Duplicate Files Finder and Cleaner

    This program was created to detect and delete unnecessary files on your computer that you've unknowingly created, copied, or backed up in some way. You can find the release notes on my Github address: https://github.com/shampuan/Duplicate-Agent/issues
    Downloads: 4 This Week
    Last Update:
    See Project
  • 9
    Text Line Duplicate Remover

    Text Line Duplicate Remover

    Remove duplicate lines from your text

    This standalone offline web browser tool helps you remove duplicate lines from your text, with additional text processing options. Simply open it in your browser by double-clicking the html file. It also includes the source code too. I made this when I was working with long lists of entries and needed something to automatically clean them up. As a bonus you can also change the Sentence Case of the text, make it lowercase, UPPERCASE or Sentence case.
    Downloads: 0 This Week
    Last Update:
    See Project
  • Try Google Cloud Risk-Free With $300 in Credit Icon
    Try Google Cloud Risk-Free With $300 in Credit

    No hidden charges. No surprise bills. Cancel anytime.

    Use your credit across every product. Compute, storage, AI, analytics. When it runs out, 20+ products stay free. You only pay when you choose to.
    Start Free
  • 10
    BackgroundRemover

    BackgroundRemover

    Background Remover lets you Remove Background from images and video

    BackgroundRemover is a command line tool to remove background from image and video, made by nadermx to power BackgroundRemoverAI. If you wonder why it was made read this short blog post.
    Downloads: 4 This Week
    Last Update:
    See Project
  • 11

    RemoveDuplicateLinesFromTxt

    Remove Duplicate lines From Files in TXT

    This program remove duplicate lines in txt files.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 12
    File Nesting Config for VS Code

    File Nesting Config for VS Code

    Config of File Nesting for VS Code

    ...It is somewhat opinionated, offering a broad list of patterns (for example hiding .env.*, *.freezed.dart, etc) and it also includes an optional VS Code extension to automatically update the nesting config from the repo. Because the snippet is generated via a script (update.mjs), it is maintained for many languages, frameworks, and file types. The benefit is much cleaner project file trees, reduced noise, easier navigation, and less time wasted hunting through duplicate or generated files.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 13
    Grabber

    Grabber

    Very customizable imageboard/booru downloader with powerful filenaming

    Very customizable imageboard/booru browser and mass downloader, with powerful file naming features. Thanks to its powerful naming features, you just have to set your filename and save the directory using all the tokens available, and the program will generate a filename using the image's information. With this, you can store and manage your pictures in advanced directory structures, and save images with custom filenames. Imageboard/booru downloader which can download thousands of images from...
    Downloads: 22 This Week
    Last Update:
    See Project
  • 14
    diskover-community

    diskover-community

    Open source file indexing & storage analytics powered by Elasticsearch

    ...By indexing file metadata from sources such as local file systems, network shares like NFS and SMB, and cloud storage, the tool provides a centralized way to analyze heterogeneous storage environments. Diskover also helps identify outdated or unused files, duplicate data, and inefficient storage usage that can waste resources or increase operational costs.
    Downloads: 5 This Week
    Last Update:
    See Project
  • 15
    BFG Repo-Cleaner

    BFG Repo-Cleaner

    Remove large or troublesome blobs

    The BFG is a simpler, faster alternative to git-filter-branch for cleansing bad data out of your Git repository history. You can use it for removing crazy big files, and for removing passwords, credentials and other private data. The git-filter-branch command is enormously powerful and can do things that the BFG can't, but the BFG is much better for the tasks above, because is faster and simpler. The BFG isn't particularily clever, but is focused on making the above tasks easy. If you need...
    Downloads: 5 This Week
    Last Update:
    See Project
  • 16
    RTorrent BitTorrent Client

    RTorrent BitTorrent Client

    rTorrent BitTorrent client

    The rTorrent bittorrent client uses ncurses and is ideal for use with tmux, screen or dtach. Alternatively, version 0.9.7+ has a built-in daemon mode disabling the user interface, so you can only control it via XMLRPC. It supports saving of sessions, allows the user to add/remove torrents, and much more.
    Downloads: 29 This Week
    Last Update:
    See Project
  • 17
    supabase-py

    supabase-py

    Python Client for Supabase. Query Postgres from Flask, Django

    Python Client for Supabase. Query Postgres from Flask, Django, FastAPI. Python user authentication, security policies, edge functions, file storage, and realtime data streaming. Good first issue.
    Downloads: 2 This Week
    Last Update:
    See Project
  • 18
    Win11Debloat

    Win11Debloat

    A simple, easy to use PowerShell script to remove pre-installed apps

    Win11Debloat is an open-source PowerShell script designed to remove unnecessary apps, services, and features from Windows 10 and Windows 11. It helps users quickly declutter their system by uninstalling preinstalled bloatware and disabling unwanted background services. The tool also focuses on improving privacy by turning off telemetry, tracking features, and targeted advertisements built into Windows. In addition to removing apps, Win11Debloat provides options to customize system behavior,...
    Downloads: 141 This Week
    Last Update:
    See Project
  • 19
    WindTerm

    WindTerm

    A professional cross-platform SSH/Sftp/Shell/Telnet/Serial terminal

    ...Open source code includes, but is not limited to, the classes that can be used independently, such as functional, algorithms, GUI widgets, etc., as well as functional libraries, such as networks, protocols, etc., as well as all types that require open source according to the license. SSH v2, Telnet, Raw TCP, Serial, Shell protocols were implemented. Supports SSH auto-execution when the session is authenticated. Integrated local file manager, supports the move to, copy to, copy from, remove, rename, make new file/directory and so on. Supports Windows Cmd, PowerShell and Cmd, PowerShell as administrator. Supports Linux bash, zsh, PowerShell core, and so on. Supports MacOS bash, zsh, PowerShell core, and so on.
    Downloads: 118 This Week
    Last Update:
    See Project
  • 20
    Docker tools

    Docker tools

    Useful tools when you are running your project inside docker container

    Running a DNS service for docker containers always messes with the DNS settings of your workstation. Especially if these DNS/discovery services themselves run inside docker containers on an active development workstation. Resolving DNS issues is not an easy task. Contrary to that the hosts file is simple. The script first removes all existing entries of all the hostnames of containers created by docker-compose. Configure the environment variables in your .env file. That way it can be used by...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 21
    SortPhotos

    SortPhotos

    SortPhotos is a Python script that organizes photos and videos

    ...It can sort files by year, month, day, or any custom format using EXIF and other metadata tags, making it easy to transform messy collections into neatly arranged photo libraries. The tool works with both images and videos, automatically renames files if desired, and can filter which metadata groups or tags to prioritize when determining file dates. SortPhotos includes options for copying versus moving files, recursive searches, silent or test modes, and customizable start times for when a “day” begins. It also prevents duplicate files by comparing content, with an option to keep duplicates if needed. With support for automation through launch agents or cron jobs, SortPhotos is well-suited for photographers, archivists, and anyone looking to streamline large personal or professional media collections.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 22
    Torrra

    Torrra

    A Python tool that lets you search and download torrents

    Torrra is an open-source BitTorrent client and library focused on simplicity, performance, and extensibility for developers and self-hosted enthusiasts. It provides a command-line interface (CLI) and API that make it easy to add torrenting functionality to applications or automate downloads within scripts and workflows. The core of Torrra is built with modern asynchronous I/O and efficient resource handling, allowing it to manage multiple active torrents, peer connections, and swarm...
    Downloads: 4 This Week
    Last Update:
    See Project
  • 23
    duf

    duf

    Disk usage and free utility, a better 'df' alternative

    ...You can simply start duf without any command-line arguments. If you supply arguments, duf will only list specific devices & mount points. If you want to list everything (including pseudo, duplicate, inaccessible file systems), you can. You can show and hide specific tables. You can also show and hide specific filesystems. List inode information instead of block usage. If duf doesn't detect your terminal's colors correctly, you can set a theme. Users of oh-my-zsh should be aware that it already defines an alias called duf, which you will have to remove in order to use duf.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 24
    Meta Package Manager

    Meta Package Manager

    Wraps all package managers with a unifying CLI

    Meta Package Manager wraps all package managers with a unifying CLI, and provides the MPM CLI, a wrapper around all package managers. MPM is like yt-dlp, but for package managers instead of videos. MPM solves XKCD #1654 - Universal Install Script. List installed packages. List duplicate installed packages. Search for packages. Install a package, remove a package, and list outdated packages. Sync local package infos. Upgrade all outdated packages. Backup list of installed packages to TOML file. Restore/install list of packages from TOML files. Pin-point commands to a subset of package managers (include/exclude selectors). ...
    Downloads: 1 This Week
    Last Update:
    See Project
  • 25
    keycloak-config-cli

    keycloak-config-cli

    Import YAML/JSON-formatted configuration files into Keycloak

    Remove all UUIDs and all stuff that is default set by keycloak.
    Downloads: 69 This Week
    Last Update:
    See Project
  • Previous
  • You're on page 1
  • 2
  • 3
  • 4
  • 5
  • Next
MongoDB Logo MongoDB