Search Results for "remove duplicate file"
Sort By:
Showing 759 open source projects for "remove duplicate file"
View related business solutions-
Add Two Lines of Code. Get Full APM.Works out of the box for Rails, Django, Express, Phoenix, and more. Monitoring exceptions and performance in no time.
-
Our Free Plans just got better! | Auth0You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
-
1
FDUPES
FDUPES is a program for identifying or deleting duplicate files
FDUPES is a lightweight command-line utility that helps users find and optionally delete duplicate files within specified directories by comparing file contents, which can be extremely useful for cleaning up storage clutter or organizing large collections of files. It works by scanning directories and subdirectories, identifying sets of files with identical content through size and hash comparisons, and then listing them together so users can examine duplicates. -
2
Swiss File Knife
One hundred command line tools in a small and portable binary.
Create zip files, extract zip files, replace text in files, search in files using expressions, stream text editor, instant command line ftp and http server, send folder via network, copy folder excluding sub folders and files, find duplicate files, run a command on all files of a folder, split and join large files, make md5 checksum lists of files, remove tab characters, convert CR/LF, list newest or biggest files of a folder, compare folders, treesize, show first or last lines of a file, find filenames fast using index files, rename many files using expressions, copy part of a file, change times of a file, set file time from filename, print colored text to terminal, convert csv to tab separated, download files from web, send http or udp requests, print tcp or udp traffic, create hexdump of files, join many text files into one, list nested .zip .tar .tar.gz .tar.bz2 archive contents. ... -
3
Czkawka
Multi functional app to find duplicates, empty folders, similar images
Czkawka (Polish for “hiccup”) is a lightning‑fast, multi‑purpose file cleaning tool written in Rust. It helps users declutter storage by finding duplicate files, similar images or audio, empty folders, and unusually large files through CPU‑efficient multithreading. Available with both GUI (GTK‑based) and CLI versions for flexible usage. -
4
duplicate-file-cleaner
Windows GUI application for scan and clean the duplicate files
This is a GUI application for Windows platform, which can scan all files under the specified directory and use SHA256 signature to ensure the consistency of file content. It also supports deleting or transferring duplicate files with the same SHA256 signature. No installation is required, just run it directly after decompression. It does not rely on the network and supports offline operation. -
Gemini 3 and 200+ AI Models on One PlatformBuild generative AI apps with Vertex AI. Switch between models without switching platforms.
-
5
RemoveDuplicate
A software that can helps you remove duplicate files
RemoveDuplicate is a Windows application designed to help users find and remove duplicate files within folders. It uses MD5 hashing to identify identical files and provides a user-friendly interface to manage and delete duplicates while keeping one copy of each file. -
6
Video-subtitle-extractor
A GUI tool for extracting hard-coded subtitle (hardsub) from videos
...(CLI version) No need for users to manually set the subtitle area, the project automatically detects the subtitle area through the text detection model. Filter the text in the non-subtitle area and remove the watermark (station logo) text. -
7
Allows the removal of the com.apple.quarantine extended attribute from files and folders displayed in a Finder application window. This extend attribute is usually placed on downloads from the internet. In the case of folders, the removal action is recursive (so that every file and subfolder in the folder is acted upon).
-
8
Duplicate Agent
Duplicate Files Finder and Cleaner
This program was created to detect and delete unnecessary files on your computer that you've unknowingly created, copied, or backed up in some way. You can find the release notes on my Github address: https://github.com/shampuan/Duplicate-Agent/issues -
9
Text Line Duplicate Remover
Remove duplicate lines from your text
This standalone offline web browser tool helps you remove duplicate lines from your text, with additional text processing options. Simply open it in your browser by double-clicking the html file. It also includes the source code too. I made this when I was working with long lists of entries and needed something to automatically clean them up. As a bonus you can also change the Sentence Case of the text, make it lowercase, UPPERCASE or Sentence case. -
Try Google Cloud Risk-Free With $300 in CreditUse your credit across every product. Compute, storage, AI, analytics. When it runs out, 20+ products stay free. You only pay when you choose to.
-
10
BackgroundRemover
Background Remover lets you Remove Background from images and video
BackgroundRemover is a command line tool to remove background from image and video, made by nadermx to power BackgroundRemoverAI. If you wonder why it was made read this short blog post. -
11
RemoveDuplicateLinesFromTxt
Remove Duplicate lines From Files in TXT
This program remove duplicate lines in txt files. -
12
File Nesting Config for VS Code
Config of File Nesting for VS Code
...It is somewhat opinionated, offering a broad list of patterns (for example hiding .env.*, *.freezed.dart, etc) and it also includes an optional VS Code extension to automatically update the nesting config from the repo. Because the snippet is generated via a script (update.mjs), it is maintained for many languages, frameworks, and file types. The benefit is much cleaner project file trees, reduced noise, easier navigation, and less time wasted hunting through duplicate or generated files. -
13
Grabber
Very customizable imageboard/booru downloader with powerful filenaming
Very customizable imageboard/booru browser and mass downloader, with powerful file naming features. Thanks to its powerful naming features, you just have to set your filename and save the directory using all the tokens available, and the program will generate a filename using the image's information. With this, you can store and manage your pictures in advanced directory structures, and save images with custom filenames. Imageboard/booru downloader which can download thousands of images from... -
14
diskover-community
Open source file indexing & storage analytics powered by Elasticsearch
...By indexing file metadata from sources such as local file systems, network shares like NFS and SMB, and cloud storage, the tool provides a centralized way to analyze heterogeneous storage environments. Diskover also helps identify outdated or unused files, duplicate data, and inefficient storage usage that can waste resources or increase operational costs. -
15
BFG Repo-Cleaner
Remove large or troublesome blobs
The BFG is a simpler, faster alternative to git-filter-branch for cleansing bad data out of your Git repository history. You can use it for removing crazy big files, and for removing passwords, credentials and other private data. The git-filter-branch command is enormously powerful and can do things that the BFG can't, but the BFG is much better for the tasks above, because is faster and simpler. The BFG isn't particularily clever, but is focused on making the above tasks easy. If you need... -
16
RTorrent BitTorrent Client
rTorrent BitTorrent client
The rTorrent bittorrent client uses ncurses and is ideal for use with tmux, screen or dtach. Alternatively, version 0.9.7+ has a built-in daemon mode disabling the user interface, so you can only control it via XMLRPC. It supports saving of sessions, allows the user to add/remove torrents, and much more. -
17
supabase-py
Python Client for Supabase. Query Postgres from Flask, Django
Python Client for Supabase. Query Postgres from Flask, Django, FastAPI. Python user authentication, security policies, edge functions, file storage, and realtime data streaming. Good first issue. -
18
Win11Debloat
A simple, easy to use PowerShell script to remove pre-installed apps
Win11Debloat is an open-source PowerShell script designed to remove unnecessary apps, services, and features from Windows 10 and Windows 11. It helps users quickly declutter their system by uninstalling preinstalled bloatware and disabling unwanted background services. The tool also focuses on improving privacy by turning off telemetry, tracking features, and targeted advertisements built into Windows. In addition to removing apps, Win11Debloat provides options to customize system behavior,... -
19
WindTerm
A professional cross-platform SSH/Sftp/Shell/Telnet/Serial terminal
...Open source code includes, but is not limited to, the classes that can be used independently, such as functional, algorithms, GUI widgets, etc., as well as functional libraries, such as networks, protocols, etc., as well as all types that require open source according to the license. SSH v2, Telnet, Raw TCP, Serial, Shell protocols were implemented. Supports SSH auto-execution when the session is authenticated. Integrated local file manager, supports the move to, copy to, copy from, remove, rename, make new file/directory and so on. Supports Windows Cmd, PowerShell and Cmd, PowerShell as administrator. Supports Linux bash, zsh, PowerShell core, and so on. Supports MacOS bash, zsh, PowerShell core, and so on. -
20
Docker tools
Useful tools when you are running your project inside docker container
Running a DNS service for docker containers always messes with the DNS settings of your workstation. Especially if these DNS/discovery services themselves run inside docker containers on an active development workstation. Resolving DNS issues is not an easy task. Contrary to that the hosts file is simple. The script first removes all existing entries of all the hostnames of containers created by docker-compose. Configure the environment variables in your .env file. That way it can be used by... -
21
SortPhotos
SortPhotos is a Python script that organizes photos and videos
...It can sort files by year, month, day, or any custom format using EXIF and other metadata tags, making it easy to transform messy collections into neatly arranged photo libraries. The tool works with both images and videos, automatically renames files if desired, and can filter which metadata groups or tags to prioritize when determining file dates. SortPhotos includes options for copying versus moving files, recursive searches, silent or test modes, and customizable start times for when a “day” begins. It also prevents duplicate files by comparing content, with an option to keep duplicates if needed. With support for automation through launch agents or cron jobs, SortPhotos is well-suited for photographers, archivists, and anyone looking to streamline large personal or professional media collections. -
22
Torrra
A Python tool that lets you search and download torrents
Torrra is an open-source BitTorrent client and library focused on simplicity, performance, and extensibility for developers and self-hosted enthusiasts. It provides a command-line interface (CLI) and API that make it easy to add torrenting functionality to applications or automate downloads within scripts and workflows. The core of Torrra is built with modern asynchronous I/O and efficient resource handling, allowing it to manage multiple active torrents, peer connections, and swarm... -
23
duf
Disk usage and free utility, a better 'df' alternative
...You can simply start duf without any command-line arguments. If you supply arguments, duf will only list specific devices & mount points. If you want to list everything (including pseudo, duplicate, inaccessible file systems), you can. You can show and hide specific tables. You can also show and hide specific filesystems. List inode information instead of block usage. If duf doesn't detect your terminal's colors correctly, you can set a theme. Users of oh-my-zsh should be aware that it already defines an alias called duf, which you will have to remove in order to use duf. -
24
Meta Package Manager
Wraps all package managers with a unifying CLI
Meta Package Manager wraps all package managers with a unifying CLI, and provides the MPM CLI, a wrapper around all package managers. MPM is like yt-dlp, but for package managers instead of videos. MPM solves XKCD #1654 - Universal Install Script. List installed packages. List duplicate installed packages. Search for packages. Install a package, remove a package, and list outdated packages. Sync local package infos. Upgrade all outdated packages. Backup list of installed packages to TOML file. Restore/install list of packages from TOML files. Pin-point commands to a subset of package managers (include/exclude selectors). ... -
25
keycloak-config-cli
Import YAML/JSON-formatted configuration files into Keycloak
Remove all UUIDs and all stuff that is default set by keycloak.
