Download Shareware and Freeware Software for Windows, Linux, Macintosh, PDA

line Home  |  About Us  |  Link To Us  |  FAQ  |  Contact

Serving Software Downloads in 976 Categories, Downloaded 40.145.719 Times

Dupinator 1.0

  Date Added: May 10, 2013  |  Visits: 428

Dupinator

Report Broken Link
Printer Friendly Version


Product Homepage
Download (49 downloads)



Point this script at a folder or several folders and it will find and delete all duplicate files within the folders, leaving behind the first file found of any set of duplicates. It is designed to handle hundreds of thousands of files of any size at a time and to do so quickly.It was written to eliminate duplicates across several photo libraries that had been shared between users. As the script was a one-off to solve a very particular problem, there are no options nor is it refactoring into any kind of modules or reusable functions. The script uses a multipass approach to finding duplicate files. First, it walks all of the directories pass in and groups all files by size. In the next pass, the script walks each set of files of the same size and checksums the first 1024 bytes. Finally, the script walks each set of files that are the same size with the same hash of the first 1024 bytes and checksums each file in its entirety.The very last step is to walk each set of files of the same length/hash and delete all but the first file in the set.It ran against a 3.5 gigabyte set of files composed of about 120,000 files, of which there were about 50,000 duplicates, most of which were over 1 megabyte. The total run took about 2 minutes on a 1.33ghz G4 powerbook. Fast enough for me and fast enough without actually optimizing anything beyond the obvious.

Requirements: No special requirements
Platforms: Windows, Mac, *nix, Mac OSX, Linux, Python , BSD Solaris
Keyword: Delete Duplicate Duplicate Delete Duplicate Finder File Delete Finder
Users rating: 0/10

License: Freeware
USER REVIEWS
More Reviews or Write Review


DUPINATOR RELATED
Hard Drive Cleaners  -  Easy Duplicate Finder 1.4.4
Easy Duplicate File Finder is a free powerful tool, that helps you to find and delete duplicate files. How do you think, what hard disk space on your PC is occupied by duplicate files? Easy Duplicate Finder will show you! Features Search...
652.95 KB  
Automation Tools  -  Duplicate Finder Items 1.0
Duplicate Finder Items is a free Automator action that will automatically make a copy of each of the Finder items passed from the previous action into the same folder as the original item.
40.96 KB  
Word Processing  -  PCMate Free Duplicates Delete 6.6.4
Is your computer filling up and cluttered with duplicate files, images, movies and so on which take up much-needed hard disk space and clog up your machine? Now, PCMate Free Duplicates Delete - a feature-rich duplicate file detector easily finds &...
3.38 MB  
Book Collection Managers  -  Free Duplicate Finder 5.1.0.0
Duplicate File Finder will help you find fast all duplicate files in a folder and its sub folders. The applications will compare the content of your files so it will find duplicates even if they are using different file names. It uses fast binary...
1.53 MB  
Utilities  -  DuMP3 - duplicate & similar file finder 1.0
DuMP3 is a duplicate and similar file finder. It finds exact duplicate binaries by hash, similar text files by substring content, images (JPG, BMP, GIF, PNG, etc) by color and audio files (MP3, WAV, OGG, etc) by wave data. Future: fonts, video.
10.27 MB  
File Utilities  -  NoClone Home Edition 2011 5.1.14.0
NoClone will help you find and remove true duplicate files. This software will search and find duplicate files. NoClone searches your computer for duplicate files and removes them: this frees up disk space and improves file management. Too often...
 
Hard Drive Cleaners  -  Duplicate File Finder Mini 3.1
Duplicate File Finder Mini is a 100% freeware that used to fast find and delete the large (1 MB+) duplicate files on all your hard disks and removable storage devices, so as to recover your valuable disk space. It works very fast, usually, doing a...
476.39 KB  
Search & Replace Tools  -  PCTuneUp Free Duplicate File Finder 4.2.4
Do you feel confused why there are too many files when you sort through them in your computer? They must be duplicate files. PCTuneUp Free Duplicate File Finder is a powerful and reliable duplicate file finder tool will help you find and delete...
802.2 KB  
Hard Drive Cleaners  -  Fast Duplicate File Finder 4.1.0.1
Fast Duplicate File Finder will help you find fast all duplicate files in a folder and its sub folders. The applications will compare the content of your files so it will find duplicates even if they are using different file names. It uses fast...
2.66 MB  
File Utilities  -  AllDup Duplicate File Finder 3.3.20
AllDup is your reliable tool to help find and remove duplicate files in your computer. This freeware is capable of searching for all types of files in whatever format they may be stored in and easily deleting them or moving them to a separate...
3.23 MB  
NEW DOWNLOADS IN SCRIPTS, FILE MANAGEMENT
Scripts  -  Free Ecommerce website creator 1.2
Free Ecommerce website creator is a free PHP shop creating script. This allows you to put a online shop on your own website. Create your own free ecommerce website for Your Business. Create an online shop using easyGUI online shop creator. The...
1.44 KB  
Scripts  -  MochiGames PHP Script ZDR 1.00
MochiGames PHP Script ZDR is web site, ready for use, for flash games. These flash games are downloaded automatically by "MochiGames PHP Script ZDR" from MochiGames media. The use of the games is free, you can use your own Mochi Publisher ID and...
368.54 KB  
Scripts  -  Php Chat 2.0
Add a free php site, single sign-on and multiple skins, 100% free 1. Server Modes: The chat server has paid mode and free mode. If the free chat mode, a free chat room will be assigned to your website with your domain as the room name. 2....
938.87 KB  
Scripts  -  Nibbleblog 3.0.1
Nibbleblog it's a powerful engine for creation and manipulation of BLOG's completely free. Very simple to install and configure (Only 1 step). The database used is based on XML files and this way it is not necessary to use MySQL or similar DBMS....
371.09 KB  
Scripts  -  PHP File Manager | CloudOsys 2.9b8
CloudOsys is a PHP file manager, a tool that allows your visitors upload files such as media content directly to your website. Your visitors will upload files directly to your website, where they can share and comment on them. Through cloud...
1.41 MB  
File Management  -  YetiShare - File Hosting Script Free 2.1
YetiShare is a PHP script that allows you to create your own professional file sharing service that you can earn a revenue from. The script has a wide range of features including an extensive admin area, user accounts, and more. This is a free...
6.2 MB  
File Management  -  XtraUpload for File sharing 1.6
XtraUpload has all the features you would expect from a file Hosting Script. Free users as well as premium users have the ability to upload files but premium users get a lot more features such as viewing files, instantly downloading files and...
4.8 MB  
File Management  -  PHPGnuCacheII for File sharing 2.1.1
PHPGnuCacheII is a PHP/MySQL WebCache script for the gnutella/gnutella2 Peer-to-Peer network. It implements the Version 2 GWebCache specifications.
20.48 KB  
File Management  -  TorrentFlux for Download Managers 2.3
TorrentFlux is a FREE PHP based Torrent client that runs on a web server. It allows you to manage all of your Torrent downloads through a convenient web interface from anywhere. Features:- Upload Torrents via URL or File Upload- Start, Stop, and...
1.29 MB  
File Management  -  FastBeats for File sharing 2.0.95
FastBeats is an all-in-one BitTorrent Tracker content management system written in PHP.It uses a MySQL database to store all of your site content such as News, Torrents, Descriptions and much more. FastBeats is dedicated only for FastWeb users.
1.09 MB