Download Shareware and Freeware Software for Windows, Linux, Macintosh, PDA

line Home  |  About Us  |  Link To Us  |  FAQ  |  Contact

Serving Software Downloads in 956 Categories, Downloaded 49.589.596 Times

Crawler software
Filter: All | Freeware | Demo
 

Crawler

< 1 2 3 4 5 > 
Added: May 10, 2013 | Visits: 944

Astanda Directory Project 1.3b Astanda Directory Project [ADP] is a directory, search engine, and spider/crawler software. Your own little breed of DMOZ and Google. ADP is the only software in its class ever to be written in PHP with MySQL database support. Supports virtually unlimited ammount of links and pages. Powered by...



Platforms: Windows, Mac, *nix, PHP, BSD Solaris

License: Freeware Download (97): Astanda Directory Project 1.3b Download

Added: May 10, 2013 | Visits: 509

Heritrix Heritrix is the Internet Archive's open-source, extensible, web-scale, archival-quality web crawler project. Heritrix (sometimes spelled heretrix, or misspelled or missaid as heratrix/heritix/ heretix/heratix) is an archaic word for heiress (woman who inherits). Since this crawler seeks to...





Platforms: Windows, Mac, *nix, Java, BSD Solaris

License: Freeware Download (55): Heritrix Download

Added: May 10, 2013 | Visits: 761

Webtools 4 larbin Larbin is a Web crawler intended to fetch a large number of Web pages. It should be able to fetch more than 100 millions pages on a standard PC with much u/d. This set of PHP and Perl scripts, called webtools4larbin, can handle the output of Larbin.


Platforms: Windows, Mac, *nix, PHP, BSD Solaris

License: Freeware Download (59): Webtools 4 larbin Download

Added: May 10, 2013 | Visits: 868

PRO-Search PRO-Search is a crawler of FTP servers, SMB shares, HTTP, dc networks with powerful web search and navigation interface.


Platforms: Windows, Mac, *nix, Perl, BSD Solaris

License: Freeware Download (68): PRO-Search Download

Added: May 10, 2013 | Visits: 484

PKTorrents 0.1b PKTorrents has the functionality to crawl the top torrent sites, Meganova, Mininova, Piratebay, Snarf, Torrentportal, Torrentspy and adding 1000's of torrents to the db as it gos using the well know ibitzy torrent spider/crawler!! Users can now update torrents, rate torrents and use simple BB...


Platforms: Windows, Mac, *nix, PHP, BSD Solaris

License: Freeware Download (57): PKTorrents 0.1b Download

Added: July 18, 2013 | Visits: 572

Bee-rain Bee-rain is a web crawler that harvest and index file over the network. It is a free PHP search engine software.Bee-rain helps you in your sleep by comparing, filtering, analyzing citations of brands, companies and personalities on the Internet. Bee-rain then produces statistics and visualization...


Platforms: PHP

License: Freeware Size: 4.28 MB Download (46): Bee-rain Download

Added: October 12, 2013 | Visits: 370

FoxySpider FoxySpider is your personal web crawler! It can crawl into a given web site and retrieve what you really want (video clips, images, music files, etc.). FoxySpider displays the located items in a well-structured thumbnail gallery for ease of use.


Platforms: Mac

License: Freeware Size: 71.68 KB Download (34): FoxySpider Download

Added: July 08, 2013 | Visits: 458

AWSpider AWSpider is a web crawler for Amazon Web Services, written in Python. #md5=53f2f7be2f926c9f4b2c867b657ef59b


Platforms: Mac

License: Freeware Size: 40.96 KB Download (36): AWSpider Download

Added: June 13, 2013 | Visits: 366

Bitvo Bitvo is a media crawler and downloader. Point it to a web site or thumbnail gallery and it will seek out images, videos, and audio files and download them directly to your computer.


Platforms: Mac

License: Shareware Cost: $0.00 USD Size: 10.24 KB Download (43): Bitvo Download

Added: November 04, 2013 | Visits: 356

John Wehr AWSpider is a web crawler for Amazon Web Services, written in Python. #md5=edb1228e36df1a72e28bb07119e7a2e2


Platforms: *nix

License: Freeware Size: 40.96 KB Download (35): John Wehr Download

Added: July 10, 2013 | Visits: 324

AWSpider for Linux AWSpider is a web crawler for Amazon Web Services, written in Python #md5=edb1228e36df1a72e28bb07119e7a2e2


Platforms: *nix

License: Freeware Size: 40.96 KB Download (34): AWSpider for Linux Download

Released: August 02, 2015  |  Added: October 14, 2015 | Visits: 1.678

Arclab Website Link Analyzer Arclab Website Link Analyzer is a software website crawler to analyze and optimize your website. It spiders your whole website checking for broken links, duplicate content, missing tags and other SEO issues. The program spiders your website the same way as search engine robots. It scans each...


Platforms: Windows, Windows 8, Windows 7, Windows Server

License: Shareware Cost: $49.95 USD Size: 3.95 MB Download (89): Arclab Website Link Analyzer Download

Released: September 16, 2023  |  Added: October 05, 2023 | Visits: 332

InterroBot InterroBot combines a web crawler with advanced filtering to help you get answers to just what the heck is going on with your website. Whether you're looking for a snippet of text in the body of your target webpages, the HTTP headers, or a specific HTTP status code-InterroBot will help you...


Platforms: Windows, Windows 8, Windows 7, Windows Server

License: Shareware Cost: $65.00 USD Size: 77.02 MB Download (67): InterroBot Download

Added: October 03, 2006 | Visits: 3.932

Option Crawler Provides complete stock option chains from Internet, calculates all standard option values including Theoretical Value, Percent to Double, Implied Volatility, the Greeks, Historical Volatility. Allows for easy building of option strategy by pointing and clicking on individual contracts from the...


Platforms: Windows

License: Shareware Cost: $99.95 USD Size: 11.75 MB Download (265): Option Crawler Download

Released: March 29, 2004  |  Added: August 20, 2006 | Visits: 4.539

Newz Crawler NewzCrawler is a web news reader & browser which provides access to the a news content from different sources: - Syndicated news given in XML-based formats (RSS, ATOM, CDF, BackSlash, ScriptingNews etc.); - Usenet (NNTP) newsgroups; - Web pages. NewzCrawler gathers news content from each source...


Platforms: Windows

License: Shareware Cost: $24.95 USD Size: 1.37 MB Download (238): Newz Crawler Download

Added: November 05, 2006 | Visits: 2.236

GluedOn GluedOn keeps your computer on the Internet by simulating activity. This keeps your dial-up ISP from terminating your connection due to inactivity. GluedOn is a crawler, and includes many options. Proxy server support is included. GluedOn can be minimized to the system tray for easy access. You...


Platforms: Windows

License: Shareware Cost: $9.99 USD Size: 883 KB Download (139): GluedOn Download

Added: August 27, 2008 | Visits: 2.181

Guest book Crawler There are millions of guest books at the web! Imagine, that only a little part of them have your link. The software enables you to post to many guest books. You are searching in search engines for guest books and the software is submitting the link. You must care for the submission of every link,...


Platforms: Windows

License: Shareware Cost: $149.00 USD Size: 396 KB Download (102): Guest book Crawler Download

Added: August 14, 2008 | Visits: 2.323

ADP Astanda Directory Project is a directory, search engine, and spider/crawler software. Your own little breed of DMOZ and Google. ADP is the only software in its class ever to be written in PHP with MySQL database support. Supports virtually unlimited ammount of links and pages. Powered by Smarty...


Platforms: Windows

License: Shareware Cost: $0.00 USD Size: 181 KB Download (595): ADP Download

Added: August 22, 2008 | Visits: 2.356

WebReaper WebReaper is web crawler or spider, which can work its way through a website, downloading pages, pictures and objects that it finds so that they can be viewed locally, without needing to be connected to the Internet. The sites can be saved locally as a fully-browsable website which can be viewed...


Platforms: Windows

License: Freeware Size: 1.2 MB Download (254): WebReaper Download

Added: August 08, 2008 | Visits: 1.686

Spiderman Wall Crawler Spiderman has been in many films, comics and adventures. By day Peter Parker, a young science student, Spiderman has millions of fans across the world, and he now actually forms a part of a new breed of superheroes called The New Avengers.If you think you are a fan of Spiderman, you can now...


Platforms: Windows

License: Freeware Size: 1024 B Download (222): Spiderman Wall Crawler Download

< 1 2 3 4 5 >