Yahoo Web Crawler

A stand-alone web crawler that generates xml sitemaps, finds broken links, and validates markup & css so you can maintain error free, fully indexed sites without sacrificing productivity. - Added free offers. - Made compatible with 32-bit Macs. - Modified scanner to ignore content received with...

Mail Forward allows you to forward mail from AOL, Gmail, Hotmail, MSN, Netscape, and Yahoo web mail accounts to any e-mail address. Standard POP and IMAP e-mail accounts can also be forwarded. Mail can be forwarded for up to 20 separate accounts. For each account, a forwarding address can be...

The CMS - Bandits is a set of PHP scripts that implement an online HTML editor, calendar, search engine, RSS reader and editor, image gallery, comment system,Web crawler and many more.


Platforms: Windows, Mac, *nix, PHP, BSD Solaris

SiteAnalyzer it is a web crawler to scan the websites and check their technical and of SEO-parameters for errors and correct them effectively. Key features of the SiteAnalyzer - Scanning of all pages of the site, as well as images, scripts and documents - Getting server response codes for...


Platforms: Windows, Windows 8, Windows 7, Windows Server

Astanda Directory Project [ADP] is a directory, search engine, and spider/crawler software. Your own little breed of DMOZ and Google. ADP is the only software in its class ever to be written in PHP with MySQL database support. Supports virtually unlimited ammount of links and pages. Powered by...


Platforms: Windows, Mac, *nix, PHP, BSD Solaris

The Web Curator Tool (WCT) is an open-source workflow management application for selective web archiving. It is designed for use in libraries and other collecting organisations, and supports collection by non-technical users while still allowing complete control of the web harvesting process. It...


Platforms: *nix

Fresh WebSuction is designed for downloading Web pages or web contents (reference material, software files, online books, e-zines, news articles) for viewing offline, and saving money on Internet connection fees. If you pay fees for the amount of time you are online you can save money by quickly...


Platforms: Windows

Octoparse is a powerful but easy-to-use and free web scraping tool that is being used by tens of thousands of individuals and companies all over the world. The word of Octoparse is the combination of the two words, “Octopus” and “Parse”....


Platforms: Windows, Windows 7

PHPCrawl is a set of classes written in PHP for crawling/spidering websites, so just call it a webcrawler-library for PHP. The crawler "spiders" websites and delivers information about all found pages, links, files and so on to users of the library. By overriding a special method of the...


Platforms: Windows, Mac, *nix, PHP, BSD Solaris

Below are detailed breakdown of other features/options found in GooGNews and additional information about their usage. 1)Show Latest News Only Use: On average, Google News Homepage contains 100++ news articles. It may seem like a good idea to display all of these news on GooGNews. In actual fact,...


Platforms: Windows

Snitz Forums 2000 is one of the best ASP based bulletin board systems on the market. Getting better every day! A complete board system (forum) that allows the user access to a friendly and intuitive interface. Features: - Complete web based administration - Unlimited Forums - Unlimited...


Platforms: Windows, *nix, ASP,

AndyChat is a program for chatting to people over various network protocols. It was originally designed as a chat program which can work only on IPX networks. Now its fast becoming a command line Curses based IRC client which will eventually have all the features of AndyChat v2.xx minus the IPX...


Platforms: *nix

Wayback Machine is an open source java implementation of the The Internet Archive Wayback Machine. The current production version of the Wayback Machine is implemented in perl, and lacks in maintainability and extensibility. Also, the code is not open source. Primary motivation for the new...


Platforms: *nix

External Site Catalog allows you to index and search external sites in a Plone site. ExternalSiteCatalog is a web crawler that can index external sites and make them searchable in Plone. You can specify the sites to index in a Plone Configlet, and directly index them from Plone, or let a...


Platforms: *nix

Desktop IRIS is an easy-to-use search program that can be successfully downloaded and accessed by anyone. It allows you to intuitively find stored information from your desktop and network without imposing any restrictions on the number of files and folder locations indexed. The system uses the...


Platforms: Windows, Mac

Netifera is a new modular open source platform for creating network security tools. This project provides many advantages for both security developers and researchers who want to implement new tools as well as the community of users of these tools. * TCP and UDP network scanning and service...


Platforms: Mac, Linux

This plugin was born because there was a no other real alternative to enable content sparationd and some CMS like functionalities in WordPress. The main goal was, to enhance WordPressd-deOaos functionalities, to hide some unwanted categories, from defined parts of the blog.Today, ACE can override...


Platforms: PHP

This module is under active development for a Drupal 6 upgrade have a look at the roadmap/progress Nutch RoadmapNutch is a web crawler/indexer/search engine that is based on Lucene. It is a Java tool.This module allows you to have basic control over the Nutch crawl lifecycle through the Drupal...


Platforms: PHP

Xapian is an Open Source Probabilistic Information Retrieval library, released under the GPL. Xapian iss written in C , with bindings to allow use from other languages (Perl, Java, Python, PHP, and TCL are currently supported; Guile and C# are being worked on). Xapian is designed to be a highly...


Platforms: *nix

Majento SiteAnalyzer is a web crawler (web spider) to scan the websites and check their technical and of SEO-parameters for errors and correct them effectively. Key features - Scanning of all pages of the site, as well as images, scripts and documents - Obtaining server response codes for...


Platforms: Windows, Windows 8, Windows 7, Windows Server