Search Crawler

On WP-MU installations it allows for every blog to have its own robots.txt file.InstallationUnpack and upload it to the /wp-content/plugins/ directory.Activate the plugin through the 'Plugins' menu in WordPress. Requirements: - WordPress 2.0 up to 2.5 Platforms: Windows, Mac, *nix, PHP, BSD Solaris

pro-search is a crawler for FTP servers, SMB shares, HTTP servers, and DC++ networks.. Platforms: *nix

PHP Crawler is a simple website search script for small-to-medium websites. The only requrements are PHP and MySQL, no shell access required. Platforms: Windows, Mac, *nix, PHP, BSD Solaris

PRO-Search is a crawler of FTP servers, SMB shares, HTTP, dc networks with powerful web search and navigation interface. Platforms: Windows, Mac, *nix, Perl, BSD Solaris

It is basically a program that can make you a search engine. It is a web crawler, has all the web site source code (in ASP, soon to be PHP as well), and a mysql database. Platforms: Windows, Mac, *nix, PHP, BSD Solaris

PHP Search is a search engine script that searches a MySQL database for links and descriptions much like google. Manual adding of Data. Crawler Coming soon! Demo at http://www.jhosting.tk/admin/search/search.php Platforms: *nix

Tiny Search Engine searhes a range of Web sites for given keywords. Unlike other searchers it doesn&apost make use of on-line search engines and so offers more up-to-date search results. Features include embedded web server, content filters and other advanced tools. Platforms: Windows

The Zoom Search Engine is a free package that allows web developers to add an industrial-strength custom search to their website in a matter of minutes. It is an extremely easy-to-use application that requires no complicated server-side set-up procedures. It can also be used to create search... Platforms: Windows

a free tool for webmasters With Crawler Alert, you get an automatically email notification whenever a search engine crawler (spider/agent/robot) is scanning your website. Platforms: all

Power Search can find or capture anything embedded in HTML, CSS or JavaScript. Many websites are built from server-side scripts that dynamically generate content each time a page is loaded. Website content may come from databases, files, or from a different server all together. Power Search... Platforms: Windows, 2003, Windows Vista, 2008, 7, 7x64

Ex-Crawler is divided into 3 subprojects (Crawler Daemon, distributed gui Client, (web) search engine) which together provide a flexible and powerful search engine supporting distributed computing. More informations: http://ex-crawler.sourceforge.net Platforms: Windows, Mac, Solaris, Linux

YACY is a p2p-based search engine for the WWW, based on it's distributed crawler and the built-in caching/scraping http proxy. Brings it's own database, has a httpd/web interface. Implemented in Java, supports all platforms. Platforms: Windows, Mac, Linux

The application is based on other open source technologies like POI, Lucene, Zkoss and Tagsoup. Key features "OSS Open Search Server": - Multi-language indexing. Documents can be indexed in ten languages OCo English, French, German, Spanish, Italian, Portuguese, Finnish, etc. - Multi-lingual... Platforms: Windows, Mac, *nix, Java, BSD Solaris

Maian Search is a very simple search engine for your website that stores your pages in a database. It is ideal for small websites that don`t need a site crawler to regularly update pages. Easily create a custom search page and an import function is also included. Features: - Simple search engine.... Platforms: Windows, Mac, *nix, PHP, BSD Solaris

LAN Search Pro is a free utility for fast file searching across your local network. You can search for specific file names or for specific file types (e.g. all MP3 files). LAN Search Pro provides a lightning fast search engine and includes the ability to search within hidden network resources,... Platforms: Windows, Windows 8, Windows 7, Windows Server

Registry Crawler enables system administrators, developers and other power users to quickly find and configure Registry settings. The software provides a powerful search engine that allows you to find Registry information based on a search criterion. Results are displayed in a list allowing you...

Search Accelerator 1.0 A software utility for searching the Internetin order to find something(shareware, mp3, web, game), fast.Search Accelerator provides a handy and efficient way to find iThe fastest way to search the Internet and it's FREE. No experience needed to use this meta-search... Platforms: Windows

The softpit PC search light is a handy tool for those who need to find critical information fast and precisely on their own computer. Easy to use and no computer skill needed. Platforms: Windows

Search the top search engines simultaneously for a better search. Get all of the best relevant results combined from search engines such as Google, Yahoo!, AltaVista and Lycos with this fast, easy-to-use and free desktop Internet meta search tool. Simply enter what you are looking for and Arrow... Platforms: Windows

Free 1-hour search engine optimization crash course on the basics of search engine optimization & how to submit to search engines. The course is broken down into 10 chapters: 1. What Is Search Engine Optimization? 2. Search Engine Optimization Part 1: Meta Tags 3. Search Engine... Platforms: Windows