Robots Txt Generator

Advanced Robots.txt Generator is the most complete and easy to use application that allows you to create, maintain and keep track of your Robots.txt files for all your websites. The following is a list of the features of Advanced Robots.txt Generator. * Support for ~300 Robots and... Platforms: Windows

Create your robots.txt files in seconds and maintain them easilly and effortlesly with the unique utility Advanced Robots.txt Generator. Advanced Robots.txt Generator is the most complete and easy to use application that allows you to create, maintain and keep track of your Robots.txt files for... Platforms: Windows

Log Analyzer will allow you to download and save log files with information on spider visits, as well as export it into different file formats. Using Log Analyzer you can track spider visits, identify malicious and unwanted spiders and exclude them from your site and create spider visits reports... Platforms: Windows

Robots.txt Maker is a Windows application for Webmasters and Website Owners who want to create attention grabbing robots.txt files fast and easy! Robots.txt Maker includes the most popular User Agents that have been proven to index your files and directories. Crawl delay. Allow your Sitemap(s).... Platforms: Windows

On WP-MU installations it allows for every blog to have its own robots.txt file.InstallationUnpack and upload it to the /wp-content/plugins/ directory.Activate the plugin through the 'Plugins' menu in WordPress. Requirements: - WordPress 2.0 up to 2.5 Platforms: Windows, Mac, *nix, PHP, BSD Solaris

Just fill in a simple form and the robots.txt code is generated for you. Robots Txt Maker will generate the robots.txt file you need to help prevent the indexing of files and directories that if indexed by themselves could frustrate a visitor's search experience and possibly alienate them.... Platforms: Windows

A robots.txt file lets search engines (Google, Yahoo, MSN, etc) know which pages on your site you don't want them to index. This is helpful in keeping them from going to pages that will confuse them and/or won't provide any added benefit to you from having indexed.Since nobody has put one in here... Platforms: Windows, *nix, PHP, BSD

This is a simple application to create a robots.txt file for django. It has no models at all and you're supposed to edit a template to update the robots.txt file. I got tired of having to add this view to each and every project because Django doesn't have a built in text/plain view. Platforms: *nix

This module generates the robots.txt file dynamically and gives you the chance to edit it, on a per-site basis, from the web UI.Installation - Unpack to your Drupal site modules directory (usually /sites/all/modules/) - Enable from Administer > Site Building > Modules  Requirements: - Drupal... Platforms: Windows, Mac, *nix, PHP, BSD Solaris

Robot-Analyzer Professional works together with Search Engine optimization tools to specifically guide Search Engine spiders to relevant areas of your web site. If you are submitting regularly, but still not being awarded the listing you require, Robot-Analyzer will generate correctly formatted,...

Make your robots.txt file and meta tags by filling in simple form fields.Now you may give your web site the edge it needs to achieve higher rankings within search engine databases. You get 2 programsfor one low price.Even calculate meta tag word count for Title, Keywords, Description, Abstract,... Platforms: Windows

Make an unlimited number of online voting polls, rollovers, popups, audio players, robots.txt files, and meta tags by filling in simple form fields.You get 6 programs for one low price. Best of all, no special servers, monthly fees, or additional costs, View voting results immediately online. Add... Platforms: Windows

Make an unlimited number of online voting polls, popups, audio players, meta tags and robots.txt filesby filling in simple form fields.You get 5 programs for one low price.Best of all, there are no special servers, monthly fees or additional costs.View voting results immediately online. Add audio... Platforms: Windows

Visual SEO Studio is a desktop SEO Audit Tool, a Visual approach to make SEO tasks quick and easy. The program lets you Crawl one or more sites in parallel with its Interactive Web Spider, Spot on-site issues at a glance, Save Page Screenshot miniatures and see where the fold lays, visually... Platforms: Windows, Windows 7, Windows Server

Visual SEO Studio is a desktop SEO Audit Tool, a Visual approach to make SEO tasks quick and easy. The program lets you Crawl one or more sites in parallel with its Interactive Web Spider, Spot on-site issues at a glance, Save Page Screenshot miniatures and see where the fold lays, visually edit... Platforms: Mac

WebSite Auditor is a multi-purpose SEO tool that takes complete care of on-page optimization - and saves you time! It consists of two modules, one dealing with site structure analysis and the other one covering content optimization. Here are just some things you can do with the WebSite... Platforms: Windows, Windows 8, Windows 7, Windows Server

Create text, HTML, RSS and XML sitemaps to help search engines like Google and Yahoo to crawl and index your website. Crawler is feature rich supporting many website crawling options. Configure amount of simultaneous connections to use. Supports crawler filters, robots.txt, custom connection and... Platforms: Windows, Windows 7

Indexing of the title, description, keywords and full content of all HTML, ASP and TXT documents using a recursive call to all pages in a web site and sub folders excluding those folders listed in the robots.txt file. Simple search of the index for your web pages or advanced search for the... Platforms: Windows

Installation - Unpack in your modules folder (usually /sites/all/modules/) and enable under Administer > Site Building > Modules. Requirements: - Drupal 6.x Platforms: Windows, Mac, *nix, PHP, BSD Solaris

Page Promoter is an ultimate URL registration, search engine optimization and promotion tool for submitting Web sites to thousands search engines and directories as well as preliminary site optimization and effectiveness check. The software allows you to enhance sites` exposure on the Internet... Platforms: Windows