Make Robots Txt

Log Analyzer will allow you to track spider visits and save log files with information on spider visits, as well as export it into different file formats. Robots.txt Editor is visual editor that will enable you to specify different directives for selected spiders in specific areas of the site and...

The Revisionist is a tool for extracting and indexing hidden metadata (such as deleted or modified text) from large collections of MS Word files. It can operate whole Web sites or SMB or NFS directories. The Revisionist project is handy for pen-testing, or it can be used just to spot...

Looking to save as much time on routine SEO tasks as possible? Introducing a huge time-saver - SEO PowerSuite toolset! SEO PowerSuite Enterprise will make SEO easy. Here is what it allows you to do: - Quickly discover tons of high-paying keywords in your niche (20+ keyword research...


Platforms: Windows, Windows 8, Windows 7, Windows Server

What if you could run all your SEO tasks using just one multi-feature SEO pack? Sounds too good to be true? SEO PowerSuite makes it real! It is an all-in-one SEO bundle that includes four fast and effective SEO tools: 1. WebSite Auditor is an on-page SEO tool that helps you perform a...


Platforms: Windows, Windows 8, Windows 7, Windows Server

mySitemap allows you to easily create HTML and XML sitemaps (Google Sitemaps) by scanning websites either locally or already on the internet. Once scanned, mySitemap will allow you to view, edit and export the sitemap for inclusion on your website. With mySitemap you simply enter the...


Platforms: Mac

This simple robots.txt file will help deter some of the unwanted bots that spider your site for email adresses and things of that nature that result in spam. This works for all websites and it is not just limited to phpBB.This has also been configured to allow google adsense bots to spider your...


Platforms: Windows, *nix, PHP, BSD

RapidBot is the incredibly easy tool designed to create a robots.txt file for your site directly from RapidWeaver. Robots.txt file is retrieved by search engines, like Google and Bing, and used to state what pages need indexing and what must be ignored. A robot (also known as Spider or Web...


Platforms: Mac

TracRobotsTxt is a module that will serve a robots.txt file from Trac. Mostly useful to tracd users, but works on anything. Just put the data you want in the wiki page RobotsTxt. Configuration: To enable the plugin: [components] robotstxt.* = enabled A typical RobotsTxt wiki page will look...


Platforms: *nix

Robot-Analyzer works together with Search Engine optimization tools to specifically guide Search Engine spiders to relevant areas of your web site. If you are submitting regularly, but still not being awarded the listing you require, Robot-Analyzer will generate correctly formatted, industry...

Internet marketing is becoming one of the highest return-on-the-investment strategies these days. Cheap and effective, targeted e-mail sending replaces those older marketing methods due to its fantastic reach and convenience. Acquiring e-mail addresses of your potential customers is a cornerstone...


Platforms: Windows, Windows 8, Windows 7

Looking for a solid link building tool? Get LinkAssistant: industry's #1 software for effortless link building and link tracking! The SEO tool lets you do a variety of link building tasks almost on auto-pilot: - Discover thousands of niche-specific websites to get backlinks from (6 link...


Platforms: Windows, Mac, *nix, Java

Page Promoter is an ultimate URL registration, search engine optimization and promotion tool for submitting Web sites to thousands search engines and directories as well as preliminary site optimization and effectiveness check. The software allows you to enhance sites` exposure on the Internet...


Platforms: Windows

Create text, HTML, RSS and XML sitemaps to help search engines like Google and Yahoo to crawl and index your website. Crawler is feature rich supporting many website crawling options. Configure amount of simultaneous connections to use. Supports crawler filters, robots.txt, custom connection and...


Platforms: Windows, Windows 7

Internet marketing is becoming one of the highest return-on-the-investment strategies these days. Cheap and effective, targeted e-mail sending replaces those older marketing methods due to its fantastic reach and convenience. Acquiring e-mail addresses of your potential customers is a cornerstone...


Platforms: Windows

NetPromoter is an ultimate Search Engine Optimization, Web site promotion and site statistics software package, which copes with an entire spectrum of tasks, necessary to improve your search engine visibility, boost your site traffic and on-line sales. NetPromoter software package includes 8...


Platforms: Windows

Over 30 generators, Web 2.0 elements, tools and scripts for webmasters and web designers to speed up website building and save time and money. Website Toolbox Pro includes: a color palette generator, gradient images, stripe backgrounds, rounded corners, a favicon generator, .htaccess, .htpasswd...


Platforms: Windows

WebSite Auditor is a multi-purpose SEO tool that takes complete care of on-page optimization - and saves you time! It consists of two modules, one dealing with site structure analysis and the other one covering content optimization. Here are just some things you can do with the WebSite...


Platforms: Windows, Windows 8, Windows 7, Windows Server

Crawl the web with this free ActiveX web bot component. Advanced features include caching, "avoid" patterns, and robots.txt compliance.


Platforms: Windows

Crawl a website with this free ActiveX spidering component. Advanced features include caching, "avoid" patterns, and robots.txt compliance.


Platforms: Windows

LinkChecker is a simple, very easy to use application specially designed to help you check websites and HTML documents for broken links. You just enter the URL or HTML doc to check, press Start and let LinkChecker take care of the rest. Features: recursive and multithreaded checking output in...


Platforms: Windows