Make Robots Txt
Log Analyzer will allow you to track spider visits and save log files with information on spider visits, as well as export it into different file formats. Robots.txt Editor is visual editor that will enable you to specify different directives for selected spiders in specific areas of the site and...
Platforms: Windows
License: Shareware | Cost: $99.90 USD | Size: 2.36 MB | Download (444): Robot Download |
The Revisionist is a tool for extracting and indexing hidden metadata (such as deleted or modified text) from large collections of MS Word files. It can operate whole Web sites or SMB or NFS directories. The Revisionist project is handy for pen-testing, or it can be used just to spot...
Platforms: *nix
License: Freeware | Size: 16.38 KB | Download (97): The Revisionist Download |
Looking to save as much time on routine SEO tasks as possible?
Introducing a huge time-saver - SEO PowerSuite toolset!
SEO PowerSuite Enterprise will make SEO easy. Here is what it allows you to do:
- Quickly discover tons of high-paying keywords in your niche (20+ keyword research...
Platforms: Windows, Windows 8, Windows 7, Windows Server
License: Shareware | Cost: $499.00 USD | Size: 569.89 MB | Download (1892): SEO PowerSuite Enterprise Download |
What if you could run all your SEO tasks using just one multi-feature SEO pack? Sounds too good to be true? SEO PowerSuite makes it real!
It is an all-in-one SEO bundle that includes four fast and effective SEO tools:
1. WebSite Auditor is an on-page SEO tool that helps you perform a...
Platforms: Windows, Windows 8, Windows 7, Windows Server
License: Shareware | Cost: $299.00 USD | Size: 569.89 MB | Download (2292): SEO PowerSuite Download |
mySitemap allows you to easily create HTML and XML sitemaps (Google Sitemaps) by scanning websites either locally or already on the internet. Once scanned, mySitemap will allow you to view, edit and export the sitemap for inclusion on your website.
With mySitemap you simply enter the...
Platforms: Mac
License: Shareware | Cost: $19.95 USD | Size: 3.48 MB | Download (93): mySitemap Download |
This simple robots.txt file will help deter some of the unwanted bots that spider your site for email adresses and things of that nature that result in spam. This works for all websites and it is not just limited to phpBB.This has also been configured to allow google adsense bots to spider your...
Platforms: Windows, *nix, PHP, BSD
License: Freeware | Download (54): Block Bad Bots Download |
RapidBot is the incredibly easy tool designed to create a robots.txt file for your site directly from RapidWeaver. Robots.txt file is retrieved by search engines, like Google and Bing, and used to state what pages need indexing and what must be ignored. A robot (also known as Spider or Web...
Platforms: Mac
License: Shareware | Cost: $0.00 USD | Size: 1.18 MB | Download (42): RapidBot Download |
TracRobotsTxt is a module that will serve a robots.txt file from Trac. Mostly useful to tracd users, but works on anything. Just put the data you want in the wiki page RobotsTxt. Configuration: To enable the plugin: [components] robotstxt.* = enabled A typical RobotsTxt wiki page will look...
Platforms: *nix
License: Freeware | Size: 10.24 KB | Download (39): TracRobotsTxt Download |
Robot-Analyzer works together with Search Engine optimization tools to specifically guide Search Engine spiders to relevant areas of your web site. If you are submitting regularly, but still not being awarded the listing you require, Robot-Analyzer will generate correctly formatted, industry...
License: Shareware | Cost: $39.95 USD | Size: 4.23 MB | Download (145): Robot-Analyzer Download |
Internet marketing is becoming one of the highest return-on-the-investment strategies these days. Cheap and effective, targeted e-mail sending replaces those older marketing methods due to its fantastic reach and convenience. Acquiring e-mail addresses of your potential customers is a cornerstone...
Platforms: Windows, Windows 8, Windows 7
License: Shareware | Cost: $79.85 USD | Size: 30.32 MB | Download (1455): Atomic Email Hunter Download |
Looking for a solid link building tool? Get LinkAssistant: industry's #1 software for effortless link building and link tracking!
The SEO tool lets you do a variety of link building tasks almost on auto-pilot:
- Discover thousands of niche-specific websites to get backlinks from (6 link...
Platforms: Windows, Mac, *nix, Java
License: Shareware | Cost: $99.75 USD | Size: 66.97 MB | Download (142): LinkAssistant Download |
Page Promoter is an ultimate URL registration, search engine optimization and promotion tool for submitting Web sites to thousands search engines and directories as well as preliminary site optimization and effectiveness check. The software allows you to enhance sites` exposure on the Internet...
Platforms: Windows
License: Shareware | Cost: $299.90 USD | Size: 6.85 MB | Download (137): Page Promoter Download |
Create text, HTML, RSS and XML sitemaps to help search engines like Google and Yahoo to crawl and index your website. Crawler is feature rich supporting many website crawling options. Configure amount of simultaneous connections to use. Supports crawler filters, robots.txt, custom connection and...
Platforms: Windows, Windows 7
License: Shareware | Cost: $69.00 USD | Size: 15.35 MB | Download (1303): A1 Sitemap Generator Download |
Internet marketing is becoming one of the highest return-on-the-investment strategies these days. Cheap and effective, targeted e-mail sending replaces those older marketing methods due to its fantastic reach and convenience. Acquiring e-mail addresses of your potential customers is a cornerstone...
Platforms: Windows
License: Shareware | Cost: $79.85 USD | Size: 1.86 MB | Download (686): Atomic E-Mail Hunter Download |
NetPromoter is an ultimate Search Engine Optimization, Web site promotion and site statistics software package, which copes with an entire spectrum of tasks, necessary to improve your search engine visibility, boost your site traffic and on-line sales. NetPromoter software package includes 8...
Platforms: Windows
License: Shareware | Cost: $699.90 USD | Size: 38.04 MB | Download (89): NetPromoter Pack Download |
Over 30 generators, Web 2.0 elements, tools and scripts for webmasters and web designers to speed up website building and save time and money. Website Toolbox Pro includes: a color palette generator, gradient images, stripe backgrounds, rounded corners, a favicon generator, .htaccess, .htpasswd...
Platforms: Windows
License: Shareware | Cost: $49.95 USD | Size: 283 KB | Download (495): Website Toolbox Pro Download |
WebSite Auditor is a multi-purpose SEO tool that takes complete care of on-page optimization - and saves you time!
It consists of two modules, one dealing with site structure analysis and the other one covering content optimization.
Here are just some things you can do with the WebSite...
Platforms: Windows, Windows 8, Windows 7, Windows Server
License: Shareware | Cost: $125.00 USD | Size: 569.93 MB | Download (2225): WebSite Auditor Professional Download |
Crawl the web with this free ActiveX web bot component. Advanced features include caching, "avoid" patterns, and robots.txt compliance.
Platforms: Windows
License: Freeware | Size: 532.48 KB | Download (510): Web Bot Programming Library Download |
Crawl a website with this free ActiveX spidering component. Advanced features include caching, "avoid" patterns, and robots.txt compliance.
Platforms: Windows
License: Freeware | Size: 532.48 KB | Download (461): Chilkat Spider ActiveX Download |
LinkChecker is a simple, very easy to use application specially designed to help you check websites and HTML documents for broken links. You just enter the URL or HTML doc to check, press Start and let LinkChecker take care of the rest. Features: recursive and multithreaded checking output in...
Platforms: Windows
License: Freeware | Size: 10.5 MB | Download (48): LinkChecker Download |