Web Scraping Tools

'Web Test Tools' is an open source project which provides tools for different kind of testing such as unit tests (JUnit), and different kinds of tests for applications. Additionaly you can download here good implementation of internet protocols in Java.

Diggernaut is a cloud based service for web scraping, data extraction and other ETL (Extract, Transform, Load) tasks. If you are a reseller of goods and your supplier does not let you have their data in a suitable format, such as excel or csv, you will have to manually retrieve data from their...

If you love the Chrome web browser, but are tired of repetitive tasks like visiting the same sites every days, filling out forms, and remembering passwords, then iMacros for Chrome is the solution you've been dreaming of! iMacros was designed to automate the most repetitious tasks on the...


Platforms: Windows, Mac, *nix

Open Site Builder automates the essential task of a web development mechanism -- generating final pages by populating a predefined page template with content from source files. This allows to separate page layout development from content creation.


Platforms: Windows, Mac, Linux

This suite of cgi scripts and perl modules enables web hosting servers to give their clients some web based tools to manage their own files. The tools ranges from very basic web page creation to complicated file management. Similar to Geocities.com tools


Platforms: Windows, Mac, Linux

phpCampaignTools is an archive of web campaign tools which have been built using PHP/MySQL. The most active component was a ePetition tool. The scripts are very easy to install, use and customize to suit your needs. The scripts output is compatible with all modern web browsers.


Platforms: Windows, Mac, *nix, PHP, BSD Solaris

Octoparse is a powerful but easy-to-use and free web scraping tool that is being used by tens of thousands of individuals and companies all over the world. The word of Octoparse is the combination of the two words, “Octopus” and “Parse”....


Platforms: Windows, Windows 7

SMHelper provides Web-based tools to speed up the process of keeping paperwork for each show. Stage Managers Helper is a set of PHP scripts to assist the Stage Managers of the world in keeping all the minutiae and paperwork which is associated with live entertainment under control. Rather than...


Platforms: *nix

FreeTpl PHP Shopping Cart supports Downloadable products with instant activation option, especially useful for software companies selling their products via the Internet & could be easily integrated into any system widely utilizing the power of templates and web-administration tools. Shopping...


Platforms: *nix

OpenNGO project is an open source project to create a set of web-based tools designed to meet the needs of small U.S. nonprofit organizations and non-governmental organizations across the globe. CiviCRM is the first release of the OpenNGO project to create relationship management software for...


Platforms: *nix

IRobot is the Internet-robot engine for Visual Web automation and Web scraping. Completely automatic Web recording. Create your own IRobot Web robot agents to automate everything on the Web. Support Web data integration and computation. Share your Web experience with your friends. Batch form...


Platforms: Windows

Selenium Alternatives Reviwer is a great platform to review and compare web testing tools in order to find out the best best selenium alternative for automated web app tests. There are four dimensions： Analyze Selenium Issues and Problems What are the difficulties or challenges you...


Platforms: Windows, Windows 7

Add encrypted and protected images to WordPress web pages. Upload and add encrypted images from the WP editor. Secure Image encrypted images provide protection for images from page saves and web scraping. Images are safe from download and saving while on display in a web browser and also safe...


Platforms: Windows, Windows 8, Windows 7, Windows Server

LinkedIn Sales Navigator Extractor extracts contact information from LinkedIn and Sales Navigator at an exceptionally fast rate. It is the exceptional extractor software to extract contact information such as first name, last name, email, business name, twitter, skype, address, phone number,...


Platforms: Windows, Windows 8, Windows 7

RankQuest SEO Tools aims to help Web masters in search engine optimization. RankQuest SEO Tools is Keyword Finder and Meta Tag Analyzer are among the most important tools for SEO. Keyword Finder lists the keywords in the meta keyword tag of a site. Meta Tag Analyzer examines the meta...


Platforms: *nix

Free web editor especially for beginners and non-web-technical people. It uses "content + template = a web site". No need to code HTML. What You See Is What You Get. No need to design. Get a nice looking by a ready-made or custom-made web template. No need to learn. It allows anyone to update,...


Platforms: Windows

The Web browser is probably the most frequently used software today, and many tasks are highly repetitious. iMacros relieves the repetition of checking on the same sites every day, remembering passwords and filling out web forms. Web professional can use the software for functional testing and...


Platforms: Windows

XMLPublication project is a collection of tools to generate Web pages from desktop documents or other structured documents, such as books with paragraphs, or tabular data. It cuts documents into Web pages, and creates customizable multi-indices. All this is done through a repeatable process...


Platforms: *nix

The web crawler is a program that automatically traverses the web by downloading the pages and following the links from page to page. A general purpose of web crawler is to download any web page that can be accessed through the links. This process is called web crawling or spidering. Many sites,...


Platforms: Windows, Mac, Linux, Linux Console, Linux Gnome, Linux GPL, Linux Open Source, Java

The Web Developer extension adds a menu and a toolbar to the browser with various web developer tools. It is designed for Firefox, Flock and Seamonkey, and will run on any platform that these browsers support including Windows, Mac OS X and Linux.


Platforms: Mac