Ebsite Scraper

Octoparse is a powerful but easy-to-use and free web scraping tool that is being used by tens of thousands of individuals and companies all over the world. The word of Octoparse is the combination of the two words, “Octopus” and “Parse”....

Text::Scraper contains structured data from (un)structured text. SYNOPSIS use Text::Scraper; use LWP::Simple; use Data::Dumper; # # 1. Get our template and source text # my $tmpl = Text::Scraper->slurp(*DATA); my $src = get(http://search.cpan.org/recent) || die $!; # # 2. Extract...

screen-scraper project is a tool used to extract data from web sites. You might use screen-scraper for the following purposes: - Data Mining and Extraction - Data Migration - Application Integration - Business Intelligence - Web Task Automation - Portal Components - Meta-Searching -...


Platforms: *nix

WWW::Scraper::Dice Perl module contains Scrapes Dice : (skills,locations) => (title, location ,residue). SYNOPSIS use WWW::Search; my $oSearch = new WWW::Scraper(Dice); my $sQuery = WWW::Scraper::escape_query("unix and (c++ or java)"); $oSearch->native_query($sQuery, {method => bool,...


Platforms: *nix

WWW::Scraper::BAJobs it Scrapes BAJobs.com. SYNOPSIS require WWW::Scraper; $search = new WWW::Scraper(BAJobs); This class is an BAJobs specialization of WWW::Search. It handles making and interpreting BAJobs searches http://www.BAJobs.com. This class exports no public interface; all...


Platforms: *nix

WWW::Scraper::FlipDog it Scrapes www.FlipDog.com. SYNOPSIS use WWW::Scraper; use WWW::Scraper::Response::Job; $search = new WWW::Scraper(FlipDog); $search->setup_query($query, {options}); while ( my $response = $scraper->next_response() ) { # $response is a...


Platforms: *nix

Search engine scraper pulls back urls from top search engines based on keywords and footprints - - Find thousands of blogs , waraz downloads , forums, recipes etc Enter your keyword/footprint - Choose the search engine of your choice - work with proxies if you like - then click play - once...


Platforms: Windows, Mac

An easy to implement professional web scraper for WordPress. This can be used to display realtime data from any websites directly into your posts, pages or sidebar. Use this to include realtime stock quotes, cricket or soccer scores or any other generic content. The scraper is built using time...


Platforms: PHP

Extract data from Yellow Pages Directory such as Business Name, Street, City, State, ZipCode, Phone, Website and Email in a well structured comma separated file(CSV). Extract all business information based on your custom requirement. Yellow Pages Scraper is very easy to use for novice peoples...


Platforms: Windows, Mac, Linux

Web::Scraper is a web scraper toolkit, inspired by Ruby's equivalent Scrapi. It provides a DSL-ish interface for traversing HTML documents and returning a neatly arranged Perl data strcuture. The scraper and process blocks provide a method to define what segments of a document to extract. It...


Platforms: *nix

WWW::phpBB is a phpBB forum scraper Perl module. SYNOPSIS use WWW::phpBB; # scrape as guest my $phpbb = WWW::phpBB->new( base_url => http://localhost/~stefan/forum1, db_host => localhost, db_user => stefan, db_passwd => somepass, db_database => stefan, db_prefix => phpbb2_, );...


Platforms: *nix

Scrape websites and extract data into customizable CSV files ready to be imported anywhere like web databases and office tools. Also great for grabbing inventory lists you want to link or sell (e.g. if you are an affiliate). Mix and mash scraped website data to create new mashup website services...


Platforms: Windows

It features XPath and Regular Expression parsers out of the box and other customer parsers can be added.The module could be used, for example, to extract an image URL from within raw HTML and to map it in a FileField image field.Installation:Unpack in your modules folder (usually...


Platforms: PHP

This project sets out to create a powerful, robust, quick to deploy, web scraper. A web scraper is a tool that extracts specific parts of web pages rather than the entire html page as a crawler would. The outcome of this project will be a tool, written in Java, that accomplishes the following...


Platforms: Mac

Automate manual task of scraping search results URL from Google for PPV and other site promotion tools. Supports multiple Google searches, proxy servers. Software is free and easy to use. Make all your Internet promotion tasks much easier and more automatic using this software to search for...


Platforms: Windows, Windows 8, Windows 7, Windows Server

OutWit is the Web collection engine for everyone. It runs on your Windows, MacOS or Linux machine and allows you to browse through and easily grab online information, collect media, contacts or files from the Internet, in a few clicks. Find pictures in galleries and search engines and download...


Platforms: Windows, Windows 7, Windows Server

ScraperPOD is a framework for scraping results from search engines. SYNOPSIS use WWW::Scraper; # Name your Scraper module / search engine as the first parameter, use WWW::Scraper(eBay); # or in the new() method $scraper = new WWW::Scraper(eBay); Classic WWW::Search mode # Use a...


Platforms: *nix

It uses the Arin API to connect and return queries.


Platforms: Windows, Mac, *nix, Python, BSD Solaris

like to keep my TV rips well-organized, and labeled with the correct episode title. Id-deOaove been using the excellent Bulk Rename Utility to quickly rename with proper series title, season and episode numbersd-deOCLbut the individual episode titles were always a pain. Begrudgingly, Id-deOaod...


Platforms: PHP

It might be a bit paradoxical to place a Linux wallpaper on your Windows system, but nowadays anything is permissable, and anyway many users run both systems simultaeously. If you want to make it clear that you are pro Linux, then decorate your screen with this fun image of Tux (the Linux...


Platforms: Windows