Web::Scraper 0.32

Web::Scraper is a web scraper toolkit, inspired by Ruby's equivalent Scrapi. It provides a DSL-ish interface for traversing HTML documents and returning a neatly arranged Perl data strcuture.<br /><br />The scraper and process blocks provide a method to define what segments of a document to extract. It understands CSS and HTML Selectors as well as XPath expressions.<br /><br />SYNOPSIS<br /><br /> use URI;<br /> use Web::Scraper;<br /><br /> # First, create your scraper block<br /> my $tweets = scraper {<br /> # Parse all LIs with the class "status", store them into a resulting<br /> # array 'tweets'. We embed another scraper for each tweet.<br /> process "li.status", "tweets[]" => scraper {<br /> # And, in that array, pull in the elementy with the class<br /> # "entry-content", "entry-date" and the link<br /> process ".entry-content", body => 'TEXT';<br /> process ".entry-date", when => 'TEXT';<br /> process 'a[rel="bookmark"]', link => '@href';<br /> };<br /> };<br /><br /> my $res = $tweets->scrape( URI->new("http://twitter.com/miyagawa") );<br /><br /> # The result has the populated tweets array<br /> for my $tweet (@{$res->{tweets}}) {<br /> print "$tweet->{body} $tweet->{when} (link: $tweet->{link})n";<br /> }

Requirements:	No special requirements
Platforms:	*nix, Linux
Keyword:	Array,  Class,  Embed,  Parse,  Process,  Quotentrycontentquot,  Quotentrydatequot,  Quotstatusquot,  Quottweetgtbody,  Resulting,  Scraper,  Store,  Text,  Tweet,  Tweetgtlinkquot,  Tweetgtwhen,  Tweets,  Web,  Web Scraper,  Webscraper
Users rating:	0/10