Download Shareware and Freeware Software for Windows, Linux, Macintosh, PDA

line Home  |  About Us  |  Link To Us  |  FAQ  |  Contact

Serving Software Downloads in 976 Categories, Downloaded 29.542.641 Times

crawley-dev 0.0.1

Company: Crawley Developers
Date Added: September 17, 2013  |  Visits: 187

crawley-dev

Report Broken Link
Printer Friendly Version


Product Homepage
Download (16 downloads)



Crawley is Pythonic Crawling / Scraping framework intented to change the way you think about extracting data from the internet<br /><br />Features:<br /><br /> - High Speed WebCrawler built on Eventlet.<br /> - Store you data in relational databases like Postgres, Mysql, Oracle, Sqlite.<br /> - Export your data into Json, XML formats. New<br /> - Supports NoSQL databases like Mongodb and Couchdb. New<br /> - Command line tools.<br /> - Extract data using your favourite tool. XPath or Pyquery (A Jquery-like library for python).<br /> - Cookie Handlers for scraping login protected pages.<br /> - Very easy to use (see the examples).<br />

Requirements: No special requirements
Platforms: *nix, Linux
Keyword: Change Crawling Extracting Framework Intented Internet Pythonic Scraping
Users rating: 0/10

License: Shareware Size: 20.48 KB
USER REVIEWS
More Reviews or Write Review


CRAWLEY-DEV RELATED
Development Tools  -  Aloys Core Framework 0.1
Aloys Core Framework is a framework for Internet applications written in PHP/SQL (including mySQL).AloysCore gives all classes for dispatching modules calls, manage various environment variables, deal with multilingual texts, and access various...
225.28 KB  
Communication Tools  -  RadioDog 4.00alpha1
RadioDog is an all-purpose management framework for Internet Radio stations of all types, providing scheduling services, listener management, and DJ interfaces to make the life of a webcaster simpler.
22.08 KB  
Server Tools  -  Change IP 2.5
Change IP proxy is an encrypted anonymous ip changer that routes all Internet browsing through a secure tunnel enabling the user to surf anonymously. It features multiple servers and randomly rotating IP addresses. The IP addresses point to...
665.6 KB  
File Utilities  -  Phone Number Grabber Internet 5.5.0
Phone number Grabber Internet is a remarkable Internet Phone Number Finder Tool developed to assist in extracting phone numbers in bulk from internet. Tool can effortlessly extract phone numbers either through different search engines like Google,...
1.42 MB  
Development Editors  -  Magritte for Linux 0r2
Magritte is a framework to build user interfaces for Java, which are saved in XML files, allowing a user to change the interface without the need to recompile the code. It will also generate Java code to respond to GUI events.
2.04 MB  
Network & Internet  -  Konstrukt 3 Beta
Konstrukt is a REST-ful framework of controllers for PHP5. Key Aspects - Controllers are resources - URI-to-controller-mapping gives your application a logical structure - Routing based on logic rather than rules - Nested controllers...
399.36 KB  
Development Tools  -  SmartClient Framework 6.5
SmartClient brings the productivity and performance of desktop applications to standard web browsers. Key Features:Client-side Ajax In SmartClient, all presentation duties, and all HTML generation, takes place in the browser. No HTML generation or...
 
Web Browser Tools  -  Internet Exploration for Linux 0.8
Internet Exploration is easy to use. No bright icons. Quite natural and simple colors. That is surprisingly rare today. Recommended add-ons: Go classic extension (instead of NoUn Buttons) --- parts the back and forward...
10.24 KB  
Internet Client Suites  -  MicroVPN IP Changer 1.5
Protect your identity with MicroVPN HideIP VPN based proxy. Hide your IP now and benefit in seconds from Instant Internet Anonimity, full protection in WiFi hotspots, 24/7 support team, free trials, no setup fee, automated connection software....
379.29 KB  
Network & Internet  -  W2g 0.0.1
W2g is a framework for building Web-based applications such as online databases, intranet portals, or CRM systems. W2g applications are developed within the web browser, no coding is needed. However, if you are a programmer, you can extend the...
378.88 KB  
NEW DOWNLOADS IN LINUX SOFTWARE, PROGRAMMING
Linux Software  -  wpCache WordPress HTTP Cache 1.1
wpCache is a high-performance, distributed object, caching system application, generic in nature, but intended for use in speeding up dynamic web applications, by decreasing database load time. wpCache decreases dramatically the page and the...
2.85 MB  
Linux Software  -  Edraw Max for Linux 8
An all-inclusive diagramming software for OS X that is capable for 260+ drawing types including flowcharts, mind maps, org charts, infographics, floor plans, AWS network diagrams, Gantt charts, electrical schematics... and that is just the...
229.07 MB  
Linux Software  -  Polling Autodialer Software 3.4
ICTBroadcast Auto Dialer software has a survey campaign for telephone surveys and polls. This auto dialer software automatically dials a list of numbers and asks them a set of questions that they can respond to, by using their telephone keypad....
488 B  
Linux Software  -  Total Video Converter Mac Free 3.5.5
Total Video Converter Mac Free developed by EffectMatrix Ltd is the official legal version of Total Video Converter which was a globally recognized brand since 2006. Total Video Converter Mac Free is a free but powerful all-in-one video...
17.7 MB  
Linux Software  -  Skeith mod_log_sql Analyzer 2.10beta2
Skeith is a php based front end for analyzing logs for Apache using mod_log_sql.
47.5 KB  
Programming  -  FLEX-db Digital Asset Manager 3.0.9
FLEX-db - an enterprise Digital Asset Manager (DAM). It ingests and links metadata with files, creates thumbnails, and processes files using business rules. FLEX-db has a JSP client, Java app server for file input and output and an EJB metadata...
21.57 MB  
Programming  -  Libicom 0.9.0
The libicom library is a character based dynamicly linked library for Linux. It is used to remotely control the Icom IC-R8500 wide band receiver via an RS232 link. All call and return parameters to the control functions are character string based....
20.48 KB  
Programming  -  dotdesktop 0.3
Dotdesktop library provides ability to parse desktop entry file and access the information in a convenient way. Desktop entry file format is defined by freedesktop.org, it is used to describe information about an application such as the name and...
327.68 KB  
Programming  -  Cedalion for Linux 0.2.6
Cedalion is a programming language that allows its users to add new abstractions and define (and use) internal DSLs. Its innovation is in the fact that it uses projectional editing to allow the new abstractions to have no syntactic limitations.
471.04 KB  
Programming  -  libyasl 0.2
Libyasl is a C++ class library to easily realize TCP/UDP/Multicast clientsand servers in IPv4 and IPv6 environments under GNU/Linux systems.
143.36 KB