Download Shareware and Freeware Software for Windows, Linux, Macintosh, PDA

line Home  |  About Us  |  Link To Us  |  FAQ  |  Contact

Serving Software Downloads in 976 Categories, Downloaded 30.070.553 Times

mrjob 0.3.0

Company: David Marin
Date Added: November 28, 2013  |  Visits: 238

mrjob

Report Broken Link
Printer Friendly Version


Product Homepage
Download (16 downloads)

mrjob is a Python package that helps you write and run Hadoop Streaming jobs.<br /><br />mrjob fully supports Amazon's Elastic MapReduce (EMR) service, which allows you to buy time on a Hadoop cluster on an hourly basis. It also works with your own Hadoop cluster.<br /><br />Some important features:<br /><br /> * Run jobs on EMR, your own Hadoop cluster, or locally (for testing).<br /> * Write multi-step jobs (one map-reduce step feeds into the next)<br /> * Duplicate your production environment inside Hadoop<br /> o Upload your source tree and put it in your job's $PYTHONPATH<br /> o Run make and other setup scripts<br /> o Set environment variables (e.g. $TZ)<br /> o Easily install python packages from tarballs (EMR only)<br /> o Setup handled transparently by mrjob.conf config file<br /> * Automatically interpret error logs from EMR<br /> * SSH tunnel to hadoop job tracker on EMR<br /> * Minimal setup<br /> o To run on EMR, set $AWS_ACCESS_KEY_ID and $AWS_SECRET_ACCESS_KEY<br /> o To run on your Hadoop cluster, install simplejson and make sure $HADOOP_HOME is set.<br /><br />Installation<br /><br />python setup.py install

Requirements: No special requirements
Platforms: *nix, Linux
Keyword: Cluster Config Easily Environment Hadoop Handled Install Mrjobconf Package Packages Python Pythonpath Scripts Setup Tarballs Transparently Variables
Users rating: 0/10

License: Freeware Size: 122.88 KB
MRJOB RELATED
Games  -  BOOM Level Editor 1.0.0
Easily create, edit, and install levels into the popular retro Mac arcade game BOOM!
8.06 MB  
Desktop Utilities  -  Ubuntu Common Hooker 0.1
Ubuntu Common Hooker project aims to provide an interface for unknown file extensions to automatically install a certain packages when its called. Use cases Eduard is a schizophrenic, however his only obession and a way to calm him down is...
20.48 KB  
Libraries  -  PPM 2.1.8
PPM is a Perl Package Manager: locate, install, upgrade software packages. SYNOPSIS ppm genconfig ppm help [command] ppm install [--location=location] package1 [... packageN] ppm query [--case|nocase] [--abstract|author] PATTERN ppm remove...
53.25 KB  
Development Editors  -  ISSI 5.1.9.0
Inno Setup Script Includes is a library of functions that can be implemented very easily into your existing setups build with Jordan Russell's Inno Setup. In the past adding some customization to Jordan Russell's Inno Setup one had to look for...
1.09 MB  
Libraries  -  Personal Visual DialogScript 4.0
Visual DialogScript is a complete development environment for creating either programs or simple batch style scripts, written in a language called DialogScript. This freeware version is intended for students and home PC users. The package includes...
2.54 MB  
Shell & Desktop  -  pygtksourceview 1.90.3
pygtksourceview package contains python bindings for the version 2 of the GtkSourceView library. Installation: The simplest way to compile this package is: 1. `cd to the directory containing the packages source code and type `./configure to...
348.16 KB  
Shell & Desktop  -  gnome-python 2.19.2
gnome-python package contains python bindings for GNOME. Installation: The simplest way to compile this package is: 1. `cd to the directory containing the packages source code and type `./configure to configure the package for your system....
563.2 KB  
Programming  -  PyDELTAc 1.7.0
This package contains utilities for loading data from the DELTA (Description Language for Taxonomy) format, and the equivalent binary files used by the IntKey software. Installing PyDelta The easiest way to install PyDelta is from...
10.24 KB  
Programming  -  rapid-spring 0.5.0
spring content downloading You can use easy_install to get the package from the Python Package Index. easy_install -U rapid-spring If you do not have the script easy_install available then use your distribution's...
20.48 KB  
Programming  -  nimsp 0.3.2
nimsp is a Python library for interacting with the National Institute on Money in State Politics API. nimsp is a project of Sunlight Labs. Written by Michael Stephens. Source: http://github.com/mikejs/python-nimsp
10.24 KB  
NEW DOWNLOADS IN LINUX SOFTWARE, PROGRAMMING
Linux Software  -  Polling Autodialer Software 3.4
ICTBroadcast Auto Dialer software has a survey campaign for telephone surveys and polls. This auto dialer software automatically dials a list of numbers and asks them a set of questions that they can respond to, by using their telephone keypad....
488 B  
Linux Software  -  Total Video Converter Mac Free 3.5.5
Total Video Converter Mac Free developed by EffectMatrix Ltd is the official legal version of Total Video Converter which was a globally recognized brand since 2006. Total Video Converter Mac Free is a free but powerful all-in-one video...
17.7 MB  
Linux Software  -  Skeith mod_log_sql Analyzer 2.10beta2
Skeith is a php based front end for analyzing logs for Apache using mod_log_sql.
47.5 KB  
Linux Software  -  SLAX 6.0+
Slax is a modern, portable, small and fast Linux operating system with a modular approach and outstanding design. Despite its small size, Slax provides a wide collection of pre-installed software for daily use, including a well organized graphical...
190 KB  
Linux Software  -  GTK+ 2.5
GTK+, which stands for the GIMP Toolkit, is a library for creating graphical user interfaces for the X Window System. It is designed to be small, efficient, and flexible. GTK+ is written in C with a very object-oriented approach. Language bindings...
60 MB  
Programming  -  FLEX-db Digital Asset Manager 3.0.9
FLEX-db - an enterprise Digital Asset Manager (DAM). It ingests and links metadata with files, creates thumbnails, and processes files using business rules. FLEX-db has a JSP client, Java app server for file input and output and an EJB metadata...
21.57 MB  
Programming  -  Libicom 0.9.0
The libicom library is a character based dynamicly linked library for Linux. It is used to remotely control the Icom IC-R8500 wide band receiver via an RS232 link. All call and return parameters to the control functions are character string based....
20.48 KB  
Programming  -  dotdesktop 0.3
Dotdesktop library provides ability to parse desktop entry file and access the information in a convenient way. Desktop entry file format is defined by freedesktop.org, it is used to describe information about an application such as the name and...
327.68 KB  
Programming  -  Cedalion for Linux 0.2.6
Cedalion is a programming language that allows its users to add new abstractions and define (and use) internal DSLs. Its innovation is in the fact that it uses projectional editing to allow the new abstractions to have no syntactic limitations.
471.04 KB  
Programming  -  libyasl 0.2
Libyasl is a C++ class library to easily realize TCP/UDP/Multicast clientsand servers in IPv4 and IPv6 environments under GNU/Linux systems.
143.36 KB