Hadoop

hadoop-bam is a Java library for manipulation of BAM (Binary Alignment/Map) and BGZF-compressed files using the Hadoop MapReduce framework with the Picard SAM JDK. Platforms: Mac

The goal of the Hadoop UI project is to provide an intuitive, powerful and accessible client for the Hadoop map reduce framework. The following features have been implemented: * HDFS Explorer: file manager for distributed file system (HDFS) * Job Manager: Monitor and manage Hadoop jobs on... Platforms: Mac

This is an eggified version of the hadoop and hive thrift python libraries. The libs are extracted from clouderas hadoop distribution and the version of this package includes the upstream version of the hadoop distribution. Platforms: *nix

A framework for batch-processing RDF data with Hadoop and Amazon Elastic MapReduce. Platforms: Ruby

mrjob is a Python package that helps you write and run Hadoop Streaming jobs. mrjob fully supports Amazon's Elastic MapReduce (EMR) service, which allows you to buy time on a Hadoop cluster on an hourly basis. It also works with your own Hadoop cluster. Some important features: * Run jobs on... Platforms: *nix

This software allows for a user to generate test data. This is useful for testing Hadoop or other data processing clusters. Features Test Data Generator Platforms: Mac

Framework for development of simple evolutionary algorithms / island models programs in distributed environment using MapReduce programming model based on hadoop. Platforms: Windows, Mac, Linux

A web-based interface for the Hadoop MapReduce framework that simplifies the process of writing and running MapReduce jobs. Aimed at introducing parallelism concepts in introductory computer science courses. Platforms: Windows, Mac, Linux

HDFS-CLI is an interactive command line shell that makes interacting with the Hadoop Distribted Filesystem (HDFS) simpler and more intuitive than the standard command-line tools that come with Hadoop. If you are familiar with OS X, Linux, or even Windows terminal/console-based applications, then... Platforms: Mac

X-RIME is a open source project devoted to provide Hadoop based solution for large scale social network analysis. Platforms: *nix

Thumbor is a smart imaging service. It enables on-demand crop, resizing and flipping of images. https://github.com/globocom/thumbor/wiki Hbase is a column oriented database from the hadoop ecosystem. https://hbase.apache.org/ This module provide support for Hadoop Hbase as large auto replicant... Platforms: *nix

Thumbor is a smart imaging service. It enables on-demand crop, resizing and flipping of images. https://github.com/globocom/thumbor/wiki Hbase is a column oriented database from the hadoop ecosystem. https://hbase.apache.org/ This module provide support for Hadoop Hbase as large auto replicant... Platforms: *nix

WebMapReduce is a simple web-based user interface for creating and submitting Hadoop Map-Reduce jobs in practically any language. It is ideally suited for use in the introductory computer science classroom, requiring very little programming experience to write massively parallel programs. Some... Platforms: *nix

Pentaho is the open source business intelligence leader. Thousands of organizations globally depend on Pentaho to make faster and better business decisions that positively impact their bottom lines. Download the Pentaho BI Suite today if you want to speed your BI development, deploy on-premise or... Platforms: *nix

hbase-thrift is a Python client for the HBase Thrift interface. HBase is the Hadoop database. Use it when you need random, realtime read/write access to your Big Data. This project's goal is the hosting of very large tables -- billions of rows X millions of columns -- atop clusters of commodity... Platforms: *nix

The pomsets-core package implements the core functionality for workflow management in the cloud. pomsets is a computational workflow management system for your cloud infrastructure. pomset is short for "partially-ordered multiset". It is a mathematical model for defining concurrent processes... Platforms: *nix

This release primarly supports Hadoop 1.0 or Cloudera CHD3 Update 3 (Which ships 0.20.2). If you wish to use Hadoop Streaming with MongoDB, please see the notes on Streaming Hadoop versions below. This product only supports MongoDB 2.0+; although it should (mostly) work with 1.8.x. We cannot... Platforms: *nix

Desktop.Tech is the Swiss army knife of desktop applications! Upload and download from FTP, SSH/SCP and Amazon S3 servers. In the future more protocols will be added! You can explore your harddrive with the internal Windows Explorer replacement. Search your harddrive with an lightning fast... Platforms: Windows, Windows 8, Windows 7, Windows Server

Platform for parallel computation in the Amazon cloud, including machine learning ensembles written in R for computational biology and other areas of scientific research. Home to MR-Tandem, a hadoop-enabled fork of X!Tandem peptide search engine. Platforms: Windows, Mac, Linux

Software for optimization of multi modal, multi dimensional functions based on SOMA algorithm. Program is implemented on top of hadoop, and is especially well suited for functions with high computational times because of its distributed nature. Platforms: Windows, Mac, Linux