Apache Hadoop has been the driving force behind the growth of the big data industry. You'll hear it mentioned often, along with associated technologies such as Hive and Pig. But what does it do, and ...

MapReduce was invented by Google in 2004, made into the Hadoop open source project by Yahoo! in 2007, and now is being used increasingly as a massively parallel data processing engine for Big Data.

What are some of the cool things in the 2.0 release of Hadoop? To start, how about a revamped MapReduce? And what would you think of a high availability (HA) implementation of the Hadoop Distributed ...

The Hadoop community recently promoted YARN-- the next-gen Hadoop data processing framework -- to the status of "sub-project" of the Apache Hadoop Top Level Project. The promotion puts YARN on the ...

Hadoop has been known as MapReduce running on HDFS, but with YARN, Hadoop 2.0 broadens pool of potential applications Hadoop has always been a catch-all for disparate open source initiatives that ...

A monthly overview of things you need to know as an architect or aspiring architect. Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with ...

The USPTO awarded search giant Google a software method patent that covers the principle of distributed MapReduce, a strategy for parallel processing that is used by the search giant. If Google ...

Having worked on Hadoop since day one in 2006, Hortonworks co-founder Arun Murthy is clear about the significance of the latest version of the open-source big-data technology. "Hadoop 2 is a big step.

Big data is a concept that’s been as widely hyped as cloud computing, and perhaps just as misunderstood in regards to its capabilities and limitations. One of the aspects of big data that is not ...