Tag: hadoop

Jeffrey Dean and Sanjay Ghemawat's MapReduce turned a narrow pair of user functions into a contract with a distributed runtime that handled partitioning, scheduling, data movement, and machine failure, allowing ordinary programmers to use thousands of cluster machines without writing a distributed scheduler.

Doug Cutting, Mike Cafarella, Yahoo, and the Apache community turned lessons from Google's GFS and MapReduce papers into Hadoop, an open-source distributed storage and batch-processing platform that let organizations outside Google build commodity clusters for very large data sets.