KOSEN 한인과학기술자네트워크

1. Introduction

2. MapReduce frameowrk:basic architecture

3. Extensions and Enhancements of the MapReduce framework

4. Systems of declarative interfaces for the MapReduce framework

5. Related large-scale data processing systems

6. Conclusions

In the last two decades, the continuous increase of computational power has produced an overwhelming flow of data which has called for a paradigm shift in the computing architecture and large-scale data processing mechanisms. MapReduce is a simple and powerful programming model that enables easy development of scalable parallel applications to process vast amounts of data on large clusters of commodity machines. It isolates the application from the details of running a distributed program such as issues on data distribution, scheduling, and fault tolerance. However, the original implementation of the MapReduce framework had some limitations that have been tackled by many research efforts in several followup works after its introduction. This article provides a comprehensive survey for a family of approaches and mechanisms of large-scale data processing mechanisms that have been implemented based on the original idea of the MapReduce framework and are currently gaining a lot of momentum in both research and industrial communities. The authors also cover a set of introduced systems that have been implemented to provide declarative programming interfaces on top of the MapReduce framework. In addition, the authors review several large-scale data processing systems that resemble some of the ideas of the MapReduce framework for different purposes and application scenarios.