Question

Using the SVC framework, explain why MapReduce is not suitable for real time Big Data processing.

Answer 1

1. Implementing iterative map reduce jobs is expensive due to the huge space consumption by each job.

2. Problems that cannot be trivially partitionable or recombinable becomes a candid limitation of MapReduce problem solving. For instance, Travelling Salesman problem.

3. Due to the fixed cost incurred by each MapReduce job submitted, application that requires low latency time or random access to a large set of data is infeasible.

4. Also, tasks that has a dependency on each other cannot be parallelized, which is not possible through MapReduce.

5. MapReduce is suitable only for batch processing jobs, implementing interactive jobs and models becomes impossible.

6. Applications that involve precomputation on the dataset brings down the advantages of MapReduce.