mrgo is a fault tolerant MapReduce system built in Go and based on the classic MapReduce paper. We have several worker processes that calls application Map and Reduce functions and handles reading and writing files, and a single coordinator process that hands out tasks to workers and copes with failed workers. The workers will talk to the coordinator via RPC.
muffpy / mrgo Goto Github PK
View Code? Open in Web Editor NEWA MapReduce implementation in Golang