3 replies
by Tammy.Cavadias Accepted solution
I came across this tutorial [url="https://www.tutorialspoint.com/map_reduce/map_reduce_algorithm.htm"]MapReduce - Algorithm[/url]. It appears to answer your question in detail.
- Tam :-)
by ganeshsh Accepted solution
Sorting is done at reducer node based on keys.
Mapper class takes help of WritableComparator class to sort the key-value pair generated from Reducer. WritableComparator class implenets Java’s RawComparator interface. WritableCompratpr class’s compare method is responsible for sorting of key-value pair performed by byte by byte comparison of key.
Merge sort algorithm is used by default in MapReduce. We can’t change sorting algorithm as the data comes from different nodes in a single point and the best suited sorting algorithm is defined as Merge Sort.
by vishalgoud Accepted solution
Sorting is done at reducer node based on keys.
Mapper class takes help of WritableComparator class to sort the key-value pair generated from Reducer. WritableComparator class implenets Java’s RawComparator interface. WritableCompratpr class’s compare method is responsible for sorting of key-value pair performed by byte by byte comparison of key.
Merge sort algorithm is used by default in MapReduce. We can’t change sorting algorithm as the data comes from different nodes in a single point and the best suited sorting algorithm is defined as Merge Sort.
This discussion is closed to new replies.
Trending Software posts
Sort by Trending