Question

Which sorting algorithm is used in Map-Reduce Hadoop( bigdata-hadoop)

By tapishsaxena ·
Which sorting algorithm is used in MapReduce Hadoop?
3 total posts (Page 1 of 1)  
| Thread display: Collapse - | Expand +

All Answers

Collapse -

This might help with your question

by tcavadias Staff In reply to Which sorting algorithm i ...

I came across this tutorial MapReduce - Algorithm. It appears to answer your question in detail.

- Tam :-)

Collapse -

Map-reduce Hadoop answer

by ganeshsh In reply to Which sorting algorithm i ...

Sorting is done at reducer node based on keys.
Mapper class takes help of WritableComparator class to sort the key-value pair generated from Reducer. WritableComparator class implenets Java’s RawComparator interface. WritableCompratpr class’s compare method is responsible for sorting of key-value pair performed by byte by byte comparison of key.
Merge sort algorithm is used by default in MapReduce. We can’t change sorting algorithm as the data comes from different nodes in a single point and the best suited sorting algorithm is defined as Merge Sort.

Collapse -

Algorithm is used mapreduce and hadoop

by vishalgoud In reply to Which sorting algorithm i ...

Sorting is done at reducer node based on keys.
Mapper class takes help of WritableComparator class to sort the key-value pair generated from Reducer. WritableComparator class implenets Java’s RawComparator interface. WritableCompratpr class’s compare method is responsible for sorting of key-value pair performed by byte by byte comparison of key.
Merge sort algorithm is used by default in MapReduce. We can’t change sorting algorithm as the data comes from different nodes in a single point and the best suited sorting algorithm is defined as Merge Sort.

Back to Software Forum
3 total posts (Page 1 of 1)  

Related Discussions

Related Forums