Question

  • Creator
    Topic
  • #2341236

    Which sorting algorithm is used in Map-Reduce Hadoop( bigdata-hadoop)

    Locked

    by tapishsaxena ·

    Which sorting algorithm is used in MapReduce Hadoop?

All Answers

  • Author
    Replies
    • #2447865
      Avatar photo

      This might help with your question

      by Tammy.Cavadias ·

      In reply to Which sorting algorithm is used in Map-Reduce Hadoop( bigdata-hadoop)

      I came across this tutorial [url=”https://www.tutorialspoint.com/map_reduce/map_reduce_algorithm.htm”%5DMapReduce – Algorithm[/url]. It appears to answer your question in detail.

      – Tam 🙂

    • #2447847

      Map-reduce Hadoop answer

      by ganeshsh ·

      In reply to Which sorting algorithm is used in Map-Reduce Hadoop( bigdata-hadoop)

      Sorting is done at reducer node based on keys.
      Mapper class takes help of WritableComparator class to sort the key-value pair generated from Reducer. WritableComparator class implenets Java’s RawComparator interface. WritableCompratpr class’s compare method is responsible for sorting of key-value pair performed by byte by byte comparison of key.
      Merge sort algorithm is used by default in MapReduce. We can’t change sorting algorithm as the data comes from different nodes in a single point and the best suited sorting algorithm is defined as Merge Sort.

    • #2447841

      Algorithm is used mapreduce and hadoop

      by vishalgoud ·

      In reply to Which sorting algorithm is used in Map-Reduce Hadoop( bigdata-hadoop)

      Sorting is done at reducer node based on keys.
      Mapper class takes help of WritableComparator class to sort the key-value pair generated from Reducer. WritableComparator class implenets Java’s RawComparator interface. WritableCompratpr class’s compare method is responsible for sorting of key-value pair performed by byte by byte comparison of key.
      Merge sort algorithm is used by default in MapReduce. We can’t change sorting algorithm as the data comes from different nodes in a single point and the best suited sorting algorithm is defined as Merge Sort.

Viewing 2 reply threads