Document Similarity Measurement Using Ferret Algorithm and Map Reduce Programming Model

Provided by: IJCTT-International Journal of Computer Trends and Technology
Topic: Data Management
Format: PDF
Plagiarism of digital documents that happened frequently should be prevented and reduced. In order to measure the degree of document's similarity, Ferret algorithm is used on MapReduce and Hadoop framework. This application program is tested using ten pair documents in English and ten pair documents in Indonesian to get the degree of document's similarity between document's pairs. In this experiment, it was also tested the accuracy of the system by using several kind of n-grams, that is 1-gram, 2-gram, 3-gram, 4-gram, 5-gram, and 6-gram. In addition, this experiment is conducted on stand-alone computers and Hadoop multi-node cluster system.

Find By Topic