Perspectives on Crowdsourcing Annotations for Natural Language Processing

Crowdsourcing has emerged as a new method for obtaining annotations for training models for machine learning. While many variants of this process exist, they largely differ in their method of motivating subjects to contribute and the scale of their applications. To date, however, there has yet to be a study that helps the practitioner to decide what form an annotation application should take to best reach its objectives within the constraints of a project. The authors first provide a faceted analysis of existing crowdsourcing annotation applications.

Provided by: National University of Singapore Topic: Software Date Added: Mar 2011 Format: PDF

Find By Topic