Web Development

Automatic Wrappers for Large Scale Web Extraction

Free registration required

Executive Summary

The authors present a generic framework to make wrapper induction algorithms tolerant to noise in the training data. This enables one to learn wrappers in a completely unsupervised manner from automatically and cheaply obtained noisy training data, e.g., using dictionaries and regular expressions. By removing the site-level supervision that wrapper-based techniques require, they are able to perform information extraction at web-scale, with accuracy unattained with existing unsupervised extraction techniques. The system is used in production at Yahoo! and powers live applications.

  • Format: PDF
  • Size: 863.14 KB