Advanced Distributed Crawling System for KAD Network

Provided by: Binary Information Press
Topic: Networking
Format: PDF
Many distributed hash tables have been proposed recently, but only very few of the users' have been applied actually. KAD, a (KADemlia) based DHT (Distributed Hash Table), is only an exception which is widely used in eMule peer-to-peer system. The measurement of the network will be able to guidance for the designing of such systems. In order to make the results of measurement more accurate, it is essential to develop a high-performance crawler. In this paper, the authors introduce a new distributed KAD crawler and apply a new condition for stopping crawling, so that the crawler can collect information faster and more completely.

Find By Topic