A Supervised Method for Multi-keyword Web Crawling on Web Forums

Download Now
Provided by: International Journal of Computer Science and Mobile Computing (IJCSMC)
Topic: Big Data
Format: PDF
Web forums are used by large number of users to post and share their comments with other users of various websites. The forums consist of many lists of topics on their boards with a large list of threads in each board. The users can create many threads and share their views in posts as well. In this paper a supervised web forum multi-keyword crawler is proposed to crawl relevant contents from the forum pages by reducing the delay. All the forums in the web have navigation paths that lead to the forum threads and these paths are connected by specific types of URLs. Thus the proposed method needs to recognize the various URLs by using the regular expression patterns within the forum.
Download Now

Find By Topic