International Journal of Advanced Research in Computer Science and Software Engineering (IJARCSSE)
Data mining on a very large data set is a complex task. ICWF (Intelligent Crawling Web Forum) is web-scale forum crawler. The objective of ICWF is to simply related forum content from the web with minimum overhead. A Crawler traverses the World Wide Web in a systematic manner with intention of gathering data or knowledge. Web forums are used by large number of users to post and share their comments with other users of various websites. The forums consist of many lists of topics on their boards with a large list of threads in each board. The users can create many threads and share their views in posts as well. Forum threads have information contented that is the aim of the forum crawler.