International Journal of Advance Research in Science and Engineering (IJARSE)
In this paper, the authors propose a focus crawler under supervision method which will serve as a supervised web scale forum crawler. This paper is only to crawl relevant content in the forum from web with a reduced overhead. The threads of forum will contain the information which is the target for the web crawlers. They know that the forums will have different styles or layouts and are sometimes powered by various software but they are said to be having similar impact for navigation paths which will be based or connected by specific URL types that will lead the user from the entry page to various thread pages.