Crawling the Hidden Web: An Approach to Dynamic Web Indexing
The majority of the websites encapsulating online information are dynamic and hence too sophisticated for many traditional search engines to index. With the ever growing quantity of such hidden web pages, this issue continues to raise diverse opinions between the research and practitioner among the web mining communities. Several aspects enriching these dynamic web pages are bringing more challenges day-by-day to index them. By explaining these aspects and challenges, in this paper, the authors have presented a framework for dynamic web indexing. With the implementation of this framework and the results which they have found from it, all the necessary experimental setup and the developmental processes are explained.