International Journal of Engineering and Science Invention (IJESI)
Search engines are the entrance for today's web. Probably most of the users get through the information's with the help of it. Seeking and rendering information from web through the search engine gives more pressure to retain the credibility and reliability of the search engine. Spam was one that creates a severe pain for the reliability of the search engines. Spam's occurrence in the search engine deceives the ranking algorithm to attain higher ranks rather for commercial purposes or to seek attention. Crawlers are the programs which facilitate the search engine's work by following the hyperlinks in web pages to automatically download a partial snapshot of the web.