Hello all, I am looking forward to write a bot of my own that will crawl the web and index pages just like other search engines do. But I have no idea where and how to begin. Can anyone give me any input in the matter?