Originally posted by Rat Bastid
These "bots" are actually called "spiders" because thew crawl torough the page text looking for keywords & backwards links to gauge the content of the site. That's how the sites get ranked. The crawl typically lasts 7-10 days a month.
I suppose Jordan could ask google, et al not to crawl the site, since he's not selling anything or has any sponsors to please.
Then again, that would reduce the amount of newcomers to the site.
P.S. I'm pretty new to this line of work, so I may not be 100% correct on everything.