MyBlogLog Crawlers & Bots
We have noticed a dramatic increase in the number of bots crawling MyBlogLog.com, collecting data on our members and trying to position avatars at the top of Reader Rolls over the last several weeks.
In a few cases, the number of requests from these bots have had the equivalent of a Denial of Service (DoS) attack -- not only on MyBlogLog.com but also our member sites. This cannot continue. If you are crawling this site, please stop.
To address this problem in the short term, we are implementing new server monitoring and will ban anyone hitting the server more than 1000 pages an hour. We will also be updating our Terms of Service to make scraping/gaming of site content against the rules. Beyond that it's for the lawyers to resolve; and nobody wants that.
That said, we have a bunch of new ways to get MyBlogLog data coming in the next several weeks. While we can't talk about them now, please stay tuned to this blog.
Thanks,
Todd
