[Date Prev][Date Next] [Thread Prev][Thread Next] [Date Index] [Thread Index]

Badly behaving bots.

As I type this message, a bot from the netblock is scraping my entire server... That alone I don't have a problem with, however, it's a bit nuts that this bot is literally sending 10 requests/connections in one go... If the WWW folks don't like it (their RFC2616 section 8 says clients shouldn't be using more than 2 connections per server, and modern browsers generally cap out at 6), I don't see why we should be doing it either.

Whoever runs this bot, please configure it to send between 1-6 connections in one go, and not 10-34. (the high number is not a joke)

Zachary L. Andrews (zcrayfish@gmail.com)

Reply to: