[Date Prev][Date Next] [Thread Prev][Thread Next] [Date Index] [Thread Index]

Re: Traffic control



On Thu, Dec 12, 2002 at 10:08:23AM -0500, Marco Antonio wrote:
> Now we are facing a problem: some people are making 'automated
> searches' on our www server -an ugly IIS5 :), and we intend to
> block this kind of search.

Check your logs and see what the User-Agent header is for those
requests - you may be lucky and have a hand full like "WebSpider" or
"Googlebot" or similar. 

If this is the case, you can drop squid (or another proxy if you
prefer) on your firewall, set it up to transparently proxy for the
web server, and tell squid to deny requests with those User-Agent
headers. If you're lucky! ;)

Regards,

Bernard.

-- 
 Bernard Blackham
 bernard at blackham dot com dot au
 Australian Linux Technical Conference 2003: http://www.linux.conf.au/

Attachment: pgpW4Lik02ScG.pgp
Description: PGP signature


Reply to: