Re: LinkWalker
russell@coker.com.au (Russell Coker) wrote in message news:<20011223164148.48E8118642@lyta.coker.com.au>...
> I have a nasty web spider with an agent name of "LinkWalker" downloading
> everything on my site (including .tgz files). Does anyone know anything
> about it?
It's apparantly a link-validation robot operated by a company called
SevenTwentyFour Incorporated, see:
http://www.seventwentyfour.com/tech.html
I found your post while searching for information on this robot while
tracking its spoor through our HTTP logs here.
> I've added the following to my firewall setup to stop further attacks...
>
> # crappy LinkWalker - evil spider that downloads every file including .tgz on
> # the site
> iptables -A INPUT -j logitrej -p tcp -s 209.167.50.25 -d 0.0.0.0/0 --dport www
We were hit from 209.167.50.22; if you want to use iptables to block
this spider, I'd block all of NETBLK-NET-SEVEN24AUU1, 209.167.50.16 -
209.167.50.31.
Personally, I think this is a rogue organization -- there was an entry
from this spider in our logs coming from a Seven24 IP with a HTTP
referrer of www.adultinterracialsexvideos.com/interracialsex/interracialgroupsexsen.html.
Needless to say, we do not run an adult web site and that referrer
site does NOT have a link to us. Likely Seven24 is trying to clutter
people's logs with references as a form of advertising.
Reply to: