[Date Prev][Date Next] [Thread Prev][Thread Next] [Date Index] [Thread Index]

Re: Multiple DSL lines + iproute + squid ...

kveton@orst.edu (Scott Kveton) wrote in message news:<Pine.GSO.4.31.0107010844590.18478-100000@flop.ENGR.ORST.EDU>...
> Hello all,
> I'm working on a problem that seems like it should work and am looking for
> some help knocking out any obvious problems.
> We currently have several DSL lines that are used for crawling websites.
> Bandwidth as it is is pretty cheap via DSL (we have 6 7Mbit lines for much
> less than an ~equivalent T-3).  Right now we use a single RedHat machine
> that has the DSL lines attached to it and we use iproute to direct the
> "networks" of traffic to each DSL line.

Hi Scott, 

So what is this crawler doing then? I noticed you hitting my site the
other day, and didn't like the look of someone downloading everysingle
one of my images. What's it all for?



Reply to: