On 14.9.2011 14:05, Jacob Dahl Pind wrote:
As we cant ratelimit, or any other robots.txt things when those web crawlers are hitting us through those proxies, I have opped for simply redirecting access from those proxies to another selector. is in the TELEFISK_FILTER ifdef in this patch gopher://telefisk.org/0/gopher/gophernicus-1.2-beta-telefisk.diff
That's actually a pretty good feature, I might blatantly steal it for the upstream version, without attribution.
I'll make mill... bill... *TRILLIONS* with it! Bwahahahahahahaaaa. (I might have forgotten my medication this morning) - Kim _______________________________________________ Gopher-Project mailing list Gopher-Project@lists.alioth.debian.org http://lists.alioth.debian.org/cgi-bin/mailman/listinfo/gopher-project