[Date Prev][Date Next] [Thread Prev][Thread Next] [Date Index] [Thread Index]

Re: [gopher] (no subject)



> > That someone is probably a web robot. I've had a few go-rounds with the
> > proprietor of gopherproxy.org when I temporarily blocked it for DOSing the
> > Twitter->gopher gateway after causing it to exceed its rate limit.
> 
> The problem is it seems to be using some old cached info about the site, I 
> see tons of access to files with the wrong type selector and to mboxs in 
> the old umn gopherd style with R (subrange from file Rstart-end-).

Right, that's why I suspect it's a web robot checking old links out. The
real hell of it is it's going to do it forever, because the gopherproxy will
never return a 404. And this is another reason we don't want web robots
crawling proxies.

-- 
------------------------------------ personal: http://www.cameronkaiser.com/ --
  Cameron Kaiser * Floodgap Systems * www.floodgap.com * ckaiser@floodgap.com
-- The only thing to fear is fearlessness -- R. E. M. -------------------------

_______________________________________________
Gopher-Project mailing list
Gopher-Project@lists.alioth.debian.org
http://lists.alioth.debian.org/mailman/listinfo/gopher-project




Reply to: