[Date Prev][Date Next] [Thread Prev][Thread Next] [Date Index] [Thread Index]

Re: [gopher] 79.255.121.27 mass crawle




On Wed, Jan 21, 2015 at 2:10 AM, Jacob Dahl Pind <rachael@telefisk.org> wrote:

could the owner of 79.255.121.27 , please let the bot crawle a little less aggressiv, there is no pause between selector requests.

--
Jacob Dahl Pind | telefisk.org | fidonet 2:230/38.8


This address appeared in my gopher logs recently, but the interval between requests was several minutes. Here's a sample from the log:

79.255.121.27 - - [20/Jan/2015:04:41:29 -0700] "/lynx-windows" 200 197 ""
79.255.121.27 - - [20/Jan/2015:04:47:18 -0700] "/phlog/phlogengine.cgi" 200 835 ""
79.255.121.27 - - [20/Jan/2015:05:01:04 -0700] "/fobb/fobb2012" 200 7571 ""
79.255.121.27 - - [20/Jan/2015:05:13:56 -0700] "/wireless-telegraphy" 200 2698 ""
79.255.121.27 - - [20/Jan/2015:05:20:12 -0700] "/online-books" 200 1161 ""
79.255.121.27 - - [20/Jan/2015:05:25:21 -0700] "/online-books/classics" 200 2250 ""
79.255.121.27 - - [20/Jan/2015:05:39:46 -0700] "/submarine-telegraphy" 200 986 ""
79.255.121.27 - - [20/Jan/2015:05:55:30 -0700] "/slide-rules" 200 502 ""
79.255.121.27 - - [20/Jan/2015:06:04:27 -0700] "/slide-rules/sr-complete-manual" 200 597 ""
79.255.121.27 - - [20/Jan/2015:06:23:18 -0700] "/landline-telegraphy" 200 4013 ""

Accesses seem random.

Bob 
gopher://whitemesa.net
_______________________________________________
Gopher-Project mailing list
Gopher-Project@lists.alioth.debian.org
http://lists.alioth.debian.org/cgi-bin/mailman/listinfo/gopher-project

Reply to: