[gopher] A little Gopher crawler

[James Mills <prologic@shortcircuit.net.au>]

Hi All and Kim (author of Gophernicus!),

I wrote this little cralwer today: https://gist.github.com/b781e02b0299fef1f3f6

I'm a bit disappointed in performance though of crawling my local Gopehrspace (basically via localhost):

prologic@daisy

Mon Dec 15 15:13:08 

~/tmp

$ time ./gspider.py &> index

real 5m27.825s

user 0m6.126s

sys 0m5.825s

prologic@daisy

Mon Dec 15 15:18:51 

~/tmp

$ wc -l index 

355 index

Any comments? :)

cheers

James

James Mills / prologic

E: prologic@shortcircuit.net.au

W: prologic.shortcircuit.net.au

_______________________________________________
Gopher-Project mailing list
Gopher-Project@lists.alioth.debian.org
http://lists.alioth.debian.org/cgi-bin/mailman/listinfo/gopher-project