[gopher] Gopher "robots.txt" (was Re: New V-2 WAIS database)
> >New indexing will resume Sunday evening.
> How can I tell it to skip some parts of my server?
> I don't want it to download the whole 19 GB debian archive, or run some
> thousand times the NNTP gateway.
Good point. I am actually trying to think of a way like the HTTP robots.txt
that can more or less transparently tell V-2 what to stay out of. Suggestions?
--
----------------------------- personal page: http://www.armory.com/~spectre/ --
Cameron Kaiser, Point Loma Nazarene University * ckaiser@stockholm.ptloma.edu
-- Die, v.: To stop sinning suddenly. -- Elbert Hubbard -----------------------
Reply to: