[Date Prev][Date Next] [Thread Prev][Thread Next] [Date Index] [Thread Index]

[gopher] Re: Gopher "robots.txt" (was Re: New V-2 WAIS database)



On Jan 13, Cameron Kaiser <spectre@stockholm.ptloma.edu> wrote:

 >Good point. I am actually trying to think of a way like the HTTP robots.txt
 >that can more or less transparently tell V-2 what to stay out of. Suggestions?
I don't know well gopher yet, but you'd better find one before starting
to index my site, or your database will be filled with crap.

-- 
ciao,
Marco




Reply to: