Re: Download a whole gopherhole using wget/curl?
> On the other hand, I personally wouldn't mind, given that the load is
> kept low. Similar to, say, the way Cameron handles Veronica-2 indexing.
Well, part of the reason is that V-2 cheats. It only fetches menus unless
it has a direct link to the content from an unrelated site. It then puts the
menu in and doesn't spider the actual content except for other menus in it.
--
------------------------------------ personal: http://www.cameronkaiser.com/ --
Cameron Kaiser * Floodgap Systems * www.floodgap.com * ckaiser@floodgap.com
-- smit happens. --------------------------------------------------------------
Reply to: