[Date Prev][Date Next] [Thread Prev][Thread Next] [Date Index] [Thread Index]

Re: Download a whole gopherhole using wget/curl?



> On the other hand, I personally wouldn't mind, given that the load is
> kept low. Similar to, say, the way Cameron handles Veronica-2 indexing.

Well, part of the reason is that V-2 cheats. It only fetches menus unless
it has a direct link to the content from an unrelated site. It then puts the
menu in and doesn't spider the actual content except for other menus in it.

-- 
------------------------------------ personal: http://www.cameronkaiser.com/ --
  Cameron Kaiser * Floodgap Systems * www.floodgap.com * ckaiser@floodgap.com
-- smit happens. --------------------------------------------------------------


Reply to: