[Date Prev][Date Next] [Thread Prev][Thread Next] [Date Index] [Thread Index]

Re: webcrawl to cache dynamic pages



wget doesnt do what you want?

On 5/6/05, Richard Lyons <richard@the-place.net> wrote:
> On Mon, May 02, 2005 at 01:27:41PM +0100, Richard Lyons wrote:
> > I am considering how to crawl a site which is dynamically generated,
> > and create a static version of all generated pages (or selected
> > generated pages).  I guess it would be simplest to start with an
> > existing crawler, and bolt on some code. Or, alternatively, write a
> > script (perl, I fear) to modify the cache built by a crawler.
> >
> > The idea is to allow a static ecommerce site to be generated from any
> > database-generated shopping cart system.
> >
> > Any advice where to begin?
> 
> Well, that is the first time I found a subject nobody here was
> interested in...  I must be getting _really_ boring...
> <wanders off muttering into beard>
> 
> --
> richard
> 
> --
> To UNSUBSCRIBE, email to debian-user-REQUEST@lists.debian.org
> with a subject of "unsubscribe". Trouble? Contact listmaster@lists.debian.org
> 
> 


-- 
Caleb Walker



Reply to: