[Date Prev][Date Next] [Thread Prev][Thread Next] [Date Index] [Thread Index]

Re: planet.debian.org vs. blog illiteracy

ma, 2005-09-26 kello 13:32 +0200, Petter Reinholdtsen kirjoitti:
> [Nico Golde]
> > AFAIK this will not happen because some people don't want
> > their blog entries in a public archive.

It is perfectly possible to set up an archived list based on opt-in
principles: only archive web log entries from those who want to be
archived. This has been pointed out before, so it is silly to claim

> Well, these people need to stop publishing their content on the
> Internet then, as all web page versions end up in the wayback machine,
> and thus their blog entry is already in a public archive.

The Internet Archive project properly obeys robots.txt files. See
http://www.archive.org/about/exclude.php for more information. Any such
services that don't obey robots.txt are evil and need to be destroyed

Reply to: