Fwd: Aspirateur de site web
---------- Forwarded message ----------
From: philippe L <ptilou@gmail.com>
Date: Mon, 6 Dec 2004 12:20:25 +0100
Subject: Re: Aspirateur de site web
To: François Boisson <user@maison.homelinux.net>
Bonjour,
euh, j'arrete le script commend ?
A, la lecture du script, il demande des pages qui n'ont pas été gérées
par le serveur ! ( on j'ai rien compris comme d'habitude, etc .... ).
J'ai 1 Go de dispo sur le DD.
Merci pour ton aide
Philippe
voila se que donne le script :
Script started on Mon Dec 6 14:07:45 2004
debian:/home/philou/sdd5/droit# wget -m -k -p http://fre
jurisfac.free.fr
--14:08:44-- http://jurisfac.free.fr/
=> `jurisfac.free.fr/index.html'
Resolving jurisfac.free.fr... done.
Connecting to jurisfac.free.fr[212.27.40.162]:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 213 [text/html]
Server file no newer than local file `jurisfac.free.fr/index.html' --
not retrieving.
Loading robots.txt; please ignore errors.
--14:08:44-- http://jurisfac.free.fr/robots.txt
=> `jurisfac.free.fr/robots.txt'
Connecting to jurisfac.free.fr[212.27.40.162]:80... connected.
HTTP request sent, awaiting response... 404 Not Found
14:08:44 ERROR 404: Not Found.
--14:08:44-- http://jurisfac.free.fr/bidon.html
=> `jurisfac.free.fr/bidon.html'
Connecting to jurisfac.free.fr[212.27.40.162]:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 14 [text/html]
Server file no newer than local file `jurisfac.free.fr/bidon.html' --
not retrieving.
--14:08:45-- http://jurisfac.free.fr/index.php
=> `jurisfac.free.fr/index.php'
Connecting to jurisfac.free.fr[212.27.40.162]:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
Last-modified header missing -- time-stamps turned off.
--14:08:45-- http://jurisfac.free.fr/index.php
=> `jurisfac.free.fr/index.php'
Connecting to jurisfac.free.fr[212.27.40.162]:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
[<=> ] 0 --.--K/s
[ <=> ] 3,710 3.54M/s
14:08:45 (3.54 MB/s) - `jurisfac.free.fr/index.php' saved [3710]
--14:08:45-- http://jurisfac.free.fr/style.css
=> `jurisfac.free.fr/style.css'
Connecting to jurisfac.free.fr[212.27.40.162]:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 9,008 [text/css]
Remote file is newer, retrieving.
--14:08:45-- http://jurisfac.free.fr/style.css
=> `jurisfac.free.fr/style.css'
Connecting to jurisfac.free.fr[212.27.40.162]:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 9,008 [text/css]
0% [ ] 0 --.--K/s ETA --:--
100%[====================================>] 9,008 169.17K/s ETA 00:00
14:08:45 (169.17 KB/s) - `jurisfac.free.fr/style.css' saved [9008/9008]
--14:08:45-- http://jurisfac.free.fr/images/orange.gif
=> `jurisfac.free.fr/images/orange.gif'
Connecting to jurisfac.free.fr[212.27.40.162]:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 3,997 [image/gif]
Remote file is newer, retrieving.
--14:08:45-- http://jurisfac.free.fr/images/orange.gif
=> `jurisfac.free.fr/images/orange.gif'
Connecting to jurisfac.free.fr[212.27.40.162]:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 3,997 [image/gif]
0% [ ] 0 --.--K/s ETA --:--
100%[====================================>] 3,997 650.55K/s ETA 00:00
14:08:45 (650.55 KB/s) - `jurisfac.free.fr/images/orange.gif' saved [3997/3997]
--14:08:45-- http://jurisfac.free.fr/sommaire.php
=> `jurisfac.free.fr/sommaire.php'
Connecting to jurisfac.free.fr[212.27.40.162]:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
Last-modified header missing -- time-stamps turned off.
--14:08:46-- http://jurisfac.free.fr/sommaire.php
=> `jurisfac.free.fr/sommaire.php'
Connecting to jurisfac.free.fr[212.27.40.162]:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
[<=> ] 0 --.--K/s
[ <=> ] 4,206 1.00M/s
14:08:46 (1.00 MB/s) - `jurisfac.free.fr/sommaire.php' saved [4206]
--14:08:46-- http://jurisfac.free.fr/auteurs.php
=> `jurisfac.free.fr/auteurs.php'
Connecting to jurisfac.free.fr[212.27.40.162]:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
Last-modified header missing -- time-stamps turned off.
--14:08:46-- http://jurisfac.free.fr/auteurs.php
=> `jurisfac.free.fr/auteurs.php'
Connecting to jurisfac.free.fr[212.27.40.162]:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
[<=> ] 0 --.--K/s
[ <=> ] 2,608 9.06K/s
[ <=> ] 3,998 4.12K/s
[ <=> ] 4,744 3.75K/s
[ <=> ] 6,134 3.36K/s
[ <=> ] 10,795 5.76K/s
14:08:48 (5.76 KB/s) - `jurisfac.free.fr/auteurs.php' saved [10795]
--14:08:48-- http://jurisfac.free.fr/recherche.php
=> `jurisfac.free.fr/recherche.php'
Connecting to jurisfac.free.fr[212.27.40.162]:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
Last-modified header missing -- time-stamps turned off.
--14:08:49-- http://jurisfac.free.fr/recherche.php
=> `jurisfac.free.fr/recherche.php'
Connecting to jurisfac.free.fr[212.27.40.162]:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
[<=> ] 0 --.--K/s
[ <=> ] 1,604 1.53M/s
14:08:49 (1.53 MB/s) - `jurisfac.free.fr/recherche.php' saved [1604]
--14:08:49-- http://jurisfac.free.fr/ecrire.php
=> `jurisfac.free.fr/ecrire.php'
Connecting to jurisfac.free.fr[212.27.40.162]:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
Last-modified header missing -- time-stamps turned off.
--14:08:49-- http://jurisfac.free.fr/ecrire.php
=> `jurisfac.free.fr/ecrire.php'
Connecting to jurisfac.free.fr[212.27.40.162]:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
[<=> ] 0 --.--K/s
[ <=> ] 5,668 149.60K/s
14:08:49 (149.60 KB/s) - `jurisfac.free.fr/ecrire.php' saved [5668]
--14:08:49-- http://jurisfac.free.fr/images/note.gif
=> `jurisfac.free.fr/images/note.gif'
Connecting to jurisfac.free.fr[212.27.40.162]:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 2,099 [image/gif]
Remote file is newer, retrieving.
--14:08:49-- http://jurisfac.free.fr/images/note.gif
=> `jurisfac.free.fr/images/note.gif'
Connecting to jurisfac.free.fr[212.27.40.162]:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 2,099 [image/gif]
0% [ ] 0 --.--K/s ETA --:--
100%[====================================>] 2,099 2.00M/s ETA 00:00
14:08:49 (2.00 MB/s) - `jurisfac.free.fr/images/note.gif' saved [2099/2099]
--14:08:49-- http://jurisfac.free.fr/participer.php
=> `jurisfac.free.fr/participer.php'
Connecting to jurisfac.free.fr[212.27.40.162]:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
Last-modified header missing -- time-stamps turned off.
--14:08:50-- http://jurisfac.free.fr/participer.php
=> `jurisfac.free.fr/participer.php'
Connecting to jurisfac.free.fr[212.27.40.162]:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
[<=> ] 0 --.--K/s
[ <=> ] 4,507 489.04K/s
14:08:50 (489.04 KB/s) - `jurisfac.free.fr/participer.php' saved [4507]
--14:08:50-- http://jurisfac.free.fr/images/spi2.gif
=> `jurisfac.free.fr/images/spi2.gif'
Connecting to jurisfac.free.fr[212.27.40.162]:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 837 [image/gif]
Server file no newer than local file
`jurisfac.free.fr/images/spi2.gif' -- not retrieving.
--14:08:50-- http://jurisfac.free.fr/images/logo.gif
=> `jurisfac.free.fr/images/logo.gif'
Connecting to jurisfac.free.fr[212.27.40.162]:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 8,134 [image/gif]
Remote file is newer, retrieving.
--14:08:50-- http://jurisfac.free.fr/images/logo.gif
=> `jurisfac.free.fr/images/logo.gif'
Connecting to jurisfac.free.fr[212.27.40.162]:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 8,134 [image/gif]
0% [ ] 0 --.--K/s ETA --:--
100%[====================================>] 8,134 158.87K/s ETA 00:00
14:08:50 (158.87 KB/s) - `jurisfac.free.fr/images/logo.gif' saved [8134/8134]
--14:08:50-- http://jurisfac.free.fr/rubrique.php?type=Les%20cours
=> `jurisfac.free.fr/rubrique.php?type=Les%20cours'
Connecting to jurisfac.free.fr[212.27.40.162]:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
jurisfac.free.fr/rubrique.php?type=Les%20cours: Invalid argument
Cannot write to `jurisfac.free.fr/rubrique.php?type=Les%20cours'
(Invalid argument).
--14:08:50-- http://jurisfac.free.fr/rubrique.php?type=Les%20%E9tudes
=> `jurisfac.free.fr/rubrique.php?type=Les%20%E9tudes'
Connecting to jurisfac.free.fr[212.27.40.162]:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
jurisfac.free.fr/rubrique.php?type=Les%20%E9tudes: Invalid argument
Cannot write to `jurisfac.free.fr/rubrique.php?type=Les%20%E9tudes'
(Invalid argument).
--14:08:50-- http://jurisfac.free.fr/rubrique.php?type=M%E9thodologie
=> `jurisfac.free.fr/rubrique.php?type=M%E9thodologie'
Connecting to jurisfac.free.fr[212.27.40.162]:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
jurisfac.free.fr/rubrique.php?type=M%E9thodologie: Invalid argument
Cannot write to `jurisfac.free.fr/rubrique.php?type=M%E9thodologie'
(Invalid argument).
--14:08:51-- http://jurisfac.free.fr/rubrique.php?type=Orientation
=> `jurisfac.free.fr/rubrique.php?type=Orientation'
Connecting to jurisfac.free.fr[212.27.40.162]:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
jurisfac.free.fr/rubrique.php?type=Orientation: Invalid argument
Cannot write to `jurisfac.free.fr/rubrique.php?type=Orientation'
(Invalid argument).
--14:08:51-- http://jurisfac.free.fr/rubrique.php?type=Rubrique%20droits%20%E9trangers
=> `jurisfac.free.fr/rubrique.php?type=Rubrique%20droits%20%E9trangers'
Connecting to jurisfac.free.fr[212.27.40.162]:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
jurisfac.free.fr/rubrique.php?type=Rubrique%20droits%20%E9trangers:
Invalid argument
Cannot write to
`jurisfac.free.fr/rubrique.php?type=Rubrique%20droits%20%E9trangers'
(Invalid argument).
--14:08:51-- http://jurisfac.free.fr/images%5Ccc.gif
=> `jurisfac.free.fr/images\cc.gif'
Connecting to jurisfac.free.fr[212.27.40.162]:80... connected.
HTTP request sent, awaiting response... 404 Not Found
14:08:51 ERROR 404: Not Found.
--14:08:51-- http://jurisfac.free.fr/fiche.php?id=410
=> `jurisfac.free.fr/fiche.php?id=410'
Connecting to jurisfac.free.fr[212.27.40.162]:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
jurisfac.free.fr/fiche.php?id=410: Invalid argument
Cannot write to `jurisfac.free.fr/fiche.php?id=410' (Invalid argument).
--14:08:56-- http://jurisfac.free.fr/fiche.php?id=412
=> `jurisfac.free.fr/fiche.php?id=412'
Connecting to jurisfac.free.fr[212.27.40.162]:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
jurisfac.free.fr/fiche.php?id=412: Invalid argument
Cannot write to `jurisfac.free.fr/fiche.php?id=412' (Invalid argument).
--14:08:57-- http://jurisfac.free.fr/fiche.php?id=405
=> `jurisfac.free.fr/fiche.php?id=405'
Connecting to jurisfac.free.fr[212.27.40.162]:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
jurisfac.free.fr/fiche.php?id=405: Invalid argument
Cannot write to `jurisfac.free.fr/fiche.php?id=405' (Invalid argument).
--14:08:57-- http://jurisfac.free.fr/fiche.php?id=406
=> `jurisfac.free.fr/fiche.php?id=406'
Connecting to jurisfac.free.fr[212.27.40.162]:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
jurisfac.free.fr/fiche.php?id=406: Invalid argument
Cannot write to `jurisfac.free.fr/fiche.php?id=406' (Invalid argument).
--14:08:57-- http://jurisfac.free.fr/fiche.php?id=407
=> `jurisfac.free.fr/fiche.php?id=407'
Connecting to jurisfac.free.fr[212.27.40.162]:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
jurisfac.free.fr/fiche.php?id=407: Invalid argument
Cannot write to `jurisfac.free.fr/fiche.php?id=407' (Invalid argument).
--14:08:57-- http://jurisfac.free.fr/images/ccmail.gif
=> `jurisfac.free.fr/images/ccmail.gif'
Connecting to jurisfac.free.fr[212.27.40.162]:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 5,976 [image/gif]
Remote file is newer, retrieving.
--14:08:57-- http://jurisfac.free.fr/images/ccmail.gif
=> `jurisfac.free.fr/images/ccmail.gif'
Connecting to jurisfac.free.fr[212.27.40.162]:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 5,976 [image/gif]
0% [ ] 0 --.--K/s ETA --:--
100%[====================================>] 5,976 142.34K/s ETA 00:00
14:08:57 (142.34 KB/s) - `jurisfac.free.fr/images/ccmail.gif' saved [5976/5976]
--14:08:57-- http://jurisfac.free.fr/images/pin2.gif
=> `jurisfac.free.fr/images/pin2.gif'
Connecting to jurisfac.free.fr[212.27.40.162]:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 1,005 [image/gif]
Server file no newer than local file
`jurisfac.free.fr/images/pin2.gif' -- not retrieving.
--14:08:58-- http://jurisfac.free.fr/faq.php
=> `jurisfac.free.fr/faq.php'
Connecting to jurisfac.free.fr[212.27.40.162]:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
Last-modified header missing -- time-stamps turned off.
--14:08:58-- http://jurisfac.free.fr/faq.php
=> `jurisfac.free.fr/faq.php'
Connecting to jurisfac.free.fr[212.27.40.162]:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
[<=> ] 0 --.--K/s
[ <=> ] 1,189 1.13M/s
14:08:58 (1.13 MB/s) - `jurisfac.free.fr/faq.php' saved [1189]
--14:08:58-- http://jurisfac.free.fr/images/computer.gif
=> `jurisfac.free.fr/images/computer.gif'
Connecting to jurisfac.free.fr[212.27.40.162]:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 5,558 [image/gif]
Remote file is newer, retrieving.
--14:08:58-- http://jurisfac.free.fr/images/computer.gif
=> `jurisfac.free.fr/images/computer.gif'
Connecting to jurisfac.free.fr[212.27.40.162]:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 5,558 [image/gif]
0% [ ] 0 --.--K/s ETA --:--
100%[====================================>] 5,558 135.69K/s ETA 00:00
14:08:58 (135.69 KB/s) - `jurisfac.free.fr/images/computer.gif' saved
[5558/5558]
--14:08:58-- http://jurisfac.free.fr/images/home.gif
=> `jurisfac.free.fr/images/home.gif'
Connecting to jurisfac.free.fr[212.27.40.162]:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 1,353 [image/gif]
Server file no newer than local file
`jurisfac.free.fr/images/home.gif' -- not retrieving.
FINISHED --14:08:58--
Downloaded: 66,451 bytes in 13 files
Converting jurisfac.free.fr/index.html... 2-0
Converting jurisfac.free.fr/bidon.html... nothing to do.
Converting jurisfac.free.fr/index.php... 11-0
Converting jurisfac.free.fr/sommaire.php... 17-1
Converting jurisfac.free.fr/auteurs.php... 8-0
Converting jurisfac.free.fr/recherche.php... 6-0
Converting jurisfac.free.fr/ecrire.php... 15-0
Converting jurisfac.free.fr/participer.php... 8-1
jurisfac.free.fr/rubrique.php?type=Les%20cours: No such file or directory
Converting jurisfac.free.fr/rubrique.php?type=Les%20cours... nothing to do.
jurisfac.free.fr/rubrique.php?type=Les%20%E9tudes: No such file or directory
Converting jurisfac.free.fr/rubrique.php?type=Les%20%E9tudes... nothing to do.
jurisfac.free.fr/rubrique.php?type=M%E9thodologie: No such file or directory
Converting jurisfac.free.fr/rubrique.php?type=M%E9thodologie... nothing to do.
jurisfac.free.fr/rubrique.php?type=Orientation: No such file or directory
Converting jurisfac.free.fr/rubrique.php?type=Orientation... nothing to do.
jurisfac.free.fr/rubrique.php?type=Rubrique%20droits%20%E9trangers: No
such file or directory
Converting jurisfac.free.fr/rubrique.php?type=Rubrique%20droits%20%E9trangers...
nothing to do.
jurisfac.free.fr/fiche.php?id=410: No such file or directory
Converting jurisfac.free.fr/fiche.php?id=410... nothing to do.
jurisfac.free.fr/fiche.php?id=412: No such file or directory
Converting jurisfac.free.fr/fiche.php?id=412... nothing to do.
jurisfac.free.fr/fiche.php?id=405: No such file or directory
Converting jurisfac.free.fr/fiche.php?id=405... nothing to do.
jurisfac.free.fr/fiche.php?id=406: No such file or directory
Converting jurisfac.free.fr/fiche.php?id=406... nothing to do.
jurisfac.free.fr/fiche.php?id=407: No such file or directory
Converting jurisfac.free.fr/fiche.php?id=407... nothing to do.
Converting jurisfac.free.fr/faq.php... nothing to do.
Converted 19 files in 2.29 seconds.
debian:/home/philou/sdd5/droit# cd /tmp
debian:/tmp# ls -l
[0mtotal 24
-rw-r--r-- 1 root root 24576 Dec 6 14:09 [0mlog.wget[0m
[mdebian:/tmp# vim log.wget
On Sun, 5 Dec 2004 22:12:20 +0100, François Boisson
<user.anti-spam@maison.homelinux.net> wrote:
> Le Sun, 5 Dec 2004 20:47:53 +0100
>
>
> philippe L <ptilou@gmail.com> a écrit:
>
> > Et bien donne moi ta recette !
> >
> > Je viens de tomber la paserelle mis ma woody en direct et sa ne change
> > rien toujour, la même chose, euh ???
> >
> > Bon j'ai lu le man et n'ai rien trouvé, doit quand même y a voir moyen
> > de DL puisque on peut naviguer sous links , je pars à la recherche
> > d'une boule de cristale , ou en se jour dominical, y a t'il une âme
> > charitable, qui va ce décider à combler mes lacunes ! (on partage plus
> > son savoir ?)
>
>
> Bon, je te propose de faire la chose suivante:
>
> $ script /tmp/log.wget
> $ wget -m -k -p http://jurisfac.free.fr
> $ ^D
> et tu m'envoies en privé le log.wget. wget doit indiquer pourquoi il ne
> charge plus au delà du 19ième fichiers.
> Vérifies auparavant le gag idiot d'un manque de place sur le disque, ça
> arrive.
>
>
> François Boisson
>
>
>
>
> --
> Pensez à lire la FAQ de la liste avant de poser une question :
> http://wiki.debian.net/?DebianFrench
>
> Pensez à rajouter le mot ``spam'' dans vos champs "From" et "Reply-To:"
>
> To UNSUBSCRIBE, email to debian-user-french-REQUEST@lists.debian.org
> with a subject of "unsubscribe". Trouble? Contact listmaster@lists.debian.org
>
>
Reply to: