Re: Introducing http.debian.net, Debian's mirrors redirector
in-line :-
On Tue, Jun 26, 2012 at 10:43 AM, Raphael Geissert <geissert@debian.org> wrote:
> Hi,
Hi again,
> On Thursday 21 June 2012 23:03:34 shirish शिरीष wrote:
>> > More details, comparison to other approaches, and more information can
>> > be found at:
>> > http://http.debian.net/
>>
>> I *think* it should be also beneficial for jigdo stuff as well.
>
> Yes. Not sure how the downloader used by jigdo handles redirections, but it
> should work nevertheless.
>
>> There is one thing though, for some reason it takes much more
>> bandwidth when updating the index then my previous way.
> [...]
>> Previously when I was using a single mirror, most of the time the diff
>> between two runs was at the most 750 kB in the index update run. I can
>> recall there is something call .pdiff which made it easier and smaller
>> to have the index updated.
>
> For some reason, there no longer are "pdiff"s for stable, so it has to
> download the whole files on every update.
This seems to happen only via the re-director. For instance this is
from my second run with having a single server in
/etc/apt/sources.list :-
$ aptu
Hit http://ftp.debian.org unstable InRelease
Hit http://ftp.debian.org experimental InRelease
Hit http://ftp.debian.org testing InRelease
Ign http://ftp.debian.org stable InRelease
Hit http://ftp.debian.org unstable/main Sources/DiffIndex
Hit http://ftp.debian.org unstable/contrib Sources/DiffIndex
Hit http://ftp.debian.org unstable/non-free Sources/DiffIndex
Hit http://ftp.debian.org unstable/main amd64 Packages/DiffIndex
Hit http://ftp.debian.org unstable/contrib amd64 Packages/DiffIndex
Hit http://ftp.debian.org unstable/non-free amd64 Packages/DiffIndex
Hit http://ftp.debian.org unstable/contrib Translation-en/DiffIndex
Hit http://ftp.debian.org unstable/main Translation-en/DiffIndex
Hit http://ftp.debian.org unstable/non-free Translation-en/DiffIndex
Get: 1 http://ftp.debian.org experimental/main amd64
Packages/DiffIndex [7,819 B]
Get: 2 http://ftp.debian.org experimental/main
Translation-en/DiffIndex [7,819 B]
Hit http://ftp.debian.org testing/main Sources/DiffIndex
Hit http://ftp.debian.org testing/contrib Sources/DiffIndex
Hit http://ftp.debian.org testing/non-free Sources/DiffIndex
Hit http://ftp.debian.org testing/main amd64 Packages/DiffIndex
Hit http://ftp.debian.org testing/contrib amd64 Packages/DiffIndex
Hit http://ftp.debian.org testing/non-free amd64 Packages/DiffIndex
Hit http://ftp.debian.org testing/contrib Translation-en/DiffIndex
Hit http://ftp.debian.org testing/main Translation-en/DiffIndex
Hit http://ftp.debian.org testing/non-free Translation-en/DiffIndex
Get: 3 http://ftp.debian.org stable Release.gpg [1,672 B]
Get: 4 http://ftp.debian.org unstable/main 2012-06-26-0815.36.pdiff
[21.1 kB]
Get: 5 http://ftp.debian.org unstable/main 2012-06-26-0815.36.pdiff
[21.1 kB]
Get: 6 http://ftp.debian.org unstable/main amd64
2012-06-26-0815.36.pdiff [9,871 B]
Get: 7 http://ftp.debian.org unstable/main 2012-06-26-0815.36.pdiff
[277 B]
Get: 8 http://ftp.debian.org unstable/main amd64
2012-06-26-0815.36.pdiff [9,871 B]
Get: 9 http://ftp.debian.org experimental/main amd64
2012-06-26-0215.13.pdiff [759 B]
Get: 10 http://ftp.debian.org experimental/main
2012-06-26-0215.13.pdiff [351 B]
Get: 11 http://ftp.debian.org testing/main 2012-06-26-0215.13.pdiff
[30.0 kB]
Get: 12 http://ftp.debian.org unstable/main 2012-06-26-0815.36.pdiff
[277 B]
Get: 13 http://ftp.debian.org experimental/main amd64
2012-06-26-0215.13.pdiff [759 B]
Get: 14 http://ftp.debian.org experimental/main
2012-06-26-0215.13.pdiff [351 B]
Get: 15 http://ftp.debian.org testing/main 2012-06-26-0215.13.pdiff
[30.0 kB]
Get: 16 http://ftp.debian.org testing/non-free
2012-06-26-0215.13.pdiff [393 B]
Get: 17 http://ftp.debian.org testing/main amd64
2012-06-26-0215.13.pdiff [47.3 kB]
Get: 18 http://ftp.debian.org testing/non-free
2012-06-26-0215.13.pdiff [393 B]
Get: 19 http://ftp.debian.org testing/main amd64
2012-06-26-0215.13.pdiff [47.3 kB]
Get: 20 http://ftp.debian.org testing/non-free amd64
2012-06-26-0215.13.pdiff [3,829 B]
Get: 21 http://ftp.debian.org testing/main 2012-06-26-0215.13.pdiff
[1,459 B]
Get: 22 http://ftp.debian.org testing/non-free amd64
2012-06-26-0215.13.pdiff [3,829 B]
Get: 23 http://ftp.debian.org testing/main 2012-06-26-0215.13.pdiff
[1,459 B]
Get: 24 http://ftp.debian.org testing/non-free
2012-06-26-0215.13.pdiff [258 B]
Get: 25 http://ftp.debian.org testing/non-free
2012-06-26-0215.13.pdiff [258 B]
Hit http://ftp.debian.org stable Release
Get: 26 http://ftp.debian.org experimental/main amd64
2012-06-26-0815.36.pdiff [701 B]
Get: 27 http://ftp.debian.org experimental/main amd64
2012-06-26-0815.36.pdiff [701 B]
Get: 28 http://ftp.debian.org experimental/main
2012-06-26-0815.36.pdiff [571 B]
Get: 29 http://ftp.debian.org experimental/main
2012-06-26-0815.36.pdiff [571 B]
Hit http://ftp.debian.org stable/main Sources
Hit http://ftp.debian.org stable/contrib Sources
Hit http://ftp.debian.org stable/non-free Sources
Hit http://ftp.debian.org stable/main amd64 Packages
Hit http://ftp.debian.org stable/non-free amd64 Packages
Hit http://ftp.debian.org stable/contrib amd64 Packages
Fetched 134 kB in 19s (6,898 B/s)
Current status: 200 updates [-131].
As can be seen pdiffs are generated if you use the same server.
> Unless the files really changed, the Last-Modified-Since headers should have
> prevented the download. Will have to check if they are correctly preserved,
> it might be that.
Please look into it.
> Cheers,
> --
> Raphael Geissert - Debian Developer
> www.debian.org - get.debian.net
Thanx again for replying asap.
Look forward to hearing from you.
--
Regards,
Shirish Agarwal शिरीष अग्रवाल
My quotes in this email licensed under CC 3.0
http://creativecommons.org/licenses/by-nc/3.0/
http://flossexperiences.wordpress.com
065C 6D79 A68C E7EA 52B3 8D70 950D 53FB 729A 8B17
Reply to: