Re: These new diffs are great, but...

[Marc Haber <mh+debian-devel@zugschlus.de>]

On Fri, 30 Jun 2006 11:10:37 +0200, Eduard Bloch <edi@gmx.de> wrote:
>I have doubts, have you measured the real difference?

Yes, I have. Test was done in a sid chroot that hasn't been updated
for like two weeks.

|$ time sudo aptitude update
|Reading package lists... Done
|Building dependency tree... Done
|Reading extended state information
|Initializing package states... Done
|Building tag database... Done
|Ign http://zg.debian.zugschlus.de zg/sid Release.gpg
|Ign http://zg.debian.zugschlus.de zg/sid Release
|Ign http://zg.debian.zugschlus.de zg/sid/main Packages/DiffIndex
|Ign http://zg.debian.zugschlus.de zg/sid/contrib Packages/DiffIndex
|Get:1 http://zg.debian.zugschlus.de zg/sid/main Packages [7506B]
|Hit http://zg.debian.zugschlus.de zg/sid/contrib Packages
|Get:2 http://debian.debian.zugschlus.de sid Release.gpg [189B]
|Get:3 http://debian.debian.zugschlus.de sid Release [38.3kB]
|Ign http://debian.debian.zugschlus.de sid Release
|Get:4 http://debian.debian.zugschlus.de sid/main Packages/DiffIndex [12.6kB]
|Get:5 http://debian.debian.zugschlus.de sid/contrib Packages/DiffIndex [12.5kB]
|Get:6 http://debian.debian.zugschlus.de sid/main Sources/DiffIndex [12.5kB]
|Get:7 http://debian.debian.zugschlus.de sid/contrib Sources/DiffIndex [12.5kB]
|Get:8 2006-06-22-1336.37.pdiff [16.0kB]
|Get:9 2006-06-22-1336.37.pdiff [16.0kB]
|Get:10 2006-06-22-1336.37.pdiff [180B]
|Get:11 2006-06-22-1336.37.pdiff [9491B]
|Get:12 2006-06-22-1336.37.pdiff [180B]
|Get:13 2006-06-22-1336.37.pdiff [16.0kB]
|Get:14 2006-06-22-1336.37.pdiff [172B]
|Get:15 2006-06-22-1336.37.pdiff [9491B]
|Get:16 2006-06-22-1336.37.pdiff [172B]
|Get:17 2006-06-22-1336.37.pdiff [180B]
|Get:18 2006-06-23-1348.02.pdiff [25.9kB]
|Get:19 2006-06-22-1336.37.pdiff [9491B]
|Get:20 2006-06-23-1348.02.pdiff [25.9kB]
|Get:21 2006-06-23-1348.02.pdiff [329B]
|Get:22 2006-06-23-1348.02.pdiff [329B]
|Get:23 2006-06-22-1336.37.pdiff [172B]
|Get:24 2006-06-23-1348.02.pdiff [25.9kB]
|Get:25 2006-06-23-1348.02.pdiff [13.9kB]
|Get:26 2006-06-23-1348.02.pdiff [13.9kB]
|Get:27 2006-06-23-1348.02.pdiff [139B]
|Get:28 2006-06-23-1348.02.pdiff [139B]
|Get:29 2006-06-23-1348.02.pdiff [329B]
|Get:30 2006-06-24-1338.23.pdiff [39.6kB]
|Get:31 2006-06-23-1348.02.pdiff [13.9kB]
|Get:32 2006-06-24-1338.23.pdiff [39.6kB]
|Get:33 2006-06-24-1338.23.pdiff [155B]
|Get:34 2006-06-24-1338.23.pdiff [155B]
|Get:35 2006-06-23-1348.02.pdiff [139B]
|Get:36 2006-06-24-1338.23.pdiff [18.9kB]
|Get:37 2006-06-24-1338.23.pdiff [39.6kB]
|Get:38 2006-06-24-1338.23.pdiff [18.9kB]
|Get:39 2006-06-24-1338.23.pdiff [165B]
|Get:40 2006-06-24-1338.23.pdiff [165B]
|Get:41 2006-06-24-1338.23.pdiff [155B]
|Get:42 2006-06-25-1342.37.pdiff [20.3kB]
|Get:43 2006-06-24-1338.23.pdiff [18.9kB]
|Get:44 2006-06-25-1342.37.pdiff [20.3kB]
|Get:45 2006-06-25-1342.37.pdiff [205B]
|Get:46 2006-06-25-1342.37.pdiff [205B]
|Get:47 2006-06-24-1338.23.pdiff [165B]
|Get:48 2006-06-25-1342.37.pdiff [20.3kB]
|Get:49 2006-06-25-1342.37.pdiff [12.0kB]
|Get:50 2006-06-25-1342.37.pdiff [12.0kB]
|Get:51 2006-06-25-1342.37.pdiff [147B]
|Get:52 2006-06-25-1342.37.pdiff [147B]
|Get:53 2006-06-25-1342.37.pdiff [205B]
|Get:54 2006-06-25-1342.37.pdiff [12.0kB]
|Get:55 2006-06-26-1346.13.pdiff [24.6kB]
|Get:56 2006-06-26-1346.13.pdiff [24.6kB]
|Get:57 2006-06-26-1346.13.pdiff [151B]
|Get:58 2006-06-26-1346.13.pdiff [151B]
|Get:59 2006-06-25-1342.37.pdiff [147B]
|Get:60 2006-06-26-1346.13.pdiff [24.6kB]
|Get:61 2006-06-26-1346.13.pdiff [11.5kB]
|Get:62 2006-06-26-1346.13.pdiff [11.5kB]
|Get:63 2006-06-26-1346.13.pdiff [207B]
|Get:64 2006-06-26-1346.13.pdiff [207B]
|Get:65 2006-06-26-1346.13.pdiff [151B]
|Get:66 2006-06-26-1346.13.pdiff [11.5kB]
|Get:67 2006-06-27-1308.52.pdiff [1269kB]
|Get:68 2006-06-27-1308.52.pdiff [1269kB]
|Get:69 2006-06-27-1308.52.pdiff [14.7kB]
|Get:70 2006-06-27-1308.52.pdiff [14.7kB]
|Get:71 2006-06-26-1346.13.pdiff [207B]
|Get:72 2006-06-27-1308.52.pdiff [13.0kB]
|Get:73 2006-06-27-1308.52.pdiff [1269kB]
|Get:74 2006-06-27-1308.52.pdiff [13.0kB]
|Get:75 2006-06-27-1308.52.pdiff [29B]
|Get:76 2006-06-27-1308.52.pdiff [29B]
|Get:77 2006-06-27-1308.52.pdiff [14.7kB]
|Get:78 2006-06-28-1245.43.pdiff [25.3kB]
|Get:79 2006-06-27-1308.52.pdiff [13.0kB]
|Get:80 2006-06-28-1245.43.pdiff [25.3kB]
|Get:81 2006-06-28-1245.43.pdiff [391B]
|Get:82 2006-06-28-1245.43.pdiff [391B]
|Get:83 2006-06-27-1308.52.pdiff [29B]
|Get:84 2006-06-28-1245.43.pdiff [25.3kB]
|Get:85 2006-06-28-1245.43.pdiff [7672B]
|Get:86 2006-06-28-1245.43.pdiff [7672B]
|Get:87 2006-06-28-1245.43.pdiff [146B]
|Get:88 2006-06-28-1245.43.pdiff [146B]
|Get:89 2006-06-28-1245.43.pdiff [391B]
|Get:90 2006-06-29-1245.21.pdiff [39.1kB]
|Get:91 2006-06-28-1245.43.pdiff [7672B]
|Get:92 2006-06-29-1245.21.pdiff [39.1kB]
|Get:93 2006-06-29-1245.21.pdiff [818B]
|Get:94 2006-06-29-1245.21.pdiff [818B]
|Get:95 2006-06-28-1245.43.pdiff [146B]
|Get:96 2006-06-29-1245.21.pdiff [11.9kB]
|Get:97 2006-06-29-1245.21.pdiff [39.1kB]
|Get:98 2006-06-29-1245.21.pdiff [11.9kB]
|Get:99 2006-07-01-1237.31.pdiff [173B]
|Get:100 2006-07-01-1237.31.pdiff [173B]
|Get:101 2006-06-29-1245.21.pdiff [818B]
|Get:102 2006-06-30-1246.33.pdiff [46.0kB]
|Get:103 2006-06-29-1245.21.pdiff [11.9kB]
|Get:104 2006-06-30-1246.33.pdiff [46.0kB]
|Get:105 2006-07-01-1237.31.pdiff [364B]
|Get:106 2006-07-01-1237.31.pdiff [364B]
|Get:107 2006-07-01-1237.31.pdiff [173B]
|Get:108 2006-06-30-1246.33.pdiff [12.3kB]
|Get:109 2006-06-30-1246.33.pdiff [46.0kB]
|Get:110 2006-06-30-1246.33.pdiff [12.3kB]
|Get:111 2006-07-03-1239.27.pdiff [211B]
|Get:112 2006-07-03-1239.27.pdiff [211B]
|Get:113 2006-07-01-1237.31.pdiff [364B]
|Get:114 2006-07-01-1237.31.pdiff [24.8kB]
|Get:115 2006-06-30-1246.33.pdiff [12.3kB]
|Get:116 2006-07-01-1237.31.pdiff [24.8kB]
|Get:117 2006-07-03-0046.25.pdiff [9018B]
|Get:118 2006-07-03-0046.25.pdiff [9018B]
|Get:119 2006-07-03-1239.27.pdiff [211B]
|Get:120 2006-07-01-1237.31.pdiff [24.8kB]
|Get:121 2006-07-01-1237.31.pdiff [8331B]
|Get:122 2006-07-01-1237.31.pdiff [8331B]
|Get:123 2006-07-05-1243.59.pdiff [596B]
|Get:124 2006-07-05-1243.59.pdiff [596B]
|Get:125 2006-07-03-0046.25.pdiff [9018B]
|Get:126 2006-07-03-0046.25.pdiff [768kB]
|Get:127 2006-07-01-1237.31.pdiff [8331B]
|Get:128 2006-07-03-0046.25.pdiff [768kB]
|Get:129 2006-07-03-1239.27.pdiff [352B]
|Get:130 2006-07-03-1239.27.pdiff [352B]
|Get:131 2006-07-05-1243.59.pdiff [596B]
|Get:132 2006-07-03-0046.25.pdiff [10.1kB]
|Get:133 2006-07-03-0046.25.pdiff [768kB]
|Get:134 2006-07-03-0046.25.pdiff [10.1kB]
|Get:135 2006-07-06-1242.31.pdiff [225B]
|Get:136 2006-07-06-1242.31.pdiff [225B]
|Get:137 2006-07-03-1239.27.pdiff [352B]
|Get:138 2006-07-03-1239.27.pdiff [21.4kB]
|Get:139 2006-07-03-0046.25.pdiff [10.1kB]
|Get:140 2006-07-03-1239.27.pdiff [21.4kB]
|Get:141 2006-07-05-1243.59.pdiff [1046B]
|Get:142 2006-07-05-1243.59.pdiff [1046B]
|Get:143 2006-07-06-1242.31.pdiff [225B]
|Get:144 2006-07-03-1239.27.pdiff [21.4kB]
|Get:145 2006-07-03-1239.27.pdiff [8854B]
|Get:146 2006-07-03-1239.27.pdiff [8854B]
|Get:147 2006-07-05-1243.59.pdiff [1046B]
|Get:148 2006-07-03-1239.27.pdiff [8854B]
|Get:149 2006-07-04-1241.41.pdiff [29.4kB]
|Get:150 2006-07-04-1241.41.pdiff [29.4kB]
|Get:151 2006-07-04-1241.41.pdiff [29.4kB]
|Get:152 2006-07-04-1241.41.pdiff [11.7kB]
|Get:153 2006-07-04-1241.41.pdiff [11.7kB]
|Get:154 2006-07-04-1241.41.pdiff [11.7kB]
|Get:155 2006-07-05-1243.59.pdiff [62.9kB]
|Get:156 2006-07-05-1243.59.pdiff [62.9kB]
|Get:157 2006-07-05-1243.59.pdiff [62.9kB]
|Get:158 2006-07-05-1243.59.pdiff [20.8kB]
|Get:159 2006-07-05-1243.59.pdiff [20.8kB]
|Get:160 2006-07-05-1243.59.pdiff [20.8kB]
|Get:161 2006-07-06-1242.31.pdiff [44.0kB]
|Get:162 2006-07-06-1242.31.pdiff [44.0kB]
|Get:163 2006-07-06-1242.31.pdiff [44.0kB]
|Get:164 2006-07-06-1242.31.pdiff [12.9kB]
|Get:165 2006-07-06-1242.31.pdiff [12.9kB]
|Get:166 2006-07-06-1242.31.pdiff [12.9kB]
|Fetched 2766kB in 1m2s (44.0kB/s)
|Reading package lists... Done
|W: GPG error: http://debian.debian.zugschlus.de sid Release: Could not execute '/usr/bin/gpgv' to verify signature (is gnupg installed?)
|W: You may want to run apt-get update to correct these problems
|
|real    1m9.789s
|user    0m54.259s
|sys     0m8.921s
|$ sudo rm /var/lib/apt/lists/*
|rm: cannot remove `/var/lib/apt/lists/partial': Is a directory
|$ time sudo aptitude update
|Reading package lists... Done
|Building dependency tree... Done
|Reading extended state information
|Initializing package states... Done
|Building tag database... Done
|Ign http://zg.debian.zugschlus.de zg/sid Release.gpg
|Get:1 http://debian.debian.zugschlus.de sid Release.gpg [189B]
|Ign http://zg.debian.zugschlus.de zg/sid Release
|Get:2 http://zg.debian.zugschlus.de zg/sid/main Packages [7506B]
|Get:3 http://debian.debian.zugschlus.de sid Release [38.3kB]
|Get:4 http://zg.debian.zugschlus.de zg/sid/contrib Packages [20B]
|Ign http://debian.debian.zugschlus.de sid Release
|Get:5 http://debian.debian.zugschlus.de sid/main Packages [5603kB]
|Get:6 http://debian.debian.zugschlus.de sid/contrib Packages [76.2kB]
|Get:7 http://debian.debian.zugschlus.de sid/main Sources [1644kB]
|Get:8 http://debian.debian.zugschlus.de sid/contrib Sources [24.8kB]
|Fetched 7394kB in 5s (1478kB/s)
|Reading package lists... Done
|W: GPG error: http://debian.debian.zugschlus.de sid Release: Could not execute '/usr/bin/gpgv' to verify signature (is gnupg installed?)
|W: You may want to run apt-get update to correct these problems
|
|real    0m8.479s
|user    0m4.640s
|sys     0m1.068s
|$ exit

Updating with pdiffs took one minute nine seconds while downloading a
completely new set of list files took eight seconds.

Test environment was quite unfair though (an old machine with an 1200
MHz CPU and a single, slow disk on an 100 MBit link to a rather local
mirror).

Greetings
Marc

-- 
-------------------------------------- !! No courtesy copies, please !! -----
Marc Haber         |   " Questions are the         | Mailadresse im Header
Mannheim, Germany  |     Beginning of Wisdom "     | http://www.zugschlus.de/
Nordisch by Nature | Lt. Worf, TNG "Rightful Heir" | Fon: *49 621 72739834