Your message dated Tue, 11 Feb 2014 22:22:30 +0100 with message-id <20140211212229.GB5697@crossbow> and subject line Re: Bug#671440: pdiffs has caused the Debian Bug report #671440, regarding detect when just getting a new Packages file would be faster than the pdiffs to be marked as done. This means that you claim that the problem has been dealt with. If this is not the case it is now your responsibility to reopen the Bug report if necessary, and/or fix the problem forthwith. (NB: If you are a system administrator and have no idea what this message is talking about, this may indicate a serious mail system misconfiguration somewhere. Please contact owner@bugs.debian.org immediately.) -- 671440: http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=671440 Debian Bug Tracking System Contact owner@bugs.debian.org with problems
--- Begin Message ---
- To: submit@bugs.debian.org
- Subject: detect when just getting a new Packages file would be faster than the pdiffs
- From: jidanni@jidanni.org
- Date: Fri, 04 May 2012 09:53:01 +0800
- Message-id: <87txzwd85e.fsf@jidanni.org>
Package: apt Version: 0.9.2 Severity: wishlist Maybe there should be a mechanism to detect when just getting a fresh Packages file would be faster than all the pdiffs, seen here after returning from a one week vacation: + date -u Fri May 4 01:35:10 UTC 2012 + apt-get update Get:1 http://ike.egr.msu.edu experimental InRelease [162 kB] Ign http://mozilla.debian.net experimental InRelease Ign http://emacs.naquadah.org unstable/ InRelease Ign http://files.basex.org unstable/ InRelease Hit http://mozilla.debian.net experimental Release.gpg Hit http://emacs.naquadah.org unstable/ Release.gpg Hit http://mozilla.debian.net experimental Release Hit http://emacs.naquadah.org unstable/ Release Get:2 http://ike.egr.msu.edu unstable InRelease [210 kB] Ign http://files.basex.org unstable/ Release.gpg Hit http://mozilla.debian.net experimental/iceweasel-aurora i386 Packages Hit http://emacs.naquadah.org unstable/ Packages Hit http://files.basex.org unstable/ Release Get:3 http://ike.egr.msu.edu experimental/main i386 Packages/DiffIndex [7819 B] Hit http://ike.egr.msu.edu experimental/contrib i386 Packages/DiffIndex Ign http://files.basex.org unstable/ Packages/DiffIndex Hit http://ike.egr.msu.edu experimental/non-free i386 Packages/DiffIndex Ign http://emacs.naquadah.org unstable/ Translation-en Ign http://mozilla.debian.net experimental/iceweasel-aurora Translation-en Hit http://ike.egr.msu.edu experimental/contrib Translation-en/DiffIndex Hit http://files.basex.org unstable/ Packages Get:4 http://ike.egr.msu.edu experimental/main Translation-en/DiffIndex [7819 B] Hit http://ike.egr.msu.edu experimental/non-free Translation-en/DiffIndex Get:5 http://ike.egr.msu.edu unstable/main i386 Packages/DiffIndex [7876 B] Hit http://ike.egr.msu.edu unstable/contrib i386 Packages/DiffIndex Get:6 http://ike.egr.msu.edu unstable/non-free i386 Packages/DiffIndex [7819 B] Hit http://ike.egr.msu.edu unstable/contrib Translation-en/DiffIndex Get:7 http://ike.egr.msu.edu unstable/main Translation-en/DiffIndex [7876 B] Hit http://ike.egr.msu.edu unstable/non-free Translation-en/DiffIndex Get:8 http://ike.egr.msu.edu experimental/main i386 2012-04-28-0213.15.pdiff [245 B] Get:9 http://ike.egr.msu.edu experimental/main 2012-04-30-1413.19.pdiff [433 B] Get:10 http://ike.egr.msu.edu unstable/main i386 2012-04-27-1414.47.pdiff [15.3 kB] Get:11 http://ike.egr.msu.edu experimental/main i386 2012-04-28-0213.15.pdiff [245 B] Get:12 http://ike.egr.msu.edu unstable/contrib i386 2012-05-01-1415.02.pdiff [866 B] Get:13 http://ike.egr.msu.edu unstable/non-free i386 2012-05-03-2015.12.pdiff [31 B] Get:14 http://ike.egr.msu.edu unstable/main 2012-04-27-0814.16.pdiff [732 B] Ign http://files.basex.org unstable/ Translation-en Get:15 http://ike.egr.msu.edu experimental/main 2012-04-30-1413.19.pdiff [433 B] Get:16 http://ike.egr.msu.edu unstable/main i386 2012-04-27-1414.47.pdiff [15.3 kB] Get:17 http://ike.egr.msu.edu experimental/main i386 2012-04-28-0814.26.pdiff [238 B] Get:18 http://ike.egr.msu.edu experimental/main 2012-05-01-1415.02.pdiff [818 B] Get:19 http://ike.egr.msu.edu unstable/contrib i386 2012-05-01-1415.02.pdiff [866 B] Get:20 http://ike.egr.msu.edu unstable/non-free i386 2012-05-03-2015.12.pdiff [31 B] Get:21 http://ike.egr.msu.edu unstable/main i386 2012-04-27-2014.42.pdiff [8666 B] Get:22 http://ike.egr.msu.edu unstable/main 2012-04-27-0814.16.pdiff [732 B] Get:23 http://ike.egr.msu.edu unstable/contrib i386 2012-05-02-2017.15.pdiff [622 B] Get:24 http://ike.egr.msu.edu experimental/main i386 2012-04-28-0814.26.pdiff [238 B] Get:25 http://ike.egr.msu.edu unstable/main 2012-04-27-1414.47.pdiff [715 B] Get:26 http://ike.egr.msu.edu experimental/main 2012-05-01-1415.02.pdiff [818 B] Get:27 http://ike.egr.msu.edu unstable/main i386 2012-04-27-2014.42.pdiff [8666 B] Get:28 http://ike.egr.msu.edu experimental/main i386 2012-04-28-1413.55.pdiff [11.7 kB] Get:29 http://ike.egr.msu.edu experimental/main 2012-05-02-0814.32.pdiff [298 B] Get:30 http://ike.egr.msu.edu unstable/contrib i386 2012-05-02-2017.15.pdiff [622 B] Get:31 http://ike.egr.msu.edu unstable/main 2012-04-27-1414.47.pdiff [715 B] Get:32 http://ike.egr.msu.edu unstable/main i386 2012-04-28-0213.15.pdiff [14.1 kB] Get:33 http://ike.egr.msu.edu experimental/main i386 2012-04-28-1413.55.pdiff [11.7 kB] Get:34 http://ike.egr.msu.edu experimental/main 2012-05-02-0814.32.pdiff [298 B] Get:35 http://ike.egr.msu.edu unstable/main 2012-04-27-2014.42.pdiff [602 B] Get:36 http://ike.egr.msu.edu unstable/main i386 2012-04-28-0213.15.pdiff [14.1 kB] Get:37 http://ike.egr.msu.edu experimental/main i386 2012-04-28-2012.58.pdiff [12.0 kB] Get:38 http://ike.egr.msu.edu experimental/main 2012-05-02-2017.15.pdiff [667 B] Get:39 http://ike.egr.msu.edu unstable/main 2012-04-27-2014.42.pdiff [602 B] Get:40 http://ike.egr.msu.edu unstable/main i386 2012-04-28-0814.26.pdiff [1130 B] Get:41 http://ike.egr.msu.edu experimental/main i386 2012-04-28-2012.58.pdiff [12.0 kB] Get:42 http://ike.egr.msu.edu unstable/main 2012-04-28-0213.15.pdiff [31 B] Get:43 http://ike.egr.msu.edu experimental/main 2012-05-02-2017.15.pdiff [667 B] Get:44 http://ike.egr.msu.edu experimental/main i386 2012-04-29-1413.38.pdiff [3675 B] Get:45 http://ike.egr.msu.edu unstable/main i386 2012-04-28-0814.26.pdiff [1130 B] Get:46 http://ike.egr.msu.edu experimental/main 2012-05-03-2015.12.pdiff [1353 B] Get:47 http://ike.egr.msu.edu unstable/main 2012-04-28-0213.15.pdiff [31 B] Get:48 http://ike.egr.msu.edu unstable/main i386 2012-04-28-1413.55.pdiff [9719 B] Get:49 http://ike.egr.msu.edu experimental/main i386 2012-04-29-1413.38.pdiff [3675 B] Get:50 http://ike.egr.msu.edu experimental/main 2012-05-03-2015.12.pdiff [1353 B] Get:51 http://ike.egr.msu.edu unstable/main 2012-04-28-0814.26.pdiff [32 B] Get:52 http://ike.egr.msu.edu unstable/main i386 2012-04-28-1413.55.pdiff [9719 B] Get:53 http://ike.egr.msu.edu experimental/main i386 2012-04-30-0213.21.pdiff [6464 B] Get:54 http://ike.egr.msu.edu unstable/main 2012-04-28-0814.26.pdiff [32 B] Get:55 http://ike.egr.msu.edu unstable/main i386 2012-04-28-2012.58.pdiff [1187 B] Get:56 http://ike.egr.msu.edu experimental/main i386 2012-04-30-0213.21.pdiff [6464 B] Get:57 http://ike.egr.msu.edu unstable/main i386 2012-04-28-2012.58.pdiff [1187 B] Get:58 http://ike.egr.msu.edu unstable/main 2012-04-28-1413.55.pdiff [4909 B] Get:59 http://ike.egr.msu.edu experimental/main i386 2012-04-30-1413.19.pdiff [1220 B] Get:60 http://ike.egr.msu.edu unstable/main 2012-04-28-1413.55.pdiff [4909 B] Get:61 http://ike.egr.msu.edu unstable/main i386 2012-04-29-0213.55.pdiff [14.0 kB] Get:62 http://ike.egr.msu.edu experimental/main i386 2012-04-30-1413.19.pdiff [1220 B] Get:63 http://ike.egr.msu.edu unstable/main i386 2012-04-29-0213.55.pdiff [14.0 kB] Get:64 http://ike.egr.msu.edu unstable/main 2012-04-28-2012.58.pdiff [380 B] Get:65 http://ike.egr.msu.edu experimental/main i386 2012-05-01-0213.37.pdiff [511 B] Get:66 http://ike.egr.msu.edu unstable/main 2012-04-28-2012.58.pdiff [380 B] Get:67 http://ike.egr.msu.edu unstable/main i386 2012-04-29-0814.09.pdiff [23.9 kB] Get:68 http://ike.egr.msu.edu experimental/main i386 2012-05-01-0213.37.pdiff [511 B] Get:69 http://ike.egr.msu.edu unstable/main i386 2012-04-29-0814.09.pdiff [23.9 kB] Get:70 http://ike.egr.msu.edu unstable/main 2012-04-29-0213.55.pdiff [334 B] Get:71 http://ike.egr.msu.edu experimental/main i386 2012-05-01-0815.43.pdiff [846 B] Get:72 http://ike.egr.msu.edu unstable/main 2012-04-29-0213.55.pdiff [334 B] Get:73 http://ike.egr.msu.edu unstable/main i386 2012-04-29-1413.38.pdiff [12.7 kB] Get:74 http://ike.egr.msu.edu experimental/main i386 2012-05-01-0815.43.pdiff [846 B] Get:75 http://ike.egr.msu.edu unstable/main 2012-04-29-1413.38.pdiff [75 B] Get:76 http://ike.egr.msu.edu unstable/main i386 2012-04-29-1413.38.pdiff [12.7 kB] Get:77 http://ike.egr.msu.edu experimental/main i386 2012-05-01-1415.02.pdiff [2537 B] Get:78 http://ike.egr.msu.edu unstable/main 2012-04-29-1413.38.pdiff [75 B] Get:79 http://ike.egr.msu.edu unstable/main i386 2012-04-29-2013.19.pdiff [17.7 kB] Get:80 http://ike.egr.msu.edu experimental/main i386 2012-05-01-1415.02.pdiff [2537 B] Get:81 http://ike.egr.msu.edu unstable/main 2012-04-30-0213.21.pdiff [1928 B] Get:82 http://ike.egr.msu.edu unstable/main i386 2012-04-29-2013.19.pdiff [17.7 kB] Get:83 http://ike.egr.msu.edu experimental/main i386 2012-05-02-2017.15.pdiff [3146 B] Get:84 http://ike.egr.msu.edu unstable/main 2012-04-30-0213.21.pdiff [1928 B] Get:85 http://ike.egr.msu.edu unstable/main i386 2012-04-30-0213.21.pdiff [8055 B] Get:86 http://ike.egr.msu.edu experimental/main i386 2012-05-02-2017.15.pdiff [3146 B] Get:87 http://ike.egr.msu.edu unstable/main 2012-04-30-0816.43.pdiff [315 B] Get:88 http://ike.egr.msu.edu unstable/main i386 2012-04-30-0213.21.pdiff [8055 B] Get:89 http://ike.egr.msu.edu experimental/main i386 2012-05-03-0215.37.pdiff [1310 B] Get:90 http://ike.egr.msu.edu unstable/main 2012-04-30-0816.43.pdiff [315 B] Get:91 http://ike.egr.msu.edu unstable/main i386 2012-04-30-0816.43.pdiff [7278 B] Get:92 http://ike.egr.msu.edu experimental/main i386 2012-05-03-0215.37.pdiff [1310 B] Get:93 http://ike.egr.msu.edu unstable/main i386 2012-04-30-0816.43.pdiff [7278 B] Get:94 http://ike.egr.msu.edu unstable/main 2012-04-30-1413.19.pdiff [297 B] Get:95 http://ike.egr.msu.edu experimental/main i386 2012-05-03-0814.10.pdiff [23.3 kB] Get:96 http://ike.egr.msu.edu unstable/main 2012-04-30-1413.19.pdiff [297 B] Get:97 http://ike.egr.msu.edu unstable/main i386 2012-04-30-1413.19.pdiff [18.4 kB] Get:98 http://ike.egr.msu.edu experimental/main i386 2012-05-03-0814.10.pdiff [23.3 kB] Get:99 http://ike.egr.msu.edu unstable/main 2012-04-30-2017.16.pdiff [716 B] Get:100 http://ike.egr.msu.edu unstable/main i386 2012-04-30-1413.19.pdiff [18.4 kB] Get:101 http://ike.egr.msu.edu experimental/main i386 2012-05-03-2015.12.pdiff [8480 B] Get:102 http://ike.egr.msu.edu unstable/main 2012-04-30-2017.16.pdiff [716 B] Get:103 http://ike.egr.msu.edu unstable/main i386 2012-04-30-2017.16.pdiff [37.4 kB] Get:104 http://ike.egr.msu.edu experimental/main i386 2012-05-03-2015.12.pdiff [8480 B] Get:105 http://ike.egr.msu.edu unstable/main 2012-05-01-0213.37.pdiff [41 B] Get:106 http://ike.egr.msu.edu unstable/main i386 2012-04-30-2017.16.pdiff [37.4 kB] Get:107 http://ike.egr.msu.edu unstable/main 2012-05-01-0213.37.pdiff [41 B] Get:108 http://ike.egr.msu.edu unstable/main i386 2012-05-01-0213.37.pdiff [6796 B] Get:109 http://ike.egr.msu.edu unstable/main i386 2012-05-01-0213.37.pdiff [6796 B] Get:110 http://ike.egr.msu.edu unstable/main 2012-05-01-0815.43.pdiff [217 B] Get:111 http://ike.egr.msu.edu unstable/main 2012-05-01-0815.43.pdiff [217 B] Get:112 http://ike.egr.msu.edu unstable/main i386 2012-05-01-0815.43.pdiff [4546 B] Get:113 http://ike.egr.msu.edu unstable/main i386 2012-05-01-0815.43.pdiff [4546 B] Get:114 http://ike.egr.msu.edu unstable/main 2012-05-01-1415.02.pdiff [8072 B] Get:115 http://ike.egr.msu.edu unstable/main 2012-05-01-1415.02.pdiff [8072 B] Get:116 http://ike.egr.msu.edu unstable/main i386 2012-05-01-1415.02.pdiff [34.4 kB] Get:117 http://ike.egr.msu.edu unstable/main i386 2012-05-01-1415.02.pdiff [34.4 kB] Get:118 http://ike.egr.msu.edu unstable/main 2012-05-01-2014.31.pdiff [2631 B] Get:119 http://ike.egr.msu.edu unstable/main 2012-05-01-2014.31.pdiff [2631 B] Get:120 http://ike.egr.msu.edu unstable/main i386 2012-05-01-2014.31.pdiff [23.8 kB] Get:121 http://ike.egr.msu.edu unstable/main i386 2012-05-01-2014.31.pdiff [23.8 kB] Get:122 http://ike.egr.msu.edu unstable/main 2012-05-02-0213.23.pdiff [1470 B] Get:123 http://ike.egr.msu.edu unstable/main 2012-05-02-0213.23.pdiff [1470 B] Get:124 http://ike.egr.msu.edu unstable/main i386 2012-05-02-0213.23.pdiff [25.9 kB] Get:125 http://ike.egr.msu.edu unstable/main i386 2012-05-02-0213.23.pdiff [25.9 kB] Get:126 http://ike.egr.msu.edu unstable/main 2012-05-02-0814.32.pdiff [763 B] Get:127 http://ike.egr.msu.edu unstable/main 2012-05-02-0814.32.pdiff [763 B] Get:128 http://ike.egr.msu.edu unstable/main i386 2012-05-02-0814.32.pdiff [16.1 kB] Get:129 http://ike.egr.msu.edu unstable/main i386 2012-05-02-0814.32.pdiff [16.1 kB] Get:130 http://ike.egr.msu.edu unstable/main 2012-05-02-1414.49.pdiff [132 B] Get:131 http://ike.egr.msu.edu unstable/main 2012-05-02-1414.49.pdiff [132 B] Get:132 http://ike.egr.msu.edu unstable/main i386 2012-05-02-1414.49.pdiff [24.6 kB] Get:133 http://ike.egr.msu.edu unstable/main i386 2012-05-02-1414.49.pdiff [24.6 kB] Get:134 http://ike.egr.msu.edu unstable/main 2012-05-02-2017.15.pdiff [807 B] Get:135 http://ike.egr.msu.edu unstable/main 2012-05-02-2017.15.pdiff [807 B] Get:136 http://ike.egr.msu.edu unstable/main i386 2012-05-02-2017.15.pdiff [34.3 kB] Get:137 http://ike.egr.msu.edu unstable/main i386 2012-05-02-2017.15.pdiff [34.3 kB] Get:138 http://ike.egr.msu.edu unstable/main 2012-05-03-0814.10.pdiff [130 B] Get:139 http://ike.egr.msu.edu unstable/main 2012-05-03-0814.10.pdiff [130 B] Get:140 http://ike.egr.msu.edu unstable/main i386 2012-05-03-0215.37.pdiff [12.4 kB] Get:141 http://ike.egr.msu.edu unstable/main i386 2012-05-03-0215.37.pdiff [12.4 kB] Get:142 http://ike.egr.msu.edu unstable/main 2012-05-03-1416.32.pdiff [117 B] Get:143 http://ike.egr.msu.edu unstable/main 2012-05-03-1416.32.pdiff [117 B] Get:144 http://ike.egr.msu.edu unstable/main i386 2012-05-03-0814.10.pdiff [13.4 kB] Get:145 http://ike.egr.msu.edu unstable/main i386 2012-05-03-0814.10.pdiff [13.4 kB] Get:146 http://ike.egr.msu.edu unstable/main 2012-05-03-2015.12.pdiff [867 B] Get:147 http://ike.egr.msu.edu unstable/main 2012-05-03-2015.12.pdiff [867 B] Get:148 http://ike.egr.msu.edu unstable/main i386 2012-05-03-1416.32.pdiff [7814 B] Get:149 http://ike.egr.msu.edu unstable/main i386 2012-05-03-1416.32.pdiff [7814 B] Get:150 http://ike.egr.msu.edu unstable/main i386 2012-05-03-2015.12.pdiff [22.5 kB] Get:151 http://ike.egr.msu.edu unstable/main i386 2012-05-03-2015.12.pdiff [22.5 kB] Fetched 934 kB in 8min 32s (1821 B/s) Reading package lists... + echo exit value was 0 exit value was 0 + date -u Fri May 4 01:44:33 UTC 2012
--- End Message ---
--- Begin Message ---
- To: 671440-done@bugs.debian.org
- Subject: Re: Bug#671440: pdiffs
- From: David Kalnischkies <david@kalnischkies.de>
- Date: Tue, 11 Feb 2014 22:22:30 +0100
- Message-id: <20140211212229.GB5697@crossbow>
- In-reply-to: <CAAZ6_fDKhGMWO0ouN2hogPozygoUqF6xYR+UzS5FL1CFk+kK9Q@mail.gmail.com>
- References: <20130614192243.GA2853@gnu.kitenet.net> <CAAZ6_fDKhGMWO0ouN2hogPozygoUqF6xYR+UzS5FL1CFk+kK9Q@mail.gmail.com>
Version: 0.9.14.3~exp1 On Sat, Jun 15, 2013 at 01:11:05AM +0200, David Kalnischkies wrote: > On Fri, Jun 14, 2013 at 9:22 PM, Joey Hess <joeyh@debian.org> wrote: > > But this is entirely outweighed by the times they have massively slowed > > down updates when I do have bandwidth available to burn. And if I have > > The time required /should/ get down if we can finally merge pdiffs before > applying them as the current process of applying pdiffs one after the other > (and doing a http roundtrip for each file rather than pipeline) is wasteful. > To support the current mode of operation (aka: being able to skip over > patches) we need changes to the format of the Index though. > > Its a frequent topic and my last info on this is that we get the changes to > the Index "really soon now" (okay, actually, it was "tommorrow", but that > is a few weeks ago now). After that either someone else will pick it up > quickly or I will hopefully come around to look at it as I tend to be on > connections which are payed by transferred data volume at times … So, this happen in December/January with the contribution of Anthony Towns, so that we now do client-merging by default in all releases which currently have pdiffs available (without changes to dak…). As client-merging of ~200 pdiffs tends to be faster than a complete download of the indexes even on the >10MB/s connection in my tests I am going to close this bug as "not an issue anymore". We can't do more in this regard as predicting how fast the connection, your cpu, your disk and if you pay by bit transfered is extremely hard for no real gain. Best regards David KalnischkiesAttachment: signature.asc
Description: Digital signature
--- End Message ---