[Date Prev][Date Next] [Thread Prev][Thread Next] [Date Index] [Thread Index]

Bug#960304: snapshot.debian.org: Snapshot repo repeatedly cutting off connection, returning partial content



Package: snapshot.debian.org
Severity: important

Dear Maintainer,

We've got multiple error reports when downloading a large .deb package (e.g., https://snapshot.debian.org/archive/debian-security/20200424T130133Z/pool/updates/main/o/openjdk-11/openjdk-11-jdk-headless_11.0.7%2B10-3~deb10u1_amd64.deb). The server repeatedly cuts the connection after returning an arbitrary amount of bytes. (More detailed information is in https://github.com/GoogleContainerTools/distroless/issues/509)

$ curl -o a.deb https://snapshot.debian.org/archive/debian-security/20200424T130133Z/pool/updates/main/o/openjdk-11/openjdk-11-jdk-headless_11.0.7%2B10-3~deb10u1_amd64.deb
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
 37  205M   37 77.8M    0     0  6964k      0  0:00:30  0:00:11  0:00:19 6313k
curl: (18) transfer closed with 133739032 bytes remaining to read

The workaround is for an HTTP client to repeatedly make Range requests, as "wget" does below. This seems unreasonably demanding.

$ wget https://snapshot.debian.org/archive/debian-security/20200424T130133Z/pool/updates/main/o/openjdk-11/openjdk-11-jdk-headless_11.0.7%2B10-3~deb10u1_amd64.deb
--2020-05-11 11:19:11--  https://snapshot.debian.org/archive/debian-security/20200424T130133Z/pool/updates/main/o/openjdk-11/openjdk-11-jdk-headless_11.0.7%2B10-3~deb10u1_amd64.deb
Resolving snapshot.debian.org (snapshot.debian.org)... 2001:630:206:4000:1a1a:0:c13e:ca1b, 2001:1af8:4020:b030:deb::185, 193.62.202.27, ...
Connecting to snapshot.debian.org (snapshot.debian.org)|2001:630:206:4000:1a1a:0:c13e:ca1b|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 215331352 (205M)
Saving to: ‘openjdk-11-jdk-headless_11.0.7+10-3~deb10u1_amd64.deb’

openjdk-11-jdk-headless_11.0.7+10-3~deb10u1_amd6  33%[=================================>                                                                      ]  68.45M  29.6MB/s    in 2.3s    

2020-05-11 11:19:14 (29.6 MB/s) - Connection closed at byte 71770112. Retrying.

--2020-05-11 11:19:15--  (try: 2)  https://snapshot.debian.org/archive/debian-security/20200424T130133Z/pool/updates/main/o/openjdk-11/openjdk-11-jdk-headless_11.0.7%2B10-3~deb10u1_amd64.deb
Connecting to snapshot.debian.org (snapshot.debian.org)|2001:630:206:4000:1a1a:0:c13e:ca1b|:443... connected.
HTTP request sent, awaiting response... 206 Partial Content
Length: 215331352 (205M), 143561240 (137M) remaining
Saving to: ‘openjdk-11-jdk-headless_11.0.7+10-3~deb10u1_amd64.deb’

openjdk-11-jdk-headless_11.0.7+10-3~deb10u1_amd6  53%[++++++++++++++++++++++++++++++++++====================>                                                 ] 109.32M  26.6MB/s    in 1.5s    

2020-05-11 11:19:17 (26.6 MB/s) - Connection closed at byte 114630656. Retrying.

--2020-05-11 11:19:19--  (try: 3)  https://snapshot.debian.org/archive/debian-security/20200424T130133Z/pool/updates/main/o/openjdk-11/openjdk-11-jdk-headless_11.0.7%2B10-3~deb10u1_amd64.deb
Connecting to snapshot.debian.org (snapshot.debian.org)|2001:630:206:4000:1a1a:0:c13e:ca1b|:443... connected.
HTTP request sent, awaiting response... 206 Partial Content
Length: 215331352 (205M), 100700696 (96M) remaining
Saving to: ‘openjdk-11-jdk-headless_11.0.7+10-3~deb10u1_amd64.deb’

openjdk-11-jdk-headless_11.0.7+10-3~deb10u1_amd6  69%[+++++++++++++++++++++++++++++++++++++++++++++++++++++++================>                                ] 142.20M  23.8MB/s    in 1.4s    

2020-05-11 11:19:20 (23.8 MB/s) - Connection closed at byte 149106688. Retrying.

--2020-05-11 11:19:23--  (try: 4)  https://snapshot.debian.org/archive/debian-security/20200424T130133Z/pool/updates/main/o/openjdk-11/openjdk-11-jdk-headless_11.0.7%2B10-3~deb10u1_amd64.deb
Connecting to snapshot.debian.org (snapshot.debian.org)|2001:630:206:4000:1a1a:0:c13e:ca1b|:443... connected.
HTTP request sent, awaiting response... 206 Partial Content
Length: 215331352 (205M), 66224664 (63M) remaining
Saving to: ‘openjdk-11-jdk-headless_11.0.7+10-3~deb10u1_amd64.deb’

openjdk-11-jdk-headless_11.0.7+10-3~deb10u1_amd6 100%[++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++===============================>] 205.36M  29.5MB/s    in 2.1s    

2020-05-11 11:19:26 (29.5 MB/s) - ‘openjdk-11-jdk-headless_11.0.7+10-3~deb10u1_amd64.deb’ saved [215331352/215331352]

-- System Information:
Debian Release: 10.3
  APT prefers stable-updates
  APT policy: (500, 'stable-updates'), (500, 'stable')
Architecture: amd64 (x86_64)

Kernel: Linux 5.2.17-1rodete3-amd64 (SMP w/6 CPU cores)
Kernel taint flags: TAINT_PROPRIETARY_MODULE, TAINT_USER, TAINT_OOT_MODULE
Locale: LANG=C, LC_CTYPE=C.UTF-8 (charmap=UTF-8), LANGUAGE=C (charmap=UTF-8)
Shell: /bin/sh linked to /bin/dash
Init: unable to detect

Reply to: