Re: missing files from different formats of the .iso files
hi,
On Sun, 18 Jun 2023 at 18:24, Thomas Schmitt <scdbackup@gmx.net> wrote:
>
> Hi,
>
> griffin tucker wrote:
> > there's a bug in jigdo that makes it occasionally skip files
>
> In that case the missing files woule be present but filled with zeros
> when you mount the incompletely composed ISO.
> Can you confirm ?
>
sorry, i must've misexplained; the .iso's are made from the same
version, but a different format, (eg. between DVD, BD, and DLBD)
jigdo-lite runs in batch mode, and usually the reconstruction of the
first .iso is completely reconstructed from a directory of mounted
.iso's from another format, however, the next few .iso's will
consistently have 1 file missing that it couldn't find from the
mounted .iso's, when it should, and i am unable to determine the
pattern or reason for this
jigdo-lite will write everything except that missing file which is
written with 0's, then request an online source, which it does
successfully, then it fills in the 0's and verifies the md5 also
successfully
there is no corruption to the reconstructed .iso's.
>
> Not picking a file of a jigdo image may have various reasons.
> Temporary download problems should become visible by error messages.
> Consider to catch the output of jigdo-lite in a file for inspection.
>
> Persistent problems could be (possibly among others):
>
> - File is missing on the chosen Debian mirror.
>
> In this case it is supposed to be fetched from fallback servers which
> are mentioned at the end of the .jigdo file:
>
> $ gunzip <debian-11.6.0-source-DVD-1.jigdo | tail -5
> T__clXB4rmLIbFvoblKNqA=Debian:pool/main/b/bin-prot/bin-prot_0.14.0-1.debian.tar.xz
>
> [Servers]
> Debian=http://us.cdimage.debian.org/cdimage/snapshot/Debian/
> Debian=http://snapshot.debian.org/archive/debian/20221218T124218Z/ --try-last
>
> Assuming that bin-prot_0.14.0-1.debian.tar.xz would be missing, you
> could check by a web browser whether
> http://us.cdimage.debian.org/cdimage/snapshot/Debian/pool/main/b/bin-prot/bin-prot_0.14.0-1.debian.tar.xz
> exists.
>
>
> - The checksum of the file in .jidgo does not match the checksum of the
> file on the mirror server.
>
> The checksum is listed in .jigdo before the '=', encoded in a variant of
> base64.
> For decoding append enough "=" to get a number of characters which is
> divisible by 4, replace "-" and "_" by their base64 equivalents, decode
> base64, format to hex, and remove od's decorations:
>
> $ echo 'T__clXB4rmLIbFvoblKNqA'== | sed -e 's/-/+/g' -e 's/_/\//g' | base64 -d | od -t x1 | sed -e 's/^.......//' -e 's/ //g'
> 4fffdc957078ae62c86c5be86e528da8
>
> In this case the checksum is MD5. Expect to see SHA256 in newer .jigdo.
>
i look forward to the sha256 or sha512 implementation
>
> > from the source
> > and then it will request the online source. i'm not sure why.
>
> What is the difference between "the source" and "the online source" ?
> I'd normally expect that all jigdo sources of files are online.
> Do you have your own local Debian mirror or a set of older ISOs ?
>
no local mirror, just a set of the same version of debian in a
different format, as explained above
i tried with v12.0.0 source this time, and got similar results
i'm running it in a virtual machine, if that makes a difference
(afaik, it shouldn't)
>
> Have a nice day :)
>
likewise
> Thomas
>
Reply to: