[Date Prev][Date Next] [Thread Prev][Thread Next] [Date Index] [Thread Index]

Bug#960304: snapshot.debian.org: Snapshot repo repeatedly cutting off connection, returning partial content



References:

Hi Julien,

On Wed, 4 Aug 2021 10:55:09 +0200 Julien Cristau <jcristau@debian.org> wrote:
> I just had a look at this again.  It seems the issue comes from our
> varnish setup, as things are fine when hitting apache directly.  But the
> combination of streaming and a mix of small and large files in varnish's
> cache leads to things like the below, where varnish gives up after
> hitting nuke_limit (50) files to make space in the cache.

thanks a lot for looking into this!

Maybe some problems are gone now, but when I drop the measures in my code that
implemented the heavy throttling that was necessary in the past, I now run into
the same problems like before. So as far as my use of snapshot.d.o goes, it
doesn't seem as if anything has changed.

Can you confirm that I still need to limit my download speed to a certain
number of bytes per second or limit the number of files I download per hour
below a certain threshold?

Thanks!

cheers, josch

Attachment: signature.asc
Description: signature


Reply to: