Bug#960304: snapshot.debian.org: Snapshot repo repeatedly cutting off connection, returning partial content
On Thu, Aug 05, 2021 at 12:36:02PM +0200, Johannes Schauer Marin Rodrigues wrote:
> On Wed, 4 Aug 2021 10:55:09 +0200 Julien Cristau <jcristau@debian.org> wrote:
> > I just had a look at this again. It seems the issue comes from our
> > varnish setup, as things are fine when hitting apache directly. But the
> > combination of streaming and a mix of small and large files in varnish's
> > cache leads to things like the below, where varnish gives up after
> > hitting nuke_limit (50) files to make space in the cache.
>
> thanks a lot for looking into this!
>
> Maybe some problems are gone now, but when I drop the measures in my code that
> implemented the heavy throttling that was necessary in the past, I now run into
> the same problems like before. So as far as my use of snapshot.d.o goes, it
> doesn't seem as if anything has changed.
>
> Can you confirm that I still need to limit my download speed to a certain
> number of bytes per second or limit the number of files I download per hour
> below a certain threshold?
>
We cap new connections, but there's no limit on download speed as far as
I know.
Cheers,
Julien
Reply to: