Bug#966649: Request for feedback on upload_history re-implementation

[Lucas Nussbaum <lucas@debian.org>]

Hi Asheesh,

On 19/08/20 at 23:03 -0700, Asheesh Laroia wrote:
> Hi Andreas & Lucas & all,
> 
> Lucas -- I'm making progress on re-implementing this. I'd love your input
> by email or IRC about my approach, but if you're busy, feel free to ignore
> this and I'll mention you again when I submit a patch.
>
I haven't looked in detail at your code, but three quick
comments/questions based on the discussion:

I think that the changes compared to the current table structure should
be minimized, to avoid rewrite all tools that use this data.
Improvements are welcomed of course, but please don't make changes if
there's no good reason for them.

Did you confirm with DSA that parsing the online list archives is the
preferred way to go? I fear that we will hit some HTTP rate limiting at
some point and will have to reconsider the implementation.

How optimized is your code for running every few minutes? Ideally we
would like near-real-time updates of this data, we will require polling
the list archives (previously, email was received directly on
ullmann.debian.org via a special email address)

Lucas