I wonder if it would be feasible/better just to somehow share replica of the DB so then queries could be either done directly against DB or against local dedicated instance/API? Cheers, On Tue, 11 Mar 2025, Richard Reinick wrote: > Hi, > This is my first time using a Debian mailing list, so i am not sure if > someone can help me with my request. > I am currently involved in a research project (Bachelor of Science in IT at > University of Applied Science in Merseburg) that requires access to > historical package data. I would like to inquire about the possibility of > extracting specific data in large quantities from the Debian Snapshot > Archive for my research purposes. I noticed that there is a Robots Exclusion > Protocol in the Debian Snapshot Archive, therefore I want to ask for > permission to bypass the Protocol. > I understand the importance of minimizing the load on the servers. > Therefore, I plan to implement rate-limiting measures, incorporate > randomized delays, minimizing unnecessary download requests, and adhere to > any additional guidelines that may be in place to ensure a gentle access > pattern. > Could someone please advise if there is a formal process or any specific > requirements I should follow to obtain permission for this activity? > Additionally, if there are any recommendations or restrictions regarding the > extraction of data from the archive, I would greatly appreciate any > guidance. > Thank you very much for your time and assistance. I look forward to your > response. -- Yaroslav O. Halchenko Center for Open Neuroscience http://centerforopenneuroscience.org Dartmouth College, 419 Moore Hall, Hinman Box 6207, Hanover, NH 03755 WWW: http://www.linkedin.com/in/yarik
Attachment:
signature.asc
Description: PGP signature