[Date Prev][Date Next] [Thread Prev][Thread Next] [Date Index] [Thread Index]

Bug#911028: marked as done (UDD: support for rsyncable udd.dump backup in pg_dump -Fd format)

Your message dated Sun, 21 Jul 2019 13:01:42 +0000
with message-id <45s4d32pJNzlfhwW@a.mx.nexnode.net>
and subject line Closing Bug#911028 as wontfix
has caused the Debian Bug report #911028,
regarding UDD: support for rsyncable udd.dump backup in pg_dump -Fd format
to be marked as done.

This means that you claim that the problem has been dealt with.
If this is not the case it is now your responsibility to reopen the
Bug report if necessary, and/or fix the problem forthwith.

(NB: If you are a system administrator and have no idea what this
message is talking about, this may indicate a serious mail system
misconfiguration somewhere. Please contact owner@bugs.debian.org
immediately.)


-- 
911028: https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=911028
Debian Bug Tracking System
Contact owner@bugs.debian.org with problems
--- Begin Message --- 
Package: qa.debian.org
Severity: wishlist
User: qa.debian.org@packages.debian.org
Usertags: udd


Dear UDD heroes,

the publicly available udd.dump [1] is 1.5 GB and I'd like to ask for
the possibility to turn it from a PGDMP in `pg_dump -Fc` format
to a dir'ed `pg_dump -Fd` which might, with the many tables within udd,
provide a measure of bandwidth-savings for mirrors of the database when
the periodic dumps don't update some of the tables and can therefore
be skipped in a mirror run. (Potentially could save time on dumps and
restores as well, as -Fd can dump and restore tables in parallel.)

Further saving (and ease of mirror use) could possibly be achieved by
providing an rsync module of the dump directory [1], if the possibility
exists of setting that up on ullmann.d.o.

Reasoning:

Since the database is constantly changing and may require a mirror to
update often, grabbing a new 1.5GB file perhaps multiple times daily
can be daunting to some lower-bandwidth connections (while some tables
actually get updates only daily or less).


After a chat with mapreri I don't have high hopes wrt the rsync module,
but I was encouraged to just put it out there anyway.

< mapreri> nyov: of course, if you wish a -Fd dump, it should be provided alongside the current -Fc one, not instead.

And that is probably the final nail in the coffin - having two having both
is really a necessity.


As an alternative option -- perhaps udd.dump could be dumped without
pg_dump internal compression (-Z0) and instead piped through lzma/xz [2],
as the popcon dump already does?


[1] https://udd.debian.org/dumps/
[2] https://salsa.debian.org/qa/udd/blob/master/scripts/dump-db-more-frequently
    https://salsa.debian.org/qa/udd/blob/master/scripts/dump-db.sh


Cheers

--- End Message ---
--- Begin Message --- 
Clean-up

--- End Message ---
Reply to: