Any chance to pg_dump UDD partially (Was: Any chance to reduce size of bugs.d.o mirror for UDD import)

[Andreas Tille <andreas@an3as.eu>]

Hi,

it seems a fully bugs.debian.org mirror is necessary to update the bug*
tables inside UDD.  Because this is not really applicable here in the
long run I wonder whether I could use pg_dump / pg_restore from original
UDD.

I thought about something like:


#!/bin/sh

GETFROMHOST=udd.debian.org
TABLES="bugs \
        bugs_blockedby \
        bugs_blocks \
        bugs_fixed_in \
        bugs_found_in \
        bugs_merged_with \
        bugs_packages \
        bugs_tags \
        bugs_usertags"

for tab in $TABLES ; do
   psql udd -c "DROP TABLE IF EXISTS ${tab};"
   ssh $GETFROMHOST "pg_dump --no-owner --format=custom --table ${tab} udd | bzip2" | \
     bunzip2 | \
     pg_restore --no-owner --format=custom --table ${tab} --dbname=udd
done



I have no idea whether this is advisable regarding performance of UDD
host.  In any case it does not work like this because a normal user
can not "psql udd" but rather needs to sudo into user udd.  I do not
really consider it a good idea to do this via

     psql service=udd

from alioth because having just another host on another continent
inbetween just for permission issues sounds crazy.  In short:  Do you
see a reasonable way for a pg_dump - pg_restore path from udd.debian.org
to an UDD clone.

Kind regards

         Andreas.

On Fri, May 11, 2012 at 11:22:41AM +0200, Andreas Tille wrote:
> Hi,
> 
> on blends.debian.net I'm running an UDD clone for testing new things
> before pushing it to official UDD.  I also try to run an importer for
> bugs which trusts on having a local mirror of the BTS data.  The
> partition where I kept this (65GB) is now full and I wonder whether
> there is some way to just rsync the part of data which is *essential*
> for the UDD importer.  I would really like to find a way to reduce
> network traffix and disk space on blends.debian.net.
> 
> Any idea?
> 
> Kind regards
> 
>       Andreas.
> 
> -- 
> http://fam-tille.de
> 
> 
> -- 
> To UNSUBSCRIBE, email to debian-qa-REQUEST@lists.debian.org
> with a subject of "unsubscribe". Trouble? Contact listmaster@lists.debian.org
> Archive: [🔎] 20120511092241.GA3759@an3as.eu">http://lists.debian.org/[🔎] 20120511092241.GA3759@an3as.eu
> 
> 

-- 
http://fam-tille.de