Re: Debian packages containing large files
Hi Basile,
Thanks for answering me. Yes this package contains mysql data
files that are a subset from a very large live database that we would
like to duplicate frequently across several other machines.
Unfortunately because the mysqldump contains ~30 million statements it
takes a very large time to fill so we're using the debian package
approach. Would it help, if we somehow cut up table1.idb into smaller
files and reconstruct it during post install?
Cheers,
Sammy
On Wed, Oct 15, 2008 at 10:07 AM, Basile STARYNKEVITCH
<basile@starynkevitch.net> wrote:
> Sammy Yu wrote:
>>
>> Hi,
>> I've created a debian package which has a large file that is
>> slightly over 2 gigs of ram in size. When I try to install it on a
>> system with 16 GB of RAM via dpkg -i. It gives me
>>
>> Unpacking replacement data-instance0 ...
>> dpkg: error processing data-instance0-1.0-20081014.deb (--install):
>> failed to allocate buffer in buffer_copy (backend dpkg-deb during
>> `./var/lib/mysql/extdbfiles/0/archetype/table1.ibd'): Cannot allocate
>> memory
>>
>
>
> You apparently are puting a MySQL data file into a deb package.
>
> My advice would be not to avoid doing that (MySQL data files are brittle,
> and you cannot install them while a MySQL server is running.). Instead, put
> into your package a compressed mysqldump image, and have some post-install
> script load it appropriately.
>
> Maybe that would make your file smaller.
>
> In addition, a 2GB data file is huge; you might have a >100Mb *.deb file
> which is not reasonable. Remember that some people are still using analog
> modems to install debian packages!
>
> Why is your package so particular to need such a big data file? Did you
> consider alternatives (e.g. having the install script download it with
> wget?).
>
> But I am neither a Debian nor a MySQL expert.
>
> --
> Basile STARYNKEVITCH http://starynkevitch.net/Basile/
> email: basile<at>starynkevitch<dot>net mobile: +33 6 8501 2359
> 8, rue de la Faiencerie, 92340 Bourg La Reine, France
> *** opinions {are only mines, sont seulement les miennes} ***
>
Reply to: