Re: Parallel GZIP
Hi,
On Mon, Dec 22, 2008 at 02:48:41PM +0200, Volkan YAZICI wrote:
> On Mon, 22 Dec 2008, Tzafrir Cohen <tzafrir@cohens.org.il> writes:
> > Could you please giva a usage scenario?
>
> Compressing a database backup file of size 300GB.
>
> > Is the task really CPU bound and not i/o bound?
>
> "top -d 1" tells me that CPU usage is 800%. (BTW, have you ever met with
> an input file that is not CPU bound, but I/O bound -- discarding
> specifically generated worst-case scenario inputs.)
gzip, bzip2, and lzma seem quite CPU intensive as I saw too.
For my local archiving of not-so-big ata, I just tar/cpio them w/o
compression. Lazy me.
You may wish to try lzop which is optimized for speed.
Here are notable Debian compression tools.
http://people.debian.org/~osamu/pub/getwiki/html/ch11.en.html#archiveandcompressiontools
Osamu
Reply to: