[Date Prev][Date Next] [Thread Prev][Thread Next] [Date Index] [Thread Index]

Re: Parallel GZIP --> speed instead of 2 CPUs running

On 12/22/08 10:49, Osamu Aoki wrote:

On Mon, Dec 22, 2008 at 05:13:17PM +0200, Eugene V. Lyubimkin wrote:

Thomas Preud'homme wrote:

The Monday 22 December 2008 13:53:43 Eugene V. Lyubimkin, you wrote :

...

I have a core 2 duo and time give me a usage of almost 200% with pbzip2

Anyone has better results ?

Yes, see following:

jackyf@work:~/temp$ time tar -cjf temp1.tar.bz2 debian

real	0m18.830s
user	0m18.317s
sys	0m0.268s
jackyf@work:~/temp$ time bash -c "tar -cf - debian | pbzip2 -c > temp2.tar.bz2"

real	0m10.494s
user	0m19.557s
sys	0m0.488s

10 is much less than 18.


Well.... bzip is slow anyway even with SMP.

The full story is here on my amd64 core2duo system:

Summary: (with -1 option for speed, real time for compression)

          Binary files            Text file
          time(s)  size           time(s)  size
cp 0.060 13166592 0.129 40323584 lzop 0.448 12727856 2.526 28777352 gzip 0.911 12689884 3.526 27281520 pbzip2 2.027 12804577 4.800 25928838 
  lzma    3.808    12772852       7.636    25926966
  bzip2   4.358    12804175       9.938    25919654
Compressing the 289MB linux-source-2.6.27.tar file on an AMD 64X2 running 32-bit userland (and 8GB RAM): 

$ time \
> for i in {1..3};
> do
>     bzip2 -q linux-source-2.6.27_0${i}.tar;
> done

real    5m21.145s
user    5m15.682s
sys     0m2.857s

Total: 10m40s

$ time \
> for i in {4..6};
> do
>     pbzip2 linux-source-2.6.27_0${i}.tar;
> done

real    2m56.583s
user    5m19.420s
sys     0m9.235s

Total: 8m15s

$ time \
> for i in {7..9};
> do
>     pbzip2 -r linux-source-2.6.27_0${i}.tar;
> done

real    2m51.188s
user    5m18.826s
sys     0m3.417s

Total: 8m13s.

--
Ron Johnson, Jr.
Jefferson LA  USA

I like my women like I like my coffee - purchased at above-market
rates from eco-friendly organic farming cooperatives in Latin America.
Reply to: