[Date Prev][Date Next] [Thread Prev][Thread Next] [Date Index] [Thread Index]

Re: Parallel GZIP



The Monday 22 December 2008 16:47:26 Eugene V. Lyubimkin, you wrote :
> Thomas Preud'homme wrote:
> > The Monday 22 December 2008 16:13:17 Eugene V. Lyubimkin, you wrote :
> >> Thomas Preud'homme wrote:
> >>> The Monday 22 December 2008 13:53:43 Eugene V. Lyubimkin, you wrote :
> >>>> Volkan YAZICI wrote:
> >>>>> Hi,
> >>>>>
> >>>>> Are there any compression tools in the official Debian GNU/Linux
> >>>>> repositories that can take the benefit of multiple cores/cpus?
> >>>>
> >>>> pbzip2?
> >>>
> >>> I profit of this thread to ask you if you see amelioration with pbzip2.
> >>> I made 2 tests on file of 50 MB and the result if approximately the
> >>> same time as bzip2 (a little much longer with pbzip2 !!!) but a CPU
> >>> twice time more used. I have a core 2 duo and time give me a usage of
> >>> almost 200% with pbzip2
> >>>
> >>> Anyone has better results ?
> >>
> >> Yes, see following:
> >>
> >> jackyf@work:~/temp$ time tar -cjf temp1.tar.bz2 debian
> >>
> >> real	0m18.830s
> >> user	0m18.317s
> >> sys	0m0.268s
> >> jackyf@work:~/temp$ time bash -c "tar -cf - debian | pbzip2 -c >
> >> temp2.tar.bz2"
> >>
> >> real	0m10.494s
> >> user	0m19.557s
> >> sys	0m0.488s
> >>
> >> 10 is much less than 18.
> >
> > Ok so sometime it works well. It would be great to know when it'll be
> > quicker and when it will not. What kind of files are in your debian
> > directory ?
>
> There are some text files and some gzipped archives in it. I can try
> another example if you want.

No, don't. I'm just wondering why. Actually I did a test in the same order 
(bzip2 and the pbzip2) on a tar of my picture directory and on a video. I 
just don't understand why my 2 runs aren't much quicker with pbzip2.

Regards,

Thomas Preud'homme

-- 
Why debian : http://www.debian.org/intro/why_debian

Attachment: signature.asc
Description: This is a digitally signed message part.


Reply to: