[Date Prev][Date Next] [Thread Prev][Thread Next] [Date Index] [Thread Index]

Re: Parallel GZIP



Thomas Preud'homme wrote:
> The Monday 22 December 2008 16:13:17 Eugene V. Lyubimkin, you wrote :
>> Thomas Preud'homme wrote:
>>> The Monday 22 December 2008 13:53:43 Eugene V. Lyubimkin, you wrote :
>>>> Volkan YAZICI wrote:
>>>>> Hi,
>>>>>
>>>>> Are there any compression tools in the official Debian GNU/Linux
>>>>> repositories that can take the benefit of multiple cores/cpus?
>>>> pbzip2?
>>> I profit of this thread to ask you if you see amelioration with pbzip2. I
>>> made 2 tests on file of 50 MB and the result if approximately the same
>>> time as bzip2 (a little much longer with pbzip2 !!!) but a CPU twice time
>>> more used. I have a core 2 duo and time give me a usage of almost 200%
>>> with pbzip2
>>>
>>> Anyone has better results ?
>> Yes, see following:
>>
>> jackyf@work:~/temp$ time tar -cjf temp1.tar.bz2 debian
>>
>> real	0m18.830s
>> user	0m18.317s
>> sys	0m0.268s
>> jackyf@work:~/temp$ time bash -c "tar -cf - debian | pbzip2 -c >
>> temp2.tar.bz2"
>>
>> real	0m10.494s
>> user	0m19.557s
>> sys	0m0.488s
>>
>> 10 is much less than 18.
> 
> 
> Ok so sometime it works well. It would be great to know when it'll be quicker 
> and when it will not. What kind of files are in your debian directory ?
There are some text files and some gzipped archives in it. I can try another
example if you want.

-- 
Eugene V. Lyubimkin aka JackYF, JID: jackyf.devel(maildog)gmail.com
Ukrainian C++ Developer, Debian Maintainer, APT contributor

Attachment: signature.asc
Description: OpenPGP digital signature


Reply to: