Re: can pbzip2 run on stdout?
On Thu, Sep 27, 2007 at 02:57:40PM -0400, Stefhen Hovland wrote:
> Is this possible for pbzip2 to run on a tar which outputs to standard out?
>
> I am trying to speed up a backup process which takes hours, i have
> about 100g of uncompressed data which will be tar'd up and is
> currently running thru gzip. This will be running on a 16 cpu box
> which would greatly speedup this issue.
>
> from:
>
> tar cf - . | gzip > /tmp/file.tar.gz
>
> to:
>
> tar cf - . | pbzip2 > /tmp/file.tar.bz2
>
>
> This doesnt seem to work, is it because there is no way to split the
> stdio to multiple processors on the fly?
I wonder if it would help to create a named-pipe (fifo). Would that
trick the compressor (whichever) to treat it as a file (that doesn't
have an EOF until the true end) and run on a different processor?
Never having had more than one core, I can't test this.
Doug.
Reply to: