Re: interface for tar
On Tue, Aug 19, 2008 at 5:40 PM, Mag Gam <magawake@gmail.com> wrote:
> At my university we run fluid dynamic simulations. These simulations
> create many small files (30,000) per hour. Their size is very small
> (20k to 200k). Instead of having this on the filesystem since it take
My approach:
make a sufficiently-sized file using dd if=/dev/zero of=/bigfile bs=1m
count=1000
size so that you have enough room, and room for growth, of course
Make a filesystem inside of that file (reiserfs might be a good choice
since it is well-designed to handle lots of smallish files, although
"small" by that definition may be much smaller than 200k)
Mount that file in loopback mode prior to running your simulations,
and (after moving the files over to the new filesystem) direct all
filesystem traffic to use that 'filesystem' which may entail only
something simple as cd'ing into the 'filesystem' and starting work.
Reply to: