[Date Prev][Date Next] [Thread Prev][Thread Next] [Date Index] [Thread Index]

Re: interface for tar

On Tue, Aug 19, 2008 at 5:40 PM, Mag Gam <magawake@gmail.com> wrote:
> At my university we run fluid dynamic simulations. These simulations
> create many small files (30,000) per hour. Their size is very small
> (20k to 200k). Instead of having this on the filesystem since it take

My approach:

make a sufficiently-sized file using dd if=/dev/zero of=/bigfile bs=1m

size so that you have enough room, and room for growth, of course

Make a filesystem inside of that file (reiserfs might be a good choice
since it is well-designed to handle lots of smallish files, although
"small" by that definition may be much smaller than 200k)

Mount that file in loopback mode prior to running your simulations,
and (after moving the files over to the new filesystem) direct all
filesystem traffic to use that 'filesystem' which may entail only
something simple as cd'ing into the 'filesystem' and starting work.

Reply to: