[Date Prev][Date Next] [Thread Prev][Thread Next] [Date Index] [Thread Index]

Re: interface for tar



On 08/20/08 05:50, Mag Gam wrote:
David:

Do you have some sort of script to manage this? I am a little hesitate
to give professors mkfs and mount  sudo access. Is there a way around
this?

In that case, go back to Owen Townend's suggestion.

On Wed, Aug 20, 2008 at 12:13 AM, Mag Gam <magawake@gmail.com> wrote:
WOW!

Very nice ideas.

I like the dd idea. What command would I use for that? Also, the files
are coming from NFS; how can I help this?  Any ideas for this?



On Tue, Aug 19, 2008 at 10:24 PM, David Fox <dfox94085@gmail.com> wrote:
On Tue, Aug 19, 2008 at 5:40 PM, Mag Gam <magawake@gmail.com> wrote:
At my university we run fluid dynamic simulations. These simulations
create many small files (30,000) per hour. Their size is very small
(20k to 200k). Instead of having this on the filesystem since it take
My approach:

make a sufficiently-sized file using dd if=/dev/zero of=/bigfile bs=1m
count=1000

size so that you have enough room, and room for growth, of course

Make a filesystem inside of that file (reiserfs might be a good choice
since it is well-designed to handle lots of smallish files, although
"small" by that definition may be much smaller than 200k)

Mount that file in loopback mode prior to running your simulations,
and (after moving the files over to the new filesystem) direct all
filesystem traffic to use that 'filesystem' which may entail only
something simple as cd'ing into the 'filesystem' and starting work.

--
Ron Johnson, Jr.
Jefferson LA  USA

"Do not bite at the bait of pleasure till you know there is no
hook beneath it."  -- Thomas Jefferson


Reply to: