Re: file server

[debian-user@howorth.org.uk]

lina <lina.lastname@gmail.com> wrote:
> I need to extract the data for downstream analysis. after that, these
> data can be removed.

Do you need all the data present at the same time to extract it?
Obviously you won't need as much storage if you can analyse/extract it
in sections.

> On Wed, Jul 12, 2023 at 2:24 PM Jerome BENOIT
> <sphericaltriangle@rezozer.net> wrote:
> 
> > Hello,
> >
> > On 12/07/2023 13:48, lina wrote:  
> > > Currently I do not have a plan to keep the data, once the data
> > > finished  
> > analyzing, I can just remove it.
> >
> > Do you want a `scratch space` [1] ?
> > What can be also interesting to know is whether you can compress
> > your data.
> >
> > Best wishes,
> > Jerome
> >
> > [1] https://en.wikipedia.org/wiki/Scratch_space
> >  
> > >
> > > On Wed, Jul 12, 2023 at 12:26 PM Dan Ritter
> > > <dsr@randomstring.org  
> > <mailto:dsr@randomstring.org>> wrote:  
> > >
> > >     lina wrote:  
> > >      > Dear all,
> > >      >
> > >      > My computer only has 2 TB data storage capacity,
> > >      >
> > >      > I want to have 100 TB capacity to store/analyze data.
> > >      >
> > >      > I am thinking of adding 5 hard drives, each is 18TB, and
> > >      > then  
> > merge them  
> > >      > into one volume?
> > >      > or get a file server?
> > >      > What is the best option for me, and what is the budget?  
> > >
> > >     Two questions:
> > >
> > >     - do you have a backup plan in mind, or will you accept the
> > > loss of all data?
> > >
> > >     - how fast does new data come in, and how long do you need to
> > >        keep it around?
> > >
> > >     -dsr-
> > >  
> >