[Date Prev][Date Next] [Thread Prev][Thread Next] [Date Index] [Thread Index]

Re: S3-backed snapshot implementation on AWS?



On Fri, Sep 22, 2023 at 05:12:21PM +0200, Bastian Blank wrote:
> > Could we use the Debian AWS account to host that service?
> 
> I would assume that a service like snapshot would be within the scope
> for our AWS usage.  Noah?

It makes sense and I will look into it.  Let's not start anything until
we hear definitive confirmation.  Do we have a sense of how much
outgoing traffic the current snapshot service generates?

> >                                                           It would
> > require one fairly powerful VM, and a large S3 bucket (approximately
> > 150-200 TB).
> 
> 200 TB should be no problem.

Agreed.

> However we need to talk about that "one […] VM", because this sounds
> like you intend to use AWS as VM hosting, which it is not.
> 
> Please think about this in form of services and there should be at least
> two:
> - the injestor, which can only exist once and writes, and
> - the web frontend, which should be able to exist several times and only
>   reads.
> 
> So you want to plan with running the multiple web frontends with load
> balancers and maybe even cloudfront.

I agree that it would be best to design something more cloud-oriented.
However, if there's an existing infrastructure that can be moved as a
"lift & shift" into AWS now, with architectural refactoring happening
later, that's an OK place to start.

noah


Reply to: