[Date Prev][Date Next] [Thread Prev][Thread Next] [Date Index] [Thread Index]

Advice on hardware server to use for small a dedicated data center




Hello,

Thank you for all your answers and sorry to be late for answering.
 
> I prefer ZFS but I find that lots of corps prefer mdadm. I really think that's simply > because ZFS came from Sun and they lack Solaris backgrounds. Now, in a low-> RAM environment with simpler disc needs, I would probably go with mdadm. 
> Anything else I would choose ZFS. It's ability to take care of itself is surprisingly > strong. Less work for me after the set up and installation.

ZFS beeing a filesystem and mdadm an utility software, I think I'll go for mdadm. I didn't know that Debian was supporting ZFS I always used Ext4.


Well, this might be heresy, but at that size, consider a Raspberry Pi running Raspian
I use a 3+ because I want to give the 4 a couple years to get its hardware and software debugged.

I already have some raspberry pi running at home and even if I found they can do very many things, they don't match what I want now.  I'm currently using the 4b model with 1Gb of RAM which seemed to have enough power for doing much more things but it's not yet able to boot from an external hard drive, but I tried hacking this with fstab and it worked sometimes and not on the next boot, so I just stopped trying to figure out what happened. I dislike the idea that if I encrypt my hard drive anybody with enough knowledge can just take the SD card and break my encryption. 


  I think Debian is a very good choice for a small enterprise server.
> ...
I have been burned more than once with hardware RAID solutions.

Sorry if I'm misunderstanding, are you saying that Debian  cannot scale in a bigger enterprise ?
Can you tell me what happened with hardware RAID solutions?

small" could be anything from 10 to 1000 users. Mentioning some numbers
> could get you more useful recommendations.
> In any case, some interesting hardware not mentioned so far (don't
> forget about the power consumption).

Small here is for me about 2000 users all are restaurants that save their selling history locally on their own server then 2 or 3 times in the morning they will rsync their postgres data on my data center.
About the power consumption, any advice about some low power hardware are also welcome.


Supermicro 1U servers - run two or more of them
> and it's easy to turn them into a high-available cluster
>  ...
Note:  I'm seriously considering migrating from Debian for our
> next refresh - I really don't like systemd - might go all the way to BSD
>or an OpenSolaris distro.

Supermicro seems definitely to propose some great stuff I will take them in account. Why do you dislike systemd ? I heard many people saying the same thing and I don't really understand what are their motivation except initd is less invasive.


>> First of all, please don't ask me why I simply don't want to use aws or gcp.
Even if you do not use their services, you might find it useful to
> emulate them and implement a private cloud.

Very interesting, can you tell me more about that emulation process please ?

> Please specify the architecture of your services, your current
> development/ test/ staging/ production infrastructure and facilities,
> your current workload for each service, your current quality of service
> for each service, and all other relevant details.
> Please describe your goals for the new data center in terms of the above.

I don't really know how to answer to your question but let's try.  We are a startup and for the moment we have a production and a development, in fact the production is just like a test environment because we do continuous delivery, we push everyday in order to know more quickly  when something has been broken and our semi-automated tests didn't detect it. Personally, I'm a self learner, and probably many guys of my team are too. So some advices here are also welcome.
We want to be able to handle 2500+ rsync in the morning (probably distributing them in time in order to avoid a single big load acting as a ddos) and for each client of my clients (restaurants) a get and put profile request. 
Note: client's profile are shared across restaurants and clients can find/filter restaurants on the website which is not yet built but we are working on it.


> There have been 16 responses to your post in the past 36+ hours.  You
> should reply to at least some of them.

Sorry, I agree this is a bad practice, I just realized that it's even more annoying at the moment to write the answer.

Thank you again.



Le dim. 28 juin 2020 à 09:16, David Christensen <dpchrist@holgerdanske.com> a écrit :
On 2020-06-26 11:34, echo test wrote:
> Hello,

Hello. :-)


> First of all, please don't ask me why I simply don't want to use aws or gcp.

Even if you do not use their services, you might find it useful to
emulate them and implement a private cloud.


> Then, I want to build a small data center for my company for hosting a web
> app and a mail server. It's the first time I'm going to buy some hardware
> for this.

Please specify the architecture of your services, your current
development/ test/ staging/ production infrastructure and facilities,
your current workload for each service, your current quality of service
for each service, and all other relevant details.


Please describe your goals for the new data center in terms of the above.


Please specify your budget and schedule.


> I tried looking for it on the web in order to compare them but it
> seems that hardware vendors never want to talk about Debian on their
> websites.

I suspect they see no financial benefit in doing so.


> Seriously, I prefer using my money for donating to the Debian foundation
> than having to pay for Ubuntu or Red Hat Enterprise because I love Debian
> and ...

Business owners are usually interested in spending their money on things
that provide a positive "return on investment".


> So, I want to know if It's a good idea to try using Debian in an enterprise
> context,

Please define "enterprise context".  (I would define it as thousands of
employees and even more web hits and e-mail messages per day)


I view Debian as the dominant enthusiast Linux distribution in the USA.
I use it on my SOHO laptops and desktops because it mostly works on most
x86/x86_64 computers made in the last ~20 years.  (But, it is common for
the "stable" version not to work on recently designed hardware.)  I also
have a Ubiquitti Networks Unifi Controller application stack running on
a Debian VPS on the Internet ($5/month).  I am the only user and it has
never failed.  Other people with far more knowledge, skills, and
ambition do more with Debian, but the effort appears to be both heroic
and lonely.  I have yet to hear of an "enterprise" environment built on
Debian, but you can tell us about yours when you build it. (URL's for
examples of such are welcome.)


I view FreeBSD as the dominant free x86/x86_64 BSD/Unix server
distribution.  I use it on my SOHO servers because the design is
traditional, the feel is polished, software packages are recent, and
there are good books available [1, 2].  FreeBSD has notable enterprise
deployments and commercial derivatives [3].


I view Ubuntu as the dominant commercial Debian derivative company, Red
Hat as the dominant USA commercial Linux company, SUSE as the dominant
German commercial Linux company, and Oracle as the dominant commercial
Unix company.  If I ran an enterprise data center on Unix or Unix-like
computers, I would find the following characteristics of these
commercial offerings to be very appealing:

1.  Configuration management, quality assurance, and documentation.

2.  Hardware and software certification/ integration (notably Oracle).

3.  Technical support and consulting.

4.  Personnel training and certification.


> with hardwares like Dell EMC PowerEdge or Lenovo ThinkCenter which
> seems to never mention that they support Debian. What kind of issues can I
> encounter with such hardwares except simple cases like having to install
> missing drivers with some already available firmwares.

If you use a commercial OS, certified hardware, and certified software,
you should never experience compatibility issues.  If you do find an
issue, you make the vendor fix it (or fire them and hire another vendor).


> Can you give me some alternative hardwares in case this idea may take me to
> much time to solve ?

I have a Dell PowerEdge T30 and do not recall any issues with Debian 9.
(But the fact that Dell disabled the M.2 NVMe port in the firmware does
irritate me.)


I have had good luck with Antec cases; Thermaltake power supplies, Intel
motherboards, network interfaces, and solid-state drives; and Seagate
hard disk drives.


> Note: I will need some RAID solution hard or soft.

"Enterprise" implies storage area networks.  This requires hardware (and
support software).


Drives and/or racks with dual interfaces require hardware (and support
software).


Hardware RAID (and support software) should give you the best I/O
performance and least CPU load, but implies locking you into the
vendor's way of doing things.


Software RAID gives you the most control and flexibility, but impacts
I/O performance and CPU load.


> Sorry if my English is bad, it's not my mother language.

Your English is fine.


> Thank you.

You're welcome.  :-)


There have been 16 responses to your post in the past 36+ hours.  You
should reply to at least some of them.


David



[1]
https://www.pearson.com/us/higher-education/product/Mc-Kusick-Design-and-Implementation-of-the-Free-BSD-Operating-System-The-2nd-Edition/9780133761832.html

[2] https://mwl.io/nonfiction

[3]
https://www.freebsd.org/doc/en_US.ISO8859-1/books/handbook/nutshell.html#introduction-nutshell-users


Reply to: