this post was submitted on 12 Nov 2023
2 points (100.0% liked)

Homelab

371 readers
9 users here now

Rules

founded 11 months ago
MODERATORS
[email protected]
[email protected]
2
My first time building a home server, i have few questions in mind (alien.top)
submitted 10 months ago by [email protected] to c/[email protected]
16 comments fedilink hide all child comments
 

I need to build a server to my my virtual machines to, I run a lot of VMs which they use a lot of CPU and memory, for some heavy machine learning sometimes my pc gets slow down and i want to solve this issue by building a home server, not sure if you guys think this is a good idea or no

- My virtual machines run python selenium codes using multi threading, I heard this info is important as there are a lot of CPUs which are made for this, I am not sure which ones

- I need at least 30-50 CPU cores and 64gb-128gb memory

Is this achievable with a budget of 2000$?

​

Some other questions I had in mind, such a server is going to be noisy? if I placed in it another room is it possible to control it remotly without cables?

If I missed any info please point them out I would love to add more details, thank you

top 16 comments
sorted by: hot top controversial new old
[–] [email protected] 1 points 10 months ago (2 children)

Have you looked into AMD EPYC?

There are regular deals comming from china with Supermicro Motherboard/CPU/RAM deals:

https://www.ebay.com.au/itm/134674563486

A setup like this will be a power hog though.

To control it from another room you would use the web interface of whatever OS you are using eg Proxmox. To turn it on you can use Wake On Lan commands/apps on your workstation/phone.

Check out a build video for an EPYC system here:

https://www.youtube.com/watch?v=aCrldtj9bGY

You have to make sure the cooler you use is rated for the CPU though:

https://www.youtube.com/watch?v=v0jZ12U3u4A

[–] [email protected] 1 points 10 months ago (1 children)

Thank you for sharing this mate, if I understand correctly this is the specs of the link you sent?

scroll a little bit down
https://www.amd.com/en/products/cpu/amd-epyc-7702p

it says here:
64 cores of 128 Threads
and a lot of other things, but it is really 64 cores?? only for 1400$? if it this is crazy good i guess?

[–] [email protected] 1 points 10 months ago

only for 1400$

I would say that's pretty costly actually for a single CPU board, my full build was 1200$ CAD in July.

Check this vendor on Ebay for board : https://www.ebay.ca/str/tugm4470

It's where I got my Supermicro H11DSi (mind you it's the late 2017 model but not much new in between 2017 and 2019), fast shipping, pretty good price and he has a mix of ready to go combo or just parts if you need to.

I lean more on the Epyc side for the CPUs over Xeon but both are good.

[–] [email protected] 1 points 10 months ago (1 children)

Plus, is there a way I can make it reach 128gb memory? the only available option is 64gb

[–] [email protected] 1 points 10 months ago (1 children)

the only available option is 64gb

I'm not saying it looks legit, but the listing definitely has 8*64GB modules - 512GB in total.

[–] [email protected] 1 points 10 months ago (1 children)

Markaos are you sure? isn't it 8 rams that gives you only 64gb? if you are correct then i am god dam new to this shit <3

so it's really 512GB? i really want a reply, if it is then dam this is not bad

[–] [email protected] 1 points 10 months ago

Given that it also has an 8*8GB variant (which cannot be the total capacity because 1GB DDR4 DIMMs are not a thing)... yeah, I'm sure that's what the listing means. Again, no comment on how legit it actually is, I have no experience with buying server parts on eBay.

[–] [email protected] 1 points 10 months ago (1 children)

Im running a Dual 2690 v4 setup , 30 ish disks , 22 ssd's and 1tb of LRDIMMS in it. ran me about 2200CAD total not including the disks.

usually sits around 260w with a 15-20% load. disks set to spin down (only ssd's active usually).

​

just parted it together with eBay and local stuff I could find.

[–] [email protected] 1 points 10 months ago (1 children)

Hello Greem, the problem is I want to make sure that this is really good for my use case, I am searching your specs atm, thank you for the tip mate

[–] [email protected] 1 points 10 months ago (1 children)

it was more of an idea of cost.

100% I would go epyc

https://www.ebay.ca/itm/175503345724

48 core epyc 7642 + motherboard. throw in some ram for another 150$ and your on your way to a really good system. tons of expansion.

[–] [email protected] 1 points 10 months ago

the link you shared looks good, but i still need to buy powersupply and other things right?

[–] [email protected] 1 points 10 months ago

Are you sure you need that many cores? You can overprovision the light duty VM’s if they aren’t all heavy duty.

[–] [email protected] 1 points 10 months ago

You might also want to consider a 2nd hand workstation with dual cpus like the HP Z840 or equivalent from Dell or Lenovo. They are usually quieter than a rack server and should be within your budget and specs.

[–] [email protected] 1 points 10 months ago

Keep in mind number of cpu cores isn’t a very accurate or complete measure of cpu requirements, 30 - 50 cpu cores from 10 years ago vs 30 cpu cores from current gen cpu’s is significantly different

[–] [email protected] 1 points 10 months ago (1 children)

I'm fairly curious as why you need "30-50" CPU cores and .. 64-128 GB RAM and to think about what you actually need before making decisions.

I run a "lot" of VMs as well, in fact, I naively migrated a bunch of other smaller servers onto this one because it's OP!!!!!
My main compute server is an HPE Gen 10 with 80 cores and 128 GB RAM and ... I max out with "most", if not all of my VMs on at once around 10 to 15% until it crashes because I'm out of RAM by a doodoo ton.

50 cores sounds pretty overkill for 128 RAM, in my humble-pie opinion.

[–] [email protected] 1 points 10 months ago

I have 3 VM and around 85 dockers and the 32gb of ram are not enough for the 4 core cpu I have, i7 7700, ram is always over 90% usage