this post was submitted on 03 Jul 2023
16 points (90.0% liked)

Selfhosted

40458 readers
234 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

  1. Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.

  2. No spam posting.

  3. Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.

  4. Don't duplicate the full text of your blog or github here. Just post the link for folks to click.

  5. Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).

  6. No trolling.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 2 years ago
MODERATORS
 

Hey guys!

I have recently joined the selfhosting world after many years of thinking about it. Currently running casaOS with an assortment of containers. Mainly use nextcloud, paperlessNGX, and general file storage.

I am thinking of creating a proxmox cluster. Just wanted to ask for those who do. Is it worth it? And what services are you guys running?

I was thinking of using it for NAS, and a window VM and run other random things that I don't know yet.

Looking into grabbing some Lenovo M715q. Found a decent deal.

Thank you all in advance.

top 24 comments
sorted by: hot top controversial new old
[–] [email protected] 9 points 1 year ago (1 children)

Yes, yes, yes, yes. For the tiny amount of overhead, even the remote console is worth it. Especially when you get into crazy "omg I have so much hardware" homelab territory and have stuff strewn over half your home. Being able to rely on Proxmox being pretty rock solid (if you're careful and smart about your upgrades and not constantly insisting on running bleeding edge), and being able to access the consoles and 'reset buttons' of all your VMs from a single computer is AMAZING.

[–] [email protected] 3 points 1 year ago

Yeah I'm trying not to get to the point where half my house is computers... 😂

That does sound really good though! Thanks!

[–] [email protected] 8 points 1 year ago (1 children)

I've got a 3 node cluster. They are a hodge-podge of weak, old hardware. Yes, it's worth it. Don't worry about HA and automatic migration. It's nice to have a single interface to all the nodes. Also look into the proxmox backup server (PBS). It's a very nice backup system.

[–] [email protected] 1 points 1 year ago

Thank I will definitely be looking into PBS!

[–] [email protected] 4 points 1 year ago (1 children)

What do you mean by worth it? Financially? Haha

[–] [email protected] 2 points 1 year ago

Idk if any of this is beneficial financially...haha

[–] [email protected] 3 points 1 year ago (2 children)

Proxmox is all I use for VM hosting, it is well worth it IMO, I colo metal and I host several virtual machines on it, webservers, ircds, kbin, etc. I specifically use Virtual Machines (KVM) however, it does have the ability to do containerization too (LXC).

[–] [email protected] 1 points 1 year ago (1 children)

Ok sweet! What are you running currently on them?

[–] [email protected] 1 points 1 year ago

gitlab, several docker containers, kbin, ircds, a bouncer, 3-4 web servers, a couple seperate mysql servers, Handshake DNS hosting and Handshake nodes

[–] sneakyninjapants 1 points 1 year ago (1 children)

Man, I wish I could find a good colo solution that wouldn't kill me with fees. VPS isn't bad cost-wise, but I'd really like to be able to throw as much hardware as I want at it without paying $1k/mo.

[–] [email protected] 2 points 1 year ago* (last edited 1 year ago) (1 children)

I use Dacentec, their colo prices are really reasonable and start @ $40/month, it is well worth it when you have your own hardware and you can load whatever you want in it. I've had no issues with uptime or stability either.

[–] sneakyninjapants 1 points 1 year ago

Thanks for the info! I'll definitely check them out. You can fit quite a bit of compute in 1U these days. And $40/mo is far more decently priced than other colo solutions I've seen on the west coast.

[–] [email protected] 3 points 1 year ago

Lots of large operations run proxmox. You're good

[–] [email protected] 2 points 1 year ago (3 children)

The primary reason to virtualize is to maximize the "bang for your buck" on your hardware. Containers are great, but have their limits.

So long as you have a desire to learn it (and the budget), I say dive in with Proxmox and see how you can put that hardware to use. VMWare ESXi is more common in a business/enterprise setting, but costs money to for anything beyond the basic functionality after the evaluation period.

[–] JawnDoh 3 points 1 year ago (1 children)

Basic functionality is probably good for most people. I believe the biggest limit I hit was for the resources. Believe it was 8 vCore /8GB RAM on a single VM. Most of the other vSphere/vSAN and orchestrator stuff is probably beyond home lab needs

[–] [email protected] 1 points 1 year ago (1 children)

I picked up some systems with 16gb each and it's a Ryzen 5 2400. I think it should be good for my needs... hopefully.

[–] JawnDoh 2 points 1 year ago (1 children)

Oh I was saying with the free mode of esxi there are limits placed on the VM resources, not the host. It can be a bit of a pain to get the updates and patches if you don’t pay for the license though. If you get a enterprise server (dell r730 etc) then you’d be able to get the custom dell package from their site for updates but it’s a pain lol

Depending on what you are trying to run those should be an okay start

[–] [email protected] 1 points 1 year ago

Ah ok. I'll cross that bridge if I ever get there. This is just more to tinker and it'll be a glorified file server in the end of the day...haha

But just wanted to learn it and see where it goes l.

[–] [email protected] 1 points 1 year ago

Ok great! I'm doing it to just learn and tinker with. Thank you!

[–] [email protected] 0 points 1 year ago

Fwiw as an SRE specialized in infrastructure for large companies, the primary limits of containers are not about resources, they're about isolation. It's hard to beat CPU hardware virtualization (VMs) for proper isolation with decent performance, but for maximizing resource utilization, containers are actually better if you aren't running untrusted code like a cloud provider. Which is why companies like Google use them at their scale. And in fact, at least for long enough for it to end up in books, ran their VMs through their container orchestration tools. Virtualization has a penalty because you're running multiple kernels and switching back and forth etc.

[–] [email protected] 1 points 1 year ago

for sure a proxmox server is great, id just say don't go for the cluster just yet. Frankly, most self hosted stuff is dockerized and thats a huge plus. And it seems you already have that sorted out (id even ask you if casa OSs fileshare and an external drive could handle the NAS aspect).

I say this not to be a killjoy, but because I have a proxmox node I both overbuilt (for small services and running off a UPS) and underbuilt (for multiple big VMs) all because bought it to, and i kid you mot, “use it for NAS, and a window VM and run other random things that I don’t know yet”. 2 years in and i still don't know what those random things are.

So, my two cents: start cheap get a node to learn and understand where you want to go from there.

[–] [email protected] 1 points 1 year ago (1 children)

Absolutely. You're going to be paying for more overhead but I've never regretting setting up a cluster. I run mine on a t5500, a dl360 gen 6, and a raspberry pi as a witness.

On the cluster I'm running pfsense, file shares, home assistant, a pihole, and a Debian vm with docker that has containers running radarr, sonarr, watchtower, plex, jackett, and mealie. Also spin up various VMs for testing.

[–] [email protected] 0 points 1 year ago (1 children)

That's nice! I'm looking to make media server as well.

[–] [email protected] 1 points 1 year ago

I switched to moving all of my media services from VMs to containers and haven't regretted it. Highly recommend that as your approach.

I left xteve off the list of services as well. Very useful if you plan on doing IPTV.

load more comments
view more: next ›