this post was submitted on 24 Nov 2023
1 points (100.0% liked)

Homelab

371 readers
9 users here now

Rules

founded 11 months ago
MODERATORS
 

I kinda want to put together a Ceph storage cluster — but I know it can take quite a bit to get good IOPS from ceph — good CPU’s and fast enterprise drives (but I want NVMe), oh and also good networking. But I mainly want to see what I can get in the IOPS department so sequential throughput, I’m not too worried about

How would you guys go about this? Any good hardware choices now that prices of things have come down a good bit in the last year or so?

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 1 points 10 months ago (2 children)

https://static.xtremeownage.com/blog/2023/proxmox-building-a-ceph-cluster/

Having around 10 total enterprise NVMes, and 10G networking, I am pretty happy with the results.

It runs all of my VMs, kubernetes, etc, and doesn't bottleneck.

[–] [email protected] 1 points 10 months ago (1 children)

This is a great article but it definitely shows that you shouldn’t expect much

He’s not even reaching the IOPS of a single drive in his testing :(

I might have to find something else lol

[–] [email protected] 1 points 10 months ago

I did put the disclaimer front and center! Ceph really needs a ton of hardware before it starts even comparing to normal storage solutions.

But, the damn reliability is outstanding.