this post was submitted on 10 Nov 2023
2 points (100.0% liked)

Homelab

380 readers
9 users here now

Rules

founded 1 year ago
MODERATORS
 

does passthrough for a 3090 or two work on esxi 7 or 8 for vm for stable diffusion tts llama? if so what would be the recommended host os and set up? I currently have a 3090 in my windos 10 pro workstation that i use for this those tasks but also use workstation for work and games. I would like to set up something for training 24 7. host server would be a 32 or 64 core epyc w 256 ram super micro h12ssl nt mb that would also host vms for other tasks. if this doest work may look at building a separate ai server. I may get a used 3090 now and put add my workstation 3090 later or upgrade to 4090 on workstation if there good black friday deal.

top 1 comments
sorted by: hot top controversial new old
[–] [email protected] 1 points 1 year ago

I use PCI pass through for my 2080 Super on ESXi and it works but I’m only doing single host utilization. I think for VMs to share the GPU, you need the NVIDIA licensed driver which is pricey. If just a single VM needs the GPU (my case) then it’s just standard PCI Passthrough.