homelab.

This is an automated archive.

The original was posted on /r/homelab by /u/MasterTonberry427 on 2024-01-24 14:05:12+00:00.

Hello Everyone,

I am in the process of building a Epyc 7551 32c/64t server. 128gb DDR4, 2x P40 Nvidia Tesla Cards, and potentially an ARC A770/A380

I'd like to do three things with my server.

1. use OPN sense with the two onboard 1GB NICS to work as a router/firewall - and assign something like 4C/8T and 8GB ram to this operation.
2. Use windows and the ARC to do AV1 Encoding with Jellyfin.
3. Use windows and the Tesla cards (potentially more powerful cards in the future) to do local LLM testing/learning.

The windows tasks can obviously be done in the same instance. I've tried my hand at TruNas Scale before, but was unsure how to handle CPU/Graphics passthrough, as I am a newbie when it comes the software side of powerful hardware. I've even thought of just running the DHCP server on Windows, but I know that wouldn't be the best for security/uptime.