this post was submitted on 03 Nov 2024
383 points (98.2% liked)

Open Source

31044 readers
468 users here now

All about open source! Feel free to ask questions, and share news, and interesting stuff!

Useful Links

Rules

Related Communities

Community icon from opensource.org, but we are not affiliated with them.

founded 5 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[โ€“] [email protected] 15 points 3 days ago* (last edited 3 days ago) (1 children)

This is a really great use of LLM! Seriously great job! Once it's fully self-hostable (including the LLM model), I will absolutely find it space on the home server. Maybe using Rupeshs fastdcpu as the model and generation backend could work. I don't remember what his license is, though.

Edit: added link.

[โ€“] [email protected] 8 points 3 days ago

Thanks! I'm already eyeing ollama for this.