Self-Hosted Main

496 readers

1 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

For Example

Service: Dropbox - Alternative: Nextcloud
Service: Google Reader - Alternative: Tiny Tiny RSS
Service: Blogger - Alternative: WordPress

We welcome posts that include suggestions for good self-hosted alternatives to popular online services, how they are better, or how they give back control of your data. Also include hints and tips for less technical readers.

Useful Lists

Awesome-Selfhosted List of Software
Awesome-Sysadmin List of Software

founded 1 year ago

MODERATORS

[email protected]

As of today what would be the best AI to self-host on Linux (alien.top)

submitted 9 months ago by [email protected] to c/[email protected]

11 comments fedilink hide all child comments

I will mainly use it for help in coding and general questions.

top 11 comments

sorted by: hot top controversial new old

[–] [email protected] 2 points 9 months ago

Text Generation WebUI, feature-rich. Download models by yourself.

[–] [email protected] 2 points 9 months ago (2 children)

Check ollama.

[–] [email protected] 1 points 9 months ago

Thanks

[–] [email protected] 1 points 9 months ago

Ollama is great!

[–] [email protected] 2 points 9 months ago (1 children)

None, don't host it yourself.
You will need a ton of ram and a really powerfull PC. Additionally your electricity bill will go up significantly

[–] [email protected] 3 points 9 months ago (1 children)

You do know this is selfhosted, right? People tell us that what we do is "not a good idea" all the time.

[–] [email protected] 1 points 9 months ago (1 children)

Im all for selfhosting but LLMs is just stupid. But go for it you do you and evite the ride ♥

[–] [email protected] 1 points 9 months ago

Agree people be selfhosting to save money in subscriptions but then spend a 4090 and tons of energy to use an LLM from time to time

[–] [email protected] 1 points 9 months ago (1 children)

Cant say enough good things about Serge

https://github.com/serge-chat/serge

[–] [email protected] 1 points 9 months ago (1 children)

Look interesting

[–] [email protected] 1 points 9 months ago

its great and has active development. Hit up the discord, lotta helpful folks in there