this post was submitted on 20 Aug 2023
22 points (75.0% liked)
Asklemmy
43978 readers
604 users here now
A loosely moderated place to ask open-ended questions
Search asklemmy ๐
If your post meets the following criteria, it's welcome here!
- Open-ended question
- Not offensive: at this point, we do not have the bandwidth to moderate overtly political discussions. Assume best intent and be excellent to each other.
- Not regarding using or support for Lemmy: context, see the list of support communities and tools for finding communities below
- Not ad nauseam inducing: please make sure it is a question that would be new to most members
- An actual topic of discussion
Looking for support?
Looking for a community?
- Lemmyverse: community search
- sub.rehab: maps old subreddits to fediverse options, marks official as such
- [email protected]: a community for finding communities
~Icon~ ~by~ ~@Double_[email protected]~
founded 5 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Thanks a lot! Will definitely try all of these. Selfhosting looks kinda difficult and ineffective compared to other options, or am I missing something?
LM Studio is an incredibly easy to use tool for downloading and running self hosted language models
I kinda got lost in making that list (just aspergers things) and listed every model i knew.
For a layperson, yeah self hosting isn't as effective yet. But if someone who studies AI (like me), self hosting is a must. Some use cases are:
Retrain on your own data (big market potential)
Make your own bots with specific applications/use cases (like parse wikipedia before answering)
Bypass censorship (funny story, my friend asked claude to summarize a book on dystopia and it kept telling her to talk about something else cuz dystopia's were too depressing for claude)
I've even heard about models that are specialized for just one task like chatting, or logic puzzles
And lastly, privacy nerds like me