this post was submitted on 31 Jan 2025
15 points (89.5% liked)

LocalLLaMA

2531 readers
1 users here now

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

founded 2 years ago
MODERATORS
SkySyrup
pax
noneabove1182
15
What is a good model that runs on 6GB Vram? (discuss.online)
submitted 6 days ago by [email protected] to c/localllama
10 comments fedilink hide all child comments
 

Should be good at conversations and creative, it'll be for worldbuilding

Best if uncensored as I prefer that over it kicking in when I least want it

I'm fine with those roleplaying models as long as they can actually give me ideas and talk to be logically

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 2 points 5 days ago* (last edited 5 days ago)

7B models have been very good for about a year now. Lumimaid is my current favorite but I have to quantize it one step too far since it's an 8B. Noromaid was the best one before that