this post was submitted on 02 Mar 2025
24 points (92.9% liked)
LocalLLaMA
2661 readers
2 users here now
Community to discuss about LLaMA, the large language model created by Meta AI.
This is intended to be a replacement for r/LocalLLaMA on Reddit.
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Yeah that roughly translates to GB vram, but with quantization and stuff it gets more complicated.
Sounds pretty applicable tho in these sizes ^^