this post was submitted on 20 Jul 2023
6 points (100.0% liked)
LocalLLaMA
2293 readers
1 users here now
Community to discuss about LLaMA, the large language model created by Meta AI.
This is intended to be a replacement for r/LocalLLaMA on Reddit.
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Before buying a GPU for this, evaluate models using your CPU and system memory first. The only difference would be speed but note that CPUs can be acceptably fast and that responses are the same.