this post was submitted on 14 Jul 2023
7 points (100.0% liked)
LocalLLaMA
2327 readers
1 users here now
Community to discuss about LLaMA, the large language model created by Meta AI.
This is intended to be a replacement for r/LocalLLaMA on Reddit.
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Also llama.cpp offers very fast performance with the ggmls compared to using transformers, and sometimes faster than ExLlama.