this post was submitted on 08 Jun 2023
5 points (100.0% liked)

LocalLLaMA

2320 readers
3 users here now

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

founded 2 years ago
MODERATORS
SkySyrup
pax
noneabove1182
5
How do I get LLaMA going on a GPU? (self.localllama)
submitted 2 years ago by planish to c/localllama
2 comments fedilink hide all child comments
 

Everyone is so thrilled with llama.cpp, but I want to do GPU accelerated text generation and interactive writing. What's the state of the art here? Will KoboldAI now download LLaMA for me?

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 2 points 2 years ago

there's a bit more setup involved but I would look into https://github.com/oobabooga/text-generation-webui