LocalLLaMA

2531 readers

1 users here now

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

founded 2 years ago

MODERATORS

submitted 3 weeks ago by [email protected] to c/localllama

16 comments fedilink hide all child comments

Do i need industry grade gpu's or can i scrape by getring decent tps with a consumer level gpu.

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 1 points 3 weeks ago

this is useless, llama.cpp already does that airllm does (offloading to CPU) but its actually faster. so just use ollama