LocalLLaMA

2577 readers

4 users here now

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

founded 2 years ago

MODERATORS

SkySyrup

pax

noneabove1182

Making LLMs lighter with AutoGPTQ and transformers (huggingface.co)

submitted 2 years ago by noneabove1182 to c/localllama

0 comments fedilink hide all child comments

Hugging face transformers officially has support for AutoGPTQ, this is a pretty huge deal and signals a much wider adoption in quantized model support which is great for everyone!

no comments (yet)

sorted by: hot top controversial new old

there doesn't seem to be anything here