this post was submitted on 22 Aug 2023
5 points (100.0% liked)

LocalLLaMA

2269 readers
4 users here now

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

founded 1 year ago
MODERATORS
SkySyrup
pax
noneabove1182
5
PEFT 0.5.0: Release GPTQ Quantization, Low-level API · huggingface/peft (github.com)
submitted 1 year ago* (last edited 1 year ago) by noneabove1182 to c/localllama
0 comments fedilink hide all child comments
 

With release 0.5.0, PEFT now officially supports fine tuning quantized GPTQ models! This is a pretty big deal as it allows you to download a much smaller model for fine tuning!

no comments (yet)
sorted by: hot top controversial new old
there doesn't seem to be anything here