this post was submitted on 01 Nov 2023
10 points (100.0% liked)

LocalLLaMA

2179 readers
1 users here now

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

founded 1 year ago
MODERATORS
SkySyrup
pax
noneabove1182
10
Min P sampler (an alternative to Top K/Top P) has been merged into llama.cpp (github.com)
submitted 9 months ago by noneabove1182 to c/localllama
0 comments fedilink hide all child comments
 

Very interesting new sampler, does a better drop at filtering out extremely unlikely tokens when the most likely tokens are less confident, from the results it seems to pretty reliably improve quality with no noticeable downside

no comments (yet)
sorted by: hot top controversial new old
there doesn't seem to be anything here