LocalLLaMA

2274 readers

3 users here now

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

founded 2 years ago

MODERATORS

SkySyrup

pax

noneabove1182

Discovering Locally Run Language Models: Share Your Favorites/Not So Favorites! (beehaw.org)

submitted 1 year ago* (last edited 1 year ago) by [email protected] to c/localllama

13 comments fedilink hide all child comments

Let's talk about our experiences working with different models, either known or lesser-known.

Which locally run language models have you tried out? Share your insights, challenges, or anything you found interesting during your encounters with those models.

you are viewing a single comment's thread
view the rest of the comments

[–] VraethrDalkr 1 points 1 year ago* (last edited 1 year ago)

WizardLM 30B v1.0: works great with long prompts, coherent and creative.

Airoboros (13B and 33B): performs very well on my benchmarks, accurate but more predictable than WizardLM.

Chronos-Hermes 13B: excellent at role-play with SillyTavern. Very creative and coherent for generating characters dialogue. It never ceases to amaze me. Scores average on benchmarks.

Edit: Sorry for spamming the same comment. It looks like my voyager app glitched out.