LocalLLaMA

2268 readers

1 users here now

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

founded 1 year ago

MODERATORS

SkySyrup

pax

noneabove1182

Discovering Locally Run Language Models: Share Your Favorites/Not So Favorites! (beehaw.org)

submitted 1 year ago* (last edited 1 year ago) by [email protected] to c/localllama

13 comments fedilink hide all child comments

Let's talk about our experiences working with different models, either known or lesser-known.

Which locally run language models have you tried out? Share your insights, challenges, or anything you found interesting during your encounters with those models.

you are viewing a single comment's thread
view the rest of the comments

[–] Equality_for_apples 5 points 1 year ago

I've been doing RP with Wizard-Vicuna 13b Uncensored. it's good, very fast (ggml v3 q5-k-s variant) But sometimes forgets it's roleplaying and spits out a story