LocalLLaMA

2265 readers

10 users here now

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

founded 1 year ago

MODERATORS

SkySyrup

pax

noneabove1182

Meta releases ‘Code Llama 70B’, an open-source behemoth to rival private AI development (venturebeat.com)

submitted 10 months ago by [email protected] to c/localllama

15 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 2 points 9 months ago (1 children)

Why use it though if it's not as good, and repeats itself.

[–] [email protected] 9 points 9 months ago* (last edited 9 months ago)

Because it doesn't call out to the internet. I even put lmstudio behind firejail to prevent it from doing so. Thusly any code I feed it (albeit pretty trivial code) doesn't add to chatgpt's overarching data set.

It still can produce usable results. It's just not as consistent. Whenever it gets into a repetitive loop, I just restart it, resetting the initial context, which generally prevents it from repeating itself, at least initially. To be fair, I've also experienced this with chatgpt, just not as often.

TLDR; It's more private and still useful.