LocalLLaMA

2391 readers

2 users here now

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

founded 2 years ago

MODERATORS

submitted 1 year ago* (last edited 1 year ago) by noneabove1182 to c/localllama

7 comments fedilink hide all child comments

Orca 2 released by Microsoft!

Full weights here:

My own exllamav2 quants here:

GGUF from TheBloke (links to GPTQ/AWQ inside it):

you are viewing a single comment's thread
view the rest of the comments

[–] Hanabie 2 points 1 year ago (1 children)

I'll wait a little then I guess. I need 16k for what I'm doing. Thanks for the heads up 🙂

[–] noneabove1182 2 points 1 year ago (1 children)

Btw there's a 16k tune available now:

[–] Hanabie 2 points 1 year ago

Nice, will give it a try. Thank you 😊