LocalLLaMA

2237 readers

10 users here now

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

founded 1 year ago

MODERATORS

submitted 11 months ago* (last edited 11 months ago) by noneabove1182 to c/localllama

7 comments fedilink hide all child comments

Orca 2 released by Microsoft!

Full weights here:

My own exllamav2 quants here:

GGUF from TheBloke (links to GPTQ/AWQ inside it):

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 3 points 11 months ago (1 children)

How does it compare to Mistral? That’s the best performing 7b model and it’s suspiciously missing from this report.

[–] noneabove1182 2 points 11 months ago

I'm looking forward to trying it today, I think this might make a good RAG model based on the orca 2 paper, but testing will be needed