this post was submitted on 21 Nov 2023
20 points (100.0% liked)

LocalLLaMA

2199 readers
1 users here now

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

founded 1 year ago
MODERATORS
SkySyrup
pax
noneabove1182
20
Orca 2: Teaching Small Language Models How to Reason (www.microsoft.com)
submitted 9 months ago* (last edited 9 months ago) by noneabove1182 to c/localllama
7 comments fedilink hide all child comments
 

Orca 2 released by Microsoft!

Full weights here:

https://huggingface.co/microsoft/Orca-2-7b

https://huggingface.co/microsoft/Orca-2-13b

My own exllamav2 quants here:

https://huggingface.co/bartowski/Orca-2-7b-exl2

https://huggingface.co/bartowski/Orca-2-13b-exl2

GGUF from TheBloke (links to GPTQ/AWQ inside it):

https://huggingface.co/TheBloke/Orca-2-7B-GGUF

https://huggingface.co/TheBloke/Orca-2-13B-GGUF

you are viewing a single comment's thread
view the rest of the comments
[–] noneabove1182 2 points 9 months ago

I'm looking forward to trying it today, I think this might make a good RAG model based on the orca 2 paper, but testing will be needed