this post was submitted on 13 Jul 2023
14 points (100.0% liked)

LocalLLaMA

2292 readers
1 users here now

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

founded 2 years ago
MODERATORS
SkySyrup
pax
noneabove1182
14
Open-Orca/OpenOrca-Preview1-13B · Hugging Face (huggingface.co)
submitted 1 year ago by noneabove1182 to c/localllama
0 comments fedilink hide all child comments
 

Open Orca preview trained on ~6% of data:

We have trained on less than 6% of our data, just to give a preview of what is possible while we further refine our dataset! We trained a refined selection of 200k GPT-4 entries from OpenOrca. We have filtered our GPT-4 augmentations to remove statements like, "As an AI language model..." and other responses which have been shown to harm model reasoning capabilities. Further details on our dataset curation practices will be forthcoming with our full model releases.

no comments (yet)
sorted by: hot top controversial new old
there doesn't seem to be anything here