sh.itjust.works

28,301 readers
997 users here now

Useful Links

Rules:

Be respectful. Everyone should feel welcome here.
No bigotry - including racism, sexism, ableism, homophobia, transphobia, or xenophobia.
No Ads / Spamming.
No pornography.

Règles :

Soyez respectueux. Tout le monde doit se sentir le bienvenu ici.
Pas de bigoterie - y compris le racisme, le sexisme, le capacitisme, l'homophobie, la transphobie ou la xénophobie.
Pas de publicités / Pas de spam.
Pas de pornographie.

Fediseer

Other UI options (more to come)

https://oldsh.itjust.works/

Monitoring Services
lemmy-meter.info

founded 2 years ago

ADMINS

OpenOrca, an open-source dataset and series of instruct-tuned language models (erichartford.com)

submitted 1 year ago by noneabove1182 to c/localllama

5 comments fedilink

I realized that while Microsoft would probably release their LLaMA-13b based model (as of the time of this writing they still haven't) I concluded that they might not release the dataset. Therefore, I resolved to replicate their efforts, download the data myself, and train the model myself, so that OpenOrca can be released on other sizes of LLaMA as well as other foundational models such as Falcon, OpenLLaMA, RedPajama, MPT, RWKV.

OpenOrca: open source dataset and instruct-tuned LLMs (erichartford.com)

submitted 1 year ago by [email protected] to c/[email protected]

0 comments fedilink

HN Discussion