this post was submitted on 03 Oct 2023

15 points (100.0% liked)

LocalLLaMA

2266 readers

13 users here now

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

founded 1 year ago

MODERATORS

15

Dolphin 2.0 based on mistral-7b released by Eric Hartford (huggingface.co)

submitted 1 year ago* (last edited 1 year ago) by noneabove1182 to c/localllama

1 comments fedilink hide all child comments

Model is trained on his own orca style dataset as well as some airoboros apparently to increase creativity

Quants:

https://huggingface.co/TheBloke/dolphin-2.0-mistral-7B-GPTQ

https://huggingface.co/TheBloke/dolphin-2.0-mistral-7B-GGUF

https://huggingface.co/TheBloke/dolphin-2.0-mistral-7B-AWQ

you are viewing a single comment's thread
view the rest of the comments

[–] noneabove1182 2 points 1 year ago* (last edited 1 year ago) (1 children)

It depends on the learning rate, typically it's ideal and higher quality to learn really slowly over a lot of epochs but it's cheaper and obviously faster to learn fast over fewer epochs

Also the dataset size is important to consider