remghoost7

joined 1 year ago
[โ€“] [email protected] 1 points 11 months ago

I'd recommend koboldcpp for your backend, SillyTavern for your frontend, and I've been a fan of dolphin-2.1-mistral-7B. I've been using the Q4_K_S. But you could probably run a 13B model just fine.

I've heard good things about the nous-hermes models (I was a big fan of their Llama2 model). I'd stick to mistral variants, personally. Their dataset/training has far surpassed base Llama2 stuff in my opinion.

[โ€“] [email protected] 1 points 11 months ago

What does the naming scheme look like? Is it like "part1.opus", "part2.opus", etc?

I'm an amateur programmer, bored, and feel like stitching together a program. lol.