this post was submitted on 26 Aug 2023
21 points (100.0% liked)

LocalLLaMA

2269 readers
5 users here now

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

founded 1 year ago
MODERATORS
 

✅WizardCoder-34B surpasses GPT-4, ChatGPT-3.5 and Claude-2 on HumanEval with 73.2% pass@1

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 6 points 1 year ago (1 children)

Cool, but comparison is a stretch, as admitted by the authors. With identical test methodology gpt-4 is still better

Still a good news

[–] [email protected] 1 points 1 year ago

Agreed, but still huge progress in OSS models in a very short time!