AI

4006 readers

1 users here now

Artificial intelligence (AI) is intelligence demonstrated by machines, unlike the natural intelligence displayed by humans and animals, which involves consciousness and emotionality. The distinction between the former and the latter categories is often revealed by the acronym chosen.

founded 3 years ago

The GPT-4 barrier has finally been broken (simonwillison.net)

submitted 5 months ago by [email protected] to c/[email protected]

10 comments fedilink hide all child comments

Four weeks ago, GPT-4 remained the undisputed champion: consistently at the top of every key benchmark, but more importantly the clear winner in terms of “vibes”. Almost everyone investing serious time exploring LLMs agreed that it was the most capable default model for the majority of tasks—and had been for more than a year.

Today that barrier has finally been smashed. We have four new models, all released to the public in the last four weeks, that are benchmarking near or even above GPT-4. And the all-important vibes are good, too!

Those models come from four different vendors.

all 15 comments

sorted by: hot top controversial new old

[–] [email protected] 15 points 5 months ago (1 children)

None of the models that rival gpt4 are open AFAIK

[–] [email protected] 9 points 5 months ago

Yup

Firstly, none of those models are openly licensed or weights available. I imagine the resources they need to run would make them impractical for most people, but at after a year that has seen enormous leaps forward in the openly licensed model category it’s sad to see the very best models remain strictly proprietary.

[–] [email protected] 3 points 5 months ago

Hmm has the leaderboard not been updated? It's still showing gpt4 at the top: https://huggingface.co/spaces/lmsys/chatbot-arena-leaderboard