AI

4109 readers

1 users here now

Artificial intelligence (AI) is intelligence demonstrated by machines, unlike the natural intelligence displayed by humans and animals, which involves consciousness and emotionality. The distinction between the former and the latter categories is often revealed by the acronym chosen.

founded 3 years ago

The GPT-4 barrier has finally been broken (simonwillison.net)

submitted 7 months ago by [email protected] to c/[email protected]

10 comments fedilink hide all child comments

Four weeks ago, GPT-4 remained the undisputed champion: consistently at the top of every key benchmark, but more importantly the clear winner in terms of “vibes”. Almost everyone investing serious time exploring LLMs agreed that it was the most capable default model for the majority of tasks—and had been for more than a year.

Today that barrier has finally been smashed. We have four new models, all released to the public in the last four weeks, that are benchmarking near or even above GPT-4. And the all-important vibes are good, too!

Those models come from four different vendors.

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 9 points 7 months ago* (last edited 7 months ago) (1 children)

There are many free LLM models and platforms to access them. You can download and permanently posses the actual model files and weights.

There are open source frameworks to run and interact with these models that run fully locally

[+] [email protected] 3 points 7 months ago* (last edited 4 months ago) (3 children)

[removed by mod]

[–] [email protected] 4 points 7 months ago

The problem is open models are nowhere close to stuff like GPT-4

Of course not, you'd need the same class of hardware running 24/7 to get similar results, and ain't nobody paying for that.

[–] [email protected] 3 points 7 months ago

Agreed but it's still a good tool thats available. You can use it to summarize large documents. Yes prolly never as capable if you have elite monies. But still worth playing and learning how to use. Imho.

[–] [email protected] 1 points 7 months ago* (last edited 7 months ago) (1 children)

I'll acknowledge that right now to get model conclusions on par with gpt 4 you are going to need a custom pipeline with multiple adversarial models, RAG and more. But it all could be built by an eager hobbyist with a strong gaming pc

To be clear this approach will not benchmark the same as gpt 4 but can indeed generate useful content.