this post was submitted on 21 May 2025
298 points (96.6% liked)

Technology

71585 readers
3554 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS
 

Absolutely needed: to get high efficiency for this beast ... as it gets better, we'll become too dependent.

"all of this growth is for a new technology that’s still finding its footing, and in many applications—education, medical advice, legal analysis—might be the wrong tool for the job,,,"

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 4 points 4 weeks ago (2 children)

Which chatbots are getting smarter?

I know AI has potential, but specifically LLMs (which most people mean when talking about AI) seem to have hit their technological limits.

[–] [email protected] 2 points 3 weeks ago (1 children)

Copilot, ChatGPT, pretty much all of them.

[–] [email protected] 1 points 3 weeks ago (1 children)

Smarter how? Synthetic benchmarks?

Because I've heard the opposite from users and bloggers.

[–] [email protected] 1 points 3 weeks ago (1 children)

So you want me to provide some evidence that it's getting smarter, but you can't provide any that it's getting worse other than anecdotal evidence?

What evidence would you accept?

[–] [email protected] 1 points 3 weeks ago (1 children)

Any proof that we have moved past the current architecture.

[–] [email protected] 0 points 3 weeks ago (1 children)

What does "architecture" mean in this scenario?

[–] [email protected] 1 points 3 weeks ago (1 children)

Any significant shift in the model, or a complete restructuralization of the approach.

As it is, it won't grow anywhere.

[–] [email protected] 0 points 3 weeks ago* (last edited 3 weeks ago) (1 children)

So you’ve got access to all this stuffs source code and know what has and hasn’t changed with every update?

[–] [email protected] 1 points 3 weeks ago (1 children)

No, if there was any major breakthrough, it would be advertised everywhere.

[–] [email protected] 1 points 3 weeks ago (2 children)

They’re constantly advertising updates to these chat bots in what they can do.

[–] [email protected] 0 points 3 weeks ago

Small incremental updates on little tasks mean nothing, the underlying issues are still the same.

It has no intelligence, and as such carries big risks.

[–] [email protected] 0 points 3 weeks ago (1 children)

No, they are spreading lies about shit that doesn't matter as to not lose the hype.

If anyone made any significant advance, they would be all over the world.

[–] [email protected] 1 points 3 weeks ago (1 children)

You’re not backing this up with anything. Those of us who use them know they’ve been making big updates regularly.

[–] [email protected] 1 points 3 weeks ago (1 children)

You're not backing anything up either, just 'my experience'.

[–] [email protected] 1 points 3 weeks ago

Do you want me to just link to Microsoft and OpenAI’s pages about their AI chatbots updates?

[–] Jakeroxs 2 points 4 weeks ago (1 children)

Advanced Reasoning models came out like 4 months ago lol

[–] [email protected] 4 points 4 weeks ago (2 children)

Advanced reasoning? Having LLM talk to itself?

[–] [email protected] 2 points 4 weeks ago

Yes, which has improved some tasks measurably. ~20% improvement on programming tasks, as a practical example. It has also improved tool use and agentic tasks, allowing the llm to plan ahead and adjust it's initial approach based on later parts.

Having the llm talk through the tasks allows it to improve or fix bad decisions taken early based on new realizations on later stages. Sort of like when a human thinks through how to do something.

[–] Jakeroxs -1 points 4 weeks ago* (last edited 4 weeks ago) (1 children)

Lul yes but no, but they are clearly better at many types of tasks.

[–] [email protected] 0 points 4 weeks ago* (last edited 4 weeks ago) (2 children)

For example? Citations?

Pretty sure these "tasks" are meaningless metrics made up by pseudo-scientific grifters.

[–] Jakeroxs 3 points 4 weeks ago

Small bits of code, language related tasks, basic context understanding, not metrics I have literally measured simply noticed has improved compared to non reasoning models in my homelab testing. 🤷‍♂️

[–] [email protected] 2 points 4 weeks ago

AlphaFold 3 which can help in the prediction of some proteins. Although it has some limitations, it cannot be used in all cases, only in what it can perform without any problem.