Technology

59979 readers

2236 users here now

This is a most excellent place for technology news and articles.

Our Rules

Follow the lemmy.world rules.
Only tech related content.
Be excellent to each another!
Mod approved content bots can post up to 10 articles per day.
Threads asking for personal tech support may be deleted.
Politics threads may be removed.
No memes allowed as posts, OK to post as comments.
Only approved bots from the list below, to ask if your bot can be added please contact us.
Check for duplicates before posting, duplicates may be removed

Approved Bots

founded 2 years ago

MODERATORS

[email protected]

AI Prompt Engineering Is Dead (developers.slashdot.org)

submitted 9 months ago by [email protected] to c/[email protected]

35 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 2 points 9 months ago

Actually most (I think all, but not 99% positive) machine learning models are incapable of doing straight arithmetic. Due to the way they are built ML models, including deep learning models, can only learn relationships in a limited input space.

This is most apparent when you test LLMs on different arithmetic operations:

For addition, it does okay up until you get to millions or billions
Multiplication I think breaks at the 100/1000 level
exponents almost break immediately
Give it decimal values and it also breaks relatively quickly for any operation.

This has to do with the fact that LLMs are effectively multiple layers of linear functions, so higher order operations break down faster.