Futurology

1930 readers

167 users here now

founded 2 years ago

MODERATORS

When AI is tested on questions it can't model from pre-existing answers on the internet, it only scores 10% in the test. (qz.com)

submitted 2 days ago by [email protected] to c/[email protected]

13 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 1 points 2 days ago (3 children)

AI scores really low on subjects it’s never read about. Real shocker there. I’d put money on humans scoring even less on subjects they’ve never heard of.

[–] [email protected] 4 points 2 days ago* (last edited 2 days ago) (2 children)

I’d put money on humans scoring even less on subjects they’ve never heard of.

They are testing is the ability to reason. The AI, or human, can still use the internet to find out the answer. Here's a sample question that illustrates the distinction.

Hummingbirds within Apodiformes uniquely have a bilaterally paired oval bone, a sesamoid embedded in the caudolateral portion of the expanded, cruciate aponeurosis of insertion of m. depressor caudae. How many paired tendons are supported by this sesamoid bone? Answer with a number.

[–] [email protected] 3 points 2 days ago

That reads like the sort of thing Wolfram Alpha was designed to absolutely obliterate, if only the raw data representing each of those keywords had been loaded in.

load more comments (1 replies)