this post was submitted on 15 Jun 2024
33 points (59.8% liked)

Technology

59669 readers
3183 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] HerzogVonWiesel 65 points 5 months ago (1 children)

ITT: nobody understands what the Turing Test really is

[–] [email protected] 8 points 5 months ago* (last edited 5 months ago) (1 children)

To clarify:

People seem to legit think the jury talks to the bot in real time and can ask about literally whatever they want.

Its rather insulting to the scientist that put a lot of thought into organizing a controlled environment to properly test defined criteria.

[–] [email protected] 7 points 5 months ago (3 children)

Its rather insulting to the scientist that put a lot of thought into organizing a controlled environment to properly test defined criteria.

lmao. These "scientists" are frauds. 500 people is not a legit sample site. 5 minutes is a pathetic amount of time. 54% is basically the same as guessing. And most importantly the "Turing Test" is not a scientific test that can be "passed" with one weak study.

Instead of bootlicking "scientists", we should be harshly criticizing the overwhelming tide of bad science and pseudo-science.

[–] [email protected] 4 points 5 months ago

I don't think the methodology is the issue with this one. 500 people can absolutely be a legitimate sample size. Under basic assumptions about the sample being representative and the effect size being sufficiently large you do not need more than a couple hundred participants to make statistically significant observations. 54% being close to 50% doesn't mean the result is inconclusive. With an ideal sample it means people couldn't reliably differentiate the human from the bot, which is presumably what the researchers believed is of interest.

[–] mindbleach 1 points 5 months ago

54% is basically the same as guessing.

Yes, that is what success would look like.

They can't tell the difference - so they have to guess. Or they think they can tell, but they can't.

Do you think the AI is supposed to convince you it's more human than the human participant, every single time?

[–] [email protected] 1 points 5 months ago

The reporting are big clickbait but that doesn’t mean there is nothing left to learn from the old touring tests.

I dont know what the goal was they had in mind. It could just as well be “testing how overhyped the touring tests is when manipulated tests are shared with the media”

I sincerely doubt it but i do give them benefits of the doubt.