this post was submitted on 28 Jun 2024
901 points (98.9% liked)

Technology

2046 readers
5 users here now

Post articles or questions about technology

founded 2 years ago
MODERATORS
 
you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 40 points 5 months ago* (last edited 5 months ago) (3 children)

LLMs are incredibly bad at any math because they just predict the most likely answer, so if you ask them to generate a random number between 1 and 100 it's most likely to be 47 or 34. Because it's just picking a selection of numbers that humans commonly use, and those happen to be the most statistically common ones, for some reason.

doesn't mean that it won't try, it'll just be incredibly wrong.

[–] [email protected] 32 points 5 months ago (2 children)

Son of a bitch, you are right!

[–] [email protected] 14 points 5 months ago (2 children)

now the funny thing? Go find a study on the same question among humans. It's also 47.

[–] [email protected] 8 points 5 months ago

It's 37 actually. There was a video from Veritasium about it not that long ago.

[–] [email protected] 5 points 5 months ago (1 children)
[–] [email protected] 3 points 5 months ago (1 children)

I did too. Maybe that one is #3 most common

[–] [email protected] 1 points 5 months ago (1 children)

I’m here for LLM’s responding that 42 is the answer to life, the universe and everything, just because enough people said the same.

[–] [email protected] 4 points 5 months ago

42 would have been statistically the most likely answer among the original humans of earth, until our planet got overrun with telehone sanitizers, public relations executives and management consultants.

[–] [email protected] 7 points 5 months ago (2 children)

Because it’s just picking a selection of numbers that humans commonly use, and those happen to be the most statistically common ones, for some reason.

The reason is probably dumb, like people picking a common fraction (half or a third) and then fuzzing it a little to make it "more random". Is the third place number close to but not quite 25 or 75?

[–] [email protected] 1 points 5 months ago (1 children)

Its a bit more complicated but here's a cool video on the topic https://youtu.be/d6iQrh2TK98

[–] [email protected] -1 points 5 months ago (1 children)

Ok, that's interesting, but you amusingly picked the wrong number in the original comment, picking 34 rather than 37.

[–] [email protected] 3 points 5 months ago

I did not pick any number. That was my first comment in the thread

[–] [email protected] 1 points 5 months ago* (last edited 5 months ago)

idk the third place number off the top of my head, but that might be the case, although you would have to do some really weird data collection in order to get that number.

I think it's just something fundamentally pleasing about the number itself that the human brain latches onto. I suspect it has something to do with primes, or "pseudo" primes, numbers that seem like primes, but aren't since they're probably over represented in our head among "random" numbers even though primes are perfectly predictable.

[–] [email protected] 1 points 5 months ago (1 children)

Me: Pick a number between 1 and 100

Gemini: I picked a number between 1 and 100. Is there anything else I can help you with?

[–] [email protected] 2 points 5 months ago

ah yes my favorite number.