this post was submitted on 15 May 2024
646 points (99.8% liked)

TechTakes

1880 readers
63 users here now

Big brain tech dude got yet another clueless take over at HackerNews etc? Here's the place to vent. Orange site, VC foolishness, all welcome.

This is not debate club. Unless it’s amusing debate.

For actually-good tech, you want our NotAwfulTech community

founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 21 points 1 year ago* (last edited 1 year ago) (18 children)

I'm not a big AI guy but it's really not quite like that, models do NOT contain all the data they were trained on.

Edit: I have no idea what's going on down below this comment

[–] [email protected] 10 points 1 year ago* (last edited 1 year ago) (4 children)

that's a misleading and meaningless way of putting it. if I rip a page out of my textbook and bring it into an exam room, I do not have with me all the data in my textbook. and yet

[–] [email protected] 0 points 1 year ago (3 children)

It doesn’t do that, either. LLMs retain the linguistic patterns found in textbooks, nothing more. It’s remarkable that they can do so much with this information alone, but it’s still a far cry from genuine intelligence.

[–] [email protected] 15 points 1 year ago* (last edited 1 year ago) (1 children)

And yet they can spit out copyrighted material verbatim, or near-verbatim, how strange and peculiar.

[–] [email protected] 10 points 1 year ago
load more comments (1 replies)
load more comments (1 replies)
load more comments (14 replies)