this post was submitted on 15 May 2024
645 points (99.8% liked)

TechTakes

1813 readers
70 users here now

Big brain tech dude got yet another clueless take over at HackerNews etc? Here's the place to vent. Orange site, VC foolishness, all welcome.

This is not debate club. Unless it’s amusing debate.

For actually-good tech, you want our NotAwfulTech community

founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 9 points 11 months ago* (last edited 11 months ago) (1 children)

It doesn’t read on demand

Yes, it does, from the information it was trained on (or - stored), which like you say, requires a lot of hardware power so it can be accessed on demand. It isn't just manifesting the information out of thin air, and it definitely doesn't "remember" in the same way we do (E: even the best photographic memory isn't the same as an indexable one).

[–] [email protected] 6 points 11 months ago (2 children)

It's definitely not indexed, we use RAG architectures to add indexing to data stores that we want the model to have direct access to, the relevant information is injected directly in the context (prompt). This can somewhat be equated to short term memory

The rest of the information is approximated in the weights of the neural network which gives the model general knowledge and intuition..akin to long term memory

[–] [email protected] 12 points 11 months ago (1 children)

or it can be equated to a shitty database and lossy compression (with artifacts in the form of “hallucinations”), but that doesn’t make the tech sound particularly smart, does it?

but half the posts in your history are in this thread and that’s too many already

[–] Deceptichum 2 points 11 months ago* (last edited 11 months ago)

They 11 posts in total and 2 are in this thread. 2 is not half of 11.

How bad is your maths?

[–] Deceptichum -4 points 11 months ago (1 children)

People have such crazy misconceptions about AI. Glad to see someone else knows how it works at least.

[–] [email protected] 11 points 11 months ago (2 children)
[–] [email protected] 8 points 11 months ago

awww, I just got another bowl of popcorn!

but rofl holy shit at "glad to see someone else knows how they work" given the ..... depth of understanding, shall we say? that was demonstrated in this thread

[–] Deceptichum 2 points 11 months ago* (last edited 11 months ago)

No you fuck off mate. You’re in here peddling misinformation like your name was ChatGPT.