Memes

45877 readers

1020 users here now

Rules:

Be civil and nice.
Try not to excessively repost, as a rule of thumb, wait at least 2 months to do it if you have to.

founded 5 years ago

MODERATORS

[email protected]

506

AI will capture carbon through reverse buzzwordolysis (midwest.social)

submitted 6 months ago* (last edited 6 months ago) by [email protected] to c/[email protected]

42 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 1 points 6 months ago (1 children)

That's what I meant, yes. They're not built based on any linguistic field

[–] [email protected] 2 points 6 months ago* (last edited 6 months ago)

different neural network types excel at different tasks - image recognition was invented way before LLMs, not only for lack of processing power, but also because the previous architectures didn't work with languages. New architectures don't appear out of thin air, they are created with a rough idea of what we could need to make the network do a certain task (e.g. NLP) better. Even tokenization isn't blind codepoint separation but is based on an analysis of languages. But yes, natural languages aren't "parsed" for neural networks, they don't even have a formal grammar.