this post was submitted on 05 May 2025
14 points (73.3% liked)
Artificial Intelligence
1640 readers
100 users here now
Welcome to the AI Community!
Let's explore AI passionately, foster innovation, and learn together. Follow these guidelines for a vibrant and respectful community:
- Be kind and respectful.
- Share high-quality contributions.
- Stay on-topic.
- Enhance accessibility.
- Verify information.
- Encourage meaningful discussions.
You can access the AI Wiki at the following link: AI Wiki
Let's create a thriving AI community together!
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
This bullshit propaganda is intensely frustrating. Stop pretending these models are magic. This propaganda is meant to mystify and fascinate idiots.
Here is a short reading list that will explain to a competent person how generative transformers work.
https://jaykmody.com/blog/gpt-from-scratch/#fn1
https://explainextended.com/2023/12/31/happy-new-year-15/
https://jalammar.github.io/how-gpt3-works-visualizations-animations/
https://arxiv.org/abs/1706.03762
Enough pretend-along. They aren't smarter than you.
The GPT architecture is well understood, the part that is hard to explain is the way information is encoded in the trained model's parameters. It's not magic, it's just a highly opaque encoding.