50
Zuckerberg wants to build artificial general intelligence with 350K Nvidia H100 GPUs
(www.theregister.com)
this post was submitted on 20 Jan 2024
50 points (83.8% liked)
Free Open-Source Artificial Intelligence
3066 readers
1 users here now
Welcome to Free Open-Source Artificial Intelligence!
We are a community dedicated to forwarding the availability and access to:
Free Open Source Artificial Intelligence (F.O.S.A.I.)
More AI Communities
LLM Leaderboards
Developer Resources
GitHub Projects
FOSAI Time Capsule
- The Internet is Healing
- General Resources
- FOSAI Welcome Message
- FOSAI Crash Course
- FOSAI Nexus Resource Hub
- FOSAI LLM Guide
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Is Zuckerberg an idiot? Or does he have an actual plan with this?
Seems to me it's completely useless like Metaverse.
If the LLM is so stupid it can't figure out the sides of an equal sign can be reversed as simple as in 2+2=4 <=> 4=2+2. He will never achieve general intelligence by just throwing more compute power at it.
As powerful as LLM is, it's still astoundingly stupid when it hits its limitations.
I don't know much, but from what I know, we still haven't reach a point of diminishing returns, so more power = more better.
There is a lot of theoretical work on this problem, but I'm in the camp that isn't convinced large language models are the path towards general intelligence.
Throw 10x the computing power on it and it might learn that a maths equation is reversible, because it will probably have seen enough examples of that. But it won't learn what an equation represents, and therefore won't extrapolate situations that can be solved by equations.
You can already ask ChatGPT to model a real life scenario with a simple math equation. There is at least a rough model of how basic math can be used to solve problems.