LocalLLaMA
Welcome to LocalLLaMA! Here we discuss running and developing machine learning models at home. Lets explore cutting edge open source neural network technology together.
Get support from the community! Ask questions, share prompts, discuss benchmarks, get hyped at the latest and greatest model releases! Enjoy talking about our awesome hobby.
As ambassadors of the self-hosting machine learning community, we strive to support each other and share our enthusiasm in a positive constructive way.
Rules:
Rule 1 - No harassment or personal character attacks of community members. I.E no namecalling, no generalizing entire groups of people that make up our community, no baseless personal insults.
Rule 2 - No comparing artificial intelligence/machine learning models to cryptocurrency. I.E no comparing the usefulness of models to that of NFTs, no comparing the resource usage required to train a model is anything close to maintaining a blockchain/ mining for crypto, no implying its just a fad/bubble that will leave people with nothing of value when it burst.
Rule 3 - No comparing artificial intelligence/machine learning to simple text prediction algorithms. I.E statements such as "llms are basically just simple text predictions like what your phone keyboard autocorrect uses, and they're still using the same algorithms since <over 10 years ago>.
Rule 4 - No implying that models are devoid of purpose or potential for enriching peoples lives.
view the rest of the comments
Yep and it looks like China is well on its way to being independent of the USA in the AI arms race, I just saw they are pushing out their own GPU models:
https://wccftech.com/chinese-gpu-manufacturers-push-out-support-for-running-deepseek-ai-models-on-local-systems/
Gotta say between them going all out on renewables reducing their reliance on oil and gas and all in on EV's and tech, it really feels like China has just stolen all of the EU's ideas and is straight up beating them over the head with it :(
Last time I read something about this, they were still struggling massively with production. Yes, seems they're able to manufacture those chips, but the yield is low, which makes these GPUs uneconomical. They were more a very expensive tech demo. But there isn't a lot of detailed information out there. They might have made some progress since last year. I mean China isn't stupid. And they can't rely on Nvidia chips, so from their perspective there isn't another way, they need to swallow that pill and invest whatever amount of money it takes. And I'm pretty sure they can do it. It's just questionable whether they're there yet and if they're able to keep up. I have my doubts. But all of the actual information is mixed with propaganda and hype from all sides, so it's hard to tell. But they're determined and trying hard, I think that's a fact.
But yeah, I don't think Europe is leading in a lot of things. We should make an effort, though. Especially with the things that have become rarer. Like doing things ethically. And fostering democracy and freedom with the things we do and the technology we invent...