This is a most excellent place for technology news and articles.
they're most likely splitting the AI into multiple ones that specialize in specific fields and you have to pay separately for them. before this, they nerf the general purpose AI to give the incentive for users to switch once they announce the new "Expert Programmer AI" or "Expert Stocks/Crypto Trader AI".
I'm calling it now. AI is going to become like cable.
This isn't sustainable. They're banking that nobody else is going to be able to achieve GPT-4-like quality, and what with us basically being at near the bottom of the vertical bit of the growth curve, I'd say that's a little like betting that nobody's going to be able to build a car that beats the Model T's performance. Meta is trying to tackle very large language models in the same way that they got React to be so good and widely supported: by taking it open source. Google, on the other hand, is currently working on having LLMs running natively on phones and tablets. That's not to speak of the fully open source models. Yeah, running a 1.6 trillion parameter GPT-based LLM is fucking expensive and difficult to replicate, but there are newer, more efficient techniques popping up around LLMs at a dizzying pace. It's only a matter of time before someone comes up with something that's at least as good as GPT 4.
A popular venture capital backed tech project with an unsustainable business model? Now Ive heard everything. ~/s~
Yeah, that's just crazy talk. Next you're going to tell me that they're going to start hand crafting bills and spending millions in advertising to get them passed.
Good, they should be seperate.
You don’t want a medical llm trained on Internet memes or a coding llm trained to write poetry. Specialisation exists for a reason.
Honest question, why would you want a medical LLM anyway? Other kinds of AI, sure, like diagnosis help through pattern learning on medical imaging, etc, that I can understand.
How is a language based approach that completely abstracts away actual knowledge, and just tries to sound "good enough" any kind of useful in a medical workflow?
A lot of people in the media are routinely confused about the different between AI and ordinary software. They are started to call all software "AI" now.
Can you quantify the difference? Far as I can tell, there's just an imaginary line where software becomes AI just because the logic filtering it depends on to operate is sufficiently complex. The term doesn't really seem to be a useful categorization either, e.g. the fundamentally different approaches of diffusion models and transformer models.
But the only thing it's actually good at is generating languages, if they try and pretend to know stuff in fields, they're quickly exposed as frauds.
Ah, yes, when I was a kid, I would try to read big texts I understood nothing of and imitate something similar. I thought it made me smarter.
In some sense it did - probabilities of certain words being connected in a certain way, if you make some connection between them and real entities, are useful.
I mean, it did work at school, just say some water without turning on your brain. I sometimes start talking like this when I panic after a question.
I cant express my diappointment with chatgpt, they let loose a bot that makes content farms shreek in joy but messes up basic things if their is no well treaded answer, wont give you non mainstream answers (you likely already know and watched what it tells you is "really obscure anime") And jenuinely has no tolerance for error, from you or itself
I think the fact that they are sitting on that sweet, sweet first-to-market money consoles them somewhat.
It doesn't even "know" language. Every time I see it write a poem it reads like something a 3rd grader would come up with. At the end of the day, language is way to explain your experience. An LLM doesn't have experiences.
After the leak of how their system is configured I think this makes the most sense.
The model has become inbred because it’s now impossible to scrape the web without AI content getting ingested, which is full of “hallucinations” and other weird artifacts. The last opportunity to get “uncontaminated” training data was sometime in mid 2022.
Not to say that it’s causing this particular problem, but this issue will emerge eventually. Garbage in = garbage out. Eventually GPT-19 will grow a mighty Habsburg chin.
Maybe not yet, but...
We'te getting there, hopefully.
Scrapped?... Or scraped?
absolutely scraped, fixed
Also We'te, which I believe is a Klingon name.
That hasn't happened yet. Most likely they quantized GPT-4 more. It's still based on the same training data.
The lobotomies will continue. Free models will keep getting better.
The chatgpt people are really paranoid. Gpt-3 is so good at not halucinating that it often cant, even if it needs to do so to accomplish a task. Fearing the ai will confidently give the wrong answer.
Not the first time OpenAI has done this. DALLE2 used to be the best AI art program in the world. Then OpenAI decided that they didn't want to get sued by celebrities, so they made it so that if a face came out that resembled a celebrity, it would be distorted. But every face kind of looks like someone famous. Ta da! Now DALLE2 can't do faces.
Want a crane shot areal image of a teen couple in a corvette driving off into the sunset? Well, you are now banned for life from the DALLE2 service, because DALLE2 produced an image of a 'shot teen' and that violates it's terms of service.
Dalle2 was always kind of shit tbh.
Dalle2 was great when it was free and stable diffusion didn't exist. I don't see the logic of: "Someone made a free version. Lets make the program worse and charge money for it!"
The only way in mind this dumbing down happens is by fumbling with the model. So that's the one thing we can be sure: the AI is most definitely changed while publicly staying "ChatGPT 4". I assume they are either using clipping or token limitations to split the server load but fucking up the result, or they are purposely dumbing it down to capitalise on it later by introducing other pay models like ppl already mentioned.
Either way they are shooting themselves in the foot because a bunch of ppl will unsubscribe either out of spite for the change or because it's just not worth it anymore for them.
AI taking a running leap at enshittification.
Some people have been saying that since the beginning while some haven’t noticed this “decline”. It seems very subjective.
Honestly as a daily user I think it's a combination of it getting worse at understanding vague prompts and people bumbing up against edge cases more. I would suspect the former is due to things like prompt hardening but can only speculate, while the latter isn't hard to imagine just from frequent use.
You know how we have pre-bomb steel? We'll have pre-GPT data sets.
lmao I was write back then :D
You mean "I was right* or "i wrote*"?
No no, he used to work as a wright. Built ships and shit.
Yeah, when I first started using GPT-4, I didn't notice any hallucinations. Now I'm getting them all the time. Disappointing.
Just like most people after they achieve success.
