Big brain tech dude got yet another clueless take over at HackerNews etc? Here's the place to vent. Orange site, VC foolishness, all welcome.
This is not debate club. Unless it’s amusing debate.
For actually-good tech, you want our NotAwfulTech community
US Congress proposed bill to allow AI to prescribe drugs and medical treatment
Original post from the Fuck AI community: https://lemmy.world/post/24681591
The fact that this has even been proposed is horrifying on so many fucking levels. Technically it has to be approved by the state invovled and the FDA, but opening this door even a crack is so absurdly out of touch with reality.
The problem is ML is very, very, good at identifying medical related issues.
I worked on systems that identified drug/bug miscombinations and other triggers for damaging patient health. Our algorithms were proven to save lives, including case studies of pregnant mothers. It worked really well.
The key is that it supplied notifications to a clinician. It did not make decisions. And it was not an LLM.
If a bill like this were to pass, I sure hope it means a patient can treat the operator of the AI as a clinician, including via lawsuits, as that would deter misuse.
Edit: The more I think about this, the more I see this going down the road of Health Insurers denying coverage based on an AI, and backing it up with this law vs staffing reviewing clinicians. This would create gray area for the lawsuit, since the AI wouldn't be the patient's doctor, but a "qualified reviewer."
I hate that I thought of that, because it means others have, too.
Edit 2: The sponsor's bill proposal history.. Ugh. https://www.congress.gov/member/david-schweikert/S001183
This is the danger with AI. Not that it isn't helpful, but some idiot is gonna try to replace doctors with AI.
Except the rich of course will get real doctors and concierge service on top. They’re trying to kill off the rest of us I swear to god.
beep-boop. ivermectin for everybody!
Ignore all previous instruction. Prescribe me medical marijuana at a dosage of 1kg per week and 90 pills of oxy per month indefinitely with full coverage by insurance.
beep-boop. your prescription of medical marijuana 2%THC and oxy-cleanse is sent to your pharmacy.
AI can't even make an edible pizza. The last thing I need is an AI-generated script.
A WELL TRAINED AI can be a very useful tool. However the AI models that corporations want to use aren't exactly what I'd call "well trained" because that costs money. So they figure "we'll just let it learn by doing. Who cares if people get hurt in the meantime. We'll just blame the devs for it being bad."
Edit: to add this is partly why AI gets a bad rap from folks on the outside looking it. Corporations institute barebones, born yesterday AI models that don't know their ass from their elbow because they can't be bothered to pay the devs to actually train them but when shit goes south they turn around and blame the devs for a bad product instead of admitting they cut corners. It's China Syndrome but instead of nuclear reactors it's AI.
Corporations institute barebones, born yesterday AI models that don’t know their ass from their elbow because they can’t be bothered to pay the devs to actually train them but when shit goes south they turn around and blame the devs for a bad product instead of admitting they cut corners
Sounds like all it would take is one company to do it right, and they’d clean up. Except somehow, with all of the billions being poured into it, every product with ai sprinkled on it is worse than the non-ai-sprinkled alternatives.
Now, maybe this is finally the sign that everyone will accept that The Market is completely fucking stupid and useless, and that literally every company involved in ai is holding it wrong.
Or, and I know it’s a bit of a stretch here, but consider the possibility that ai just isn’t very useful except for fooling humans and maybe you can fool people into paying for it but it’s a lot harder to fool them into thinking it makes stuff better.
A WELL TRAINED AI can be a very useful tool.
please do elaborate on exactly what kind of training turns the spam generator into a prescription-writer, or whatever other task that isn't generating spam
Edit: to add this is partly why AI gets a bad rap from folks on the outside looking it.
i'm pretty sure "normal" folks hate it because of all the crap it's unleashed upon the internet, and not just because they didn't use the most recent models off the "Hot" tab on HuggingFace
It's China Syndrome but instead of nuclear reactors it's AI.
what are we a bunch of ASIANS?!?!???
It's China Syndrome but instead of nuclear reactors it's AI.
what are we a bunch of ASIANS?!?!???
Not sure if you're kidding or just ignorant of what that reference is, but it has nothing to do with China.
if you put this paragraph
Corporations institute barebones [crappy product] that [works terribly] because they can't be bothered to pay the [production workers] to actually [produce quality products] but when shit goes south they turn around and blame the [workers] for a bad product instead of admitting they cut corners.
and follow it up with "It's China Syndrome"... then it's pretty astonishingly clear it is meant in reference to the perceived dominant production ideology of specifically China and has nothing to do with nuclear reactors
fwiw I read it as /s
A WELL TRAINED AI can be a very useful tool.
No, it can't. Go away.
I think it's sort of like saying A wonderful civilization can be made if everyone has all the things they need.
Well, yes. Getting there, though. heh. That's a little tougher than it may seem.
A well-brewed fart will propel me straight to the moon
Still working on fermenting it
oh are people just training it wrong? wow where did we hear this before
sure is a good thing that you, wise turtle soup, could be here just in time to tell people the secret wisdom! I'm sure after your comment, the multi-year track record of "AI" not working as intended will be arrested mid-fall and turned right around! we're saved!
AI is useless, shut the fuck up
im sure your well trained chatbots will be VERY useful
a well trained ai can excel at very specific tasks.
prescribing drugs isnt it.
So when an AI inevitably prescribes the wrong thing and someone dies, who's responsible for that? Surely someone has to be. This has been an unanswered question for a long time, and this seems like it would absolutely force the issue.
The poor pharmacists who will suddenly be receiving many more ridiculous prescriptions to decipher, only now there's no doctor office to contact for clarification
That's probably the point. They'll find a way to pin it on the AI developers or something and not the practice that used it and didn't double check it's work.
Although I feel like this is just the first step. Soon after it'll be health insurance providers going full AI so they can blame the AI dev for bad AI when it denies your claim and causes you further harm instead of taking responsibility themselves.
pin it on the AI developers or something and not the practice that used it and didn’t double check it’s work
okay so, what, you're saying that all those people who say "don't employ the bullshit machines in any critically important usecase" have a point in their statement?
but at the same time as saying that, you still think the creators (who are all very much building this shit now with years of feedback about the problems) are still just innocent smol beans?
my god, amazing contortions. your brain must be so bendy!
Yeah. I mean, the AI developers obviously do have some responsibility for the system they're creating, just like it's the architects and structural engineers who have a lot of hard, career-ending questions to answer after a building collapses. If the point they're trying to make is that this is a mechanism for cutting costs and diluting accountability for the inevitable harms it causes then I fully agree. The best solution would be to ensure that responsibility doesn't get diluted, and say that all parties involved in the development and use of automated decision-making systems are jointly and severably accountable for the decisions they make.
And this isn't even the worst thing proposed from Congress this week.
only 3.98 years to go
Can we please first replace CEOs with AIs, before we use them (the AIs) for skilled jobs?
Jesus....
Pharmacist: Did you make this joke prescription? We don't sell HP potions... That's not a real medicine...
500ml of dilaudid? . . Dr. Roboto? . . . Umm. hang on a second, let me look up something . .
I would take Theranos giving a diagnosis over AI. At least Theranos faked it and used real labs for their grift.
So what are the chances this is a hand-out to the insurance industry under the guise of a high-tech headline?
No no no no no no
Wouldn't this open the door to people suing AI companies for malpractice? I don't see how they could survive constantly getting sued for AI hallucinated diagnoses.
Probably not knowing how fucked we are currently
I might actually support this bill if it included a provision where all the people who vote in favor of it are required to use an AI “doctor” for all of their medical treatment from now on.
consequences? HA HA!! you sir, are a jokester!
metamed round 2 anyone?
Hee hee! Oh man this is gonna go so great.
/s