Fuck AI

The key is considering who is going to be using these systems. Certainly Google search AI is never going to be useful in this way because the kind of info a patient needs is very different to what a doctor would find useful.

And if we do make systems for doctors, then it's pretty damn important that we consider things like you have, taking into account that doctors are already overwhelmed and spending way too much effort juggling medical notes. I read a thing a while back which highlighted how many doctors are struggling with information management and processing all the info they need to because of how IT systems have tended to be enforced on them from the top down, with some doctors even saying paper notes were far easier to deal with (especially for complex cases). Digitisation definitely has huge benefits, but it seems like the needs of doctors have been largely ignored.

Even besides doctors, I feel like the field of Human-Computer Interaction (HCI) has been way too focussed on ways of wringing out more money from people, with not enough focus put on how we can make technology that empowers people. It's no wonder why: If I were a HCI researcher, I know what kind of project would be more likely to get research funding, and it's the ruthlessly capitalistic ones.

"An 80% false positive is still quite useful, so long as the 20% helps and the rest is easy for a human to filter."

This gets at a key point, in my opinion — even when one ignores the straightforwardly scammy "AI" nonsense, a lot that remain are still overly focussed on building systems that do stuff for people (usually in a way that would eliminate or reduce people in the process. Many examples of this exist, but one is "AI teachers" which still requires a human in the room, but only as a "learning facilitator" or some nonsense). I work in a field where machine learning has been a prominent thing for years, so I'm in a weird place of being sick of hearing about AI, and also impressed by what we do have. Mainly though, I'm exasperated because we could be doing so much more with the tech we have if we made tools that were intended to be used by humans.

Humans are dumb and emotional and silly, but we are also pretty cool and we can make awesome things when given the opportunity to. I will always be cynical about tech that seems over keen to cut humans out of things