This story is written like it vindicates AI medicine but really it seems like the human medical system dropped the ball on the MRI. ChatGPT didn't have any brilliant insight, it just (eventually) suggested the same thing a human doctor had already suggested, but this time the author and his wife pushed harder for it to happen.
To use the metaphor from the article, they found the keys in the last place they looked.
this is one case. there's no proof here that AI will generally do better than human doctors. consider also that the power it has to convince people to push for better medical treatments can also be used to push for worse ones, or to halt standard treatment entirely, at which point it is much harder for the medical system to intervene as they aren't interacting with doctors.
It feels like moving toward a local maxima. In this example the LLM advice outperformed one doctor who dropped the ball in some ways, but I do not look forward to a world where we make it even more difficult to talk to doctors, and route most medical interactions to LLMs. I expect that in 5 years I'll be futilely shouting "representative" into my phone as my appendix ruptures.
With this sort of advice from LLMs, I think there's a lot of selective recall that's easily overlooked -- where we gloss over all the bad, dead-end lines of advice we seek from the LLM oracle.
ForHackernews · · focus · HN ↗
To use the metaphor from the article, they found the keys in the last place they looked.
saulpw · · focus · HN ↗
peesem · · focus · HN ↗
nerevarthelame · · focus · HN ↗
With this sort of advice from LLMs, I think there's a lot of selective recall that's easily overlooked -- where we gloss over all the bad, dead-end lines of advice we seek from the LLM oracle.