Thread

1. sandworm101 · 1790965439 · focus · HN ↗

   >> balance between live help vs after-visit

   Don't forget pre-visit. Doctor visits go much better if the patient advocate (this thing) has questions in hand. The patient can spend hours talking to the tool and get a summary so they are better prepped for the 5-minute doctor conversation. A tool that summarizes observed symptoms for the doctor might be an idea.

   1. rancar2 · 1790966821 · focus · HN ↗

      Doctors are good with getting a shorthand note they can scan prior to appointment about updates, etc reverent to the appointment that day. My experience is that AI models even with expert curations cannot currently do well by itself and would waste a doctor’s time and could be misleading too. As such as noted by the parent comment, that note would need to be summary sheet that AI touches would have to list facts and context with patient review that it accurately would represents what the patient would say in their own words.

      Pro tip: check out the NoHarm benchmark and tracking to see how the current models are generally trending on the medical frontier. Make sure to select Clinical not General: <a href="https:&#x2F;&#x2F;www.arise-ai.org&#x2F;mast" rel="nofollow">https:&#x2F;&#x2F;www.arise-ai.org&#x2F;mast

      And if you look at some the data carefully as one of the models highlights on their blog, there’s concerning behavior for Fable on this front: <a href="https:&#x2F;&#x2F;www.amboss.com&#x2F;us&#x2F;newsroom&#x2F;noharm" rel="nofollow">https:&#x2F;&#x2F;www.amboss.com&#x2F;us&#x2F;newsroom&#x2F;noharm

      1. nikilr · 1790969131 · focus · HN ↗

         Yes we&#x27;ve taken a look at this. In fact we had a pretty good test case from our teammate&#x27;s real visit where the text to speech was mistranscribed (despite using a medical model) to the point where it looked like the doctor said to eat a topical steroid. However, because of that case and a few other complicated cases in our internal benchmarks, we&#x27;ve made the after visit prompt much more reliable, both identifying and cleaning up mistakes in the transcript, and marking points where you really ought to confirm with your doctor if it&#x27;s unclear from context what it was actually supposed to be.

         Please try it out and lmk what you think! We would love your feedback!

         Note that our tool is not diagnosing or prescribing, simply noting what the doctor said and giving suggestions to the patient of useful questions to ask and contextual plain English definitions of medical jargon

      2. pandan_doctor · 1790993659 · focus · HN ↗

         Thanks for the thoughts! I’m one of the co-founders and a practicing physician. One of the big gaps with medical AI benchmarks like NoHARM, MAST is they are all primarily tuned for clinician reasoning and none of them look at the patient context and perspective. It&#x27;s a huge gap right now.

Unofficial Hacker News client; not affiliated with Y Combinator.