OpenAI’s Whisper tool may add fake text to medical transcripts, investigation finds.

  • SpikesOtherDog@ani.social
    link
    fedilink
    arrow-up
    13
    ·
    2 months ago

    I work in judicial tech and have heard questions of using AI transcription tools. I didn’t believe AI should be used in this kind of high risk area. The ones asking if AI is a good fit for court transcripts can be forgiven because all they see is the hype, but if the ones responding greenlight a project like that there will be some incredibly embarrassing moments.

    My other concern is that the court would have to run the service locally. There are situations where a victim’s name or other information is redacted. That information should not be on an Open AI server and should not be regurgitated back out when the AI misbehaves.

    • FatCrab@lemmy.one
      link
      fedilink
      arrow-up
      3
      ·
      2 months ago

      Don’t court stenographers basically use tailored voice models and voice to text transcription already?

      • SpikesOtherDog@ani.social
        link
        fedilink
        arrow-up
        2
        ·
        2 months ago

        I don’t get too technical with the court reporter software. They have their own license and receive direct support from their vendor. What I have seen is that there is an interpreting layer between the stenographer machine and the software, literally called magic by the vendor, that is a bit like predictive text. In this situation, the stenographer is actively recording and interpreting the results.