• ngwoo@lemmy.world
    link
    fedilink
    English
    arrow-up
    3
    ·
    4 months ago

    Weird that it actually made note of that but didn’t put it in the summary

    • Buddahriffic@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      ·
      4 months ago

      It’s because it has no idea what is important or isn’t important. It’s all just information to it and it all carries the same weight, whether it’s “parachutes aren’t any more effective than empty backpacks” or “this study is a satire making fun of other studies that extrapolate information carefully”. Even though that second bit essentially negates the first bit.

      Bet the authors weren’t expecting their joke study to hit a second time like this, demonstrating that AI is just as bad at extrapolating since it extrapolated true information from false.

      It’s reckless to use these AIs in searches. If someone jokes about pretending to be a doctor and suggesting a stick of butter being the best treatment for a heart attack and that joke makes it into the training set, how would an AI have any idea that it doesn’t have the same value as some doctors talking about patterns they’ve noticed in heart attack patients?