A mother and her 14-year-old daughter are advocating for better protections for victims after AI-generated nude images of the teen and other female classmates were circulated at a high school in New Jersey.

Meanwhile, on the other side of the country, officials are investigating an incident involving a teenage boy who allegedly used artificial intelligence to create and distribute similar images of other students – also teen girls - that attend a high school in suburban Seattle, Washington.

The disturbing cases have put a spotlight yet again on explicit AI-generated material that overwhelmingly harms women and children and is booming online at an unprecedented rate. According to an analysis by independent researcher Genevieve Oh that was shared with The Associated Press, more than 143,000 new deepfake videos were posted online this year, which surpasses every other year combined.

  • Sharkwellington@lemmy.one
    link
    fedilink
    arrow-up
    62
    ·
    1 year ago

    Right, there are plenty of reactive measures available but the only proactive measures are either restricting availability of the source photos used or restricting use of the deep fake tools used. Everything beyond that is trying to put the genie back in the bottle.

    • MagicShel@programming.dev
      link
      fedilink
      arrow-up
      31
      ·
      1 year ago

      It’s not possible to restrict deep fake technology at this point. It’s out there. Accessible to everyone who wants it and has a computer at home.

      • Sharkwellington@lemmy.one
        link
        fedilink
        arrow-up
        4
        ·
        1 year ago

        And that’s the point I was making, nobody can be “protected” from widely available photos being used on widely available programs. Best we can do is deter but that isn’t a guarantee.

    • cannache@slrpnk.net
      link
      fedilink
      arrow-up
      1
      ·
      1 year ago

      Are we seriously going to try and use someone’s photos for dumb shit like this? Cone on, people just want something to wank to or someone to call over to have sex with, who the hell would actually do this?

      • CommanderCloon@lemmy.ml
        link
        fedilink
        arrow-up
        7
        ·
        edit-2
        1 year ago

        Well evidently the answer to your last question is " some people". Your point would only make sense if all this was hypothetical