A Telegram user who advertises their services on Twitter will create an AI-generated pornographic image of anyone in the world for as little as $10 if users send them pictures of that person. Like many other Telegram communities and users producing nonconsensual AI-generated sexual images, this user creates fake nude images of celebrities, including images of minors in swimsuits, but is particularly notable because it plainly and openly shows one of the most severe harms of generative AI tools: easily creating nonconsensual pornography of ordinary people.

  • echo64@lemmy.world
    link
    fedilink
    English
    arrow-up
    0
    ·
    10 months ago

    Every time this comes up, all the tech nerds here like to excuse it as fine and not a bad thing at all. I am hoping this won’t happen this time, but knowing lemmys audience…

    • Thorny_Insight@lemm.ee
      link
      fedilink
      English
      arrow-up
      0
      ·
      10 months ago

      I’m not saying it’s not a bad thing but it’s inevitable. The problem will just be getting worse and there’s no stopping it. It’s something we’re just going to need to accept as a new normal. If we can deal with living under the constant threat of nuclear armageddon then I think we can live with fake nudes aswell.

      • echo64@lemmy.world
        link
        fedilink
        English
        arrow-up
        0
        ·
        10 months ago

        Yeah it’s this shit I’m talking about. We have a whole legal and justice system to deal with this. No kne needs to accept sexual abuse as a new normal. This shit is weird.

        • Thorny_Insight@lemm.ee
          link
          fedilink
          English
          arrow-up
          0
          ·
          edit-2
          10 months ago

          I’m not saying there shouldn’t be consequences for someone who is spreading these pictures with the intention to cause harm to someone’s reputation but it’s incredibly naive to think that the justice system is going to stop deepfakes when it can’t even prevent bike theft. 12 year olds are making these with their smartphones. The technology is extremely accessible and easy to use and that is not going to change. I’m sorry but you’re not putting the toothpaste back into the tube. Wait a few years and you can generate photorealistic porn videos of anyone you want.

          • echo64@lemmy.world
            link
            fedilink
            English
            arrow-up
            0
            arrow-down
            1
            ·
            10 months ago

            We can’t stop biketheft so fuck off women, your free game coz this guy said so.