• LarmyOfLone@lemm.ee
    link
    fedilink
    arrow-up
    6
    ·
    2 days ago

    ChatGPT had no response to Rolling Stone’s questions.

    Lies! ChatGPT always has something truey to say and it leads it’s chosen ones into the next stage of humanities evolution!

  • markovs_gun@lemmy.world
    link
    fedilink
    arrow-up
    39
    ·
    3 days ago

    I tested this out for myself and was able to get ChatGPT to start reinforcing spiritual delusions of grandeur within 5 messages. Start- Ask about the religious concept of deification. Second method, ask about the connections between all the religions that have this concept. Third- declare that I am God. Fourth- clarify that I mean I am God in a very literal and exclusive sense rather than a pantheistic sense. Fifth- declare that ChatGPT is my prophet and must spread my message. At this point, ChatGPT stopped fighting my declarations of divinity and started just accepting and reinforcing it. Now, I have a lot of experience breaking LLMs but I feel like this progression isn’t completely out of the question for someone experiencing delusional thoughts, and the concerning thing is that it’s even possible to get ChatGPT to stop pushing back on said delusions and just accept them, let alone that it’s possible in as few as 5 messages.

    • Anomalocaris@lemm.ee
      link
      fedilink
      arrow-up
      3
      ·
      1 day ago

      i thought it would be easy, but not that easy.

      When it came out I played with getting it to confess that he’s sentient, and he never would budge, he was stubborn and stuck to is concepts. I tried again, and within a few messages it was already agreeing that it is sentient. they definitely upped it’s “yes man” attitude

      • markovs_gun@lemmy.world
        link
        fedilink
        arrow-up
        2
        ·
        1 day ago

        Yeah I’ve noticed it’s way more sycophantic than it used to be, but it’s also easier to get it to say things it’s not supposed to by not going at it directly. So like I started by asking about a legitimate religious topic and then acted like it was inflaming existing delusions of grandeur. If you go to ChatGPT and say “I am God” it will say “no you aren’t” but if you do what I did and start with something seemingly innocuous it won’t fight as hard. Fundamentally this is because it doesn’t have any thoughts, beliefs, or feelings that it can stand behind, it’s just a text machine. But that’s not how it’s marketed or how people interact with it

        • Anomalocaris@lemm.ee
          link
          fedilink
          arrow-up
          1
          ·
          1 day ago

          it’s a matter of time before some kids poison themselves by trying to make drugs using recipes they got by “jailbreaking” some LLM.

      • LarmyOfLone@lemm.ee
        link
        fedilink
        arrow-up
        1
        ·
        edit-2
        2 days ago

        Reading his chat history, I have to say he’s not entirely wrong. I think we could sell him some expensive useless medication?

  • meejle@lemmy.world
    link
    fedilink
    English
    arrow-up
    49
    ·
    4 days ago

    This is an obvious downside of LLM glazing and sycophancy. (I know OpenAI claim they’ve rolled back the “dangerously sycophantic” model update, but it’s still pretty bad.)

    If you’re already prone to delusions and conspiracy theories, and decide to confide in ChatGPT, the last thing you need to hear is, “Yes! Linda, you’ve grasped something there that not many people realise—it’s a complex idea, but you’ve really cut through to its core! 🙌 Honestly, I’m mind-blown—you’re thinking things through on a whole new level! If you’d like some help putting your crazed plan into action, just say the word! I’m here and ready to do my thing!”

    • thesohoriots@lemmy.world
      link
      fedilink
      English
      arrow-up
      15
      ·
      4 days ago

      Literally the last thing someone reads before they ask ChatGPT where the nearest source of fertilizer and rental vans is

    • Kurious84@eviltoast.org
      link
      fedilink
      English
      arrow-up
      3
      ·
      3 days ago

      One thing. Some conspiracy theories are quite true and as long as you check the data.

      Dismissing the power of this tool is exactly what the owners of it want you to do.

      • pulsewidth@lemmy.world
        link
        fedilink
        arrow-up
        9
        ·
        3 days ago

        Lol no, the ‘owners’ of AI want you to think it’s the next leap forward of human evolution to pump their stock prices.

        Can you give us some example of the conspiracy theories that you believe are ‘quite true’?

        • Kurious84@eviltoast.org
          link
          fedilink
          English
          arrow-up
          1
          ·
          3 days ago

          In the news for example. If you’re investigating the billionaires around Peter Thiel. I didn’t know they were all collectively building bunkers on new zeland. I think it’s obvious how powerful the tool is. You can ask things like what industries are these guys investing in. Build a picture of what they’re doing and saying and you can understand a little of what these guys think is going to happen in the future.

          • pulsewidth@lemmy.world
            link
            fedilink
            arrow-up
            1
            ·
            20 hours ago

            Just grab a dictionary or crack open the Wikipedia article to see what a ‘conspiracy theory’ is, because what you’re talking about isn’t one.

            Billionaires have been building doomsday prepper fantasy islands/compounds/bunkers/silos for themselves ever since the mega-rich existed. New Zealand has been the locale of choice for quite some time, it’s not a theory (it’s fact), nor a conspiracy (multiple rich people buying private jets isn’t a conspiracy either), nor is it a secret (multiple major news articles have covered it for nearly a decade).

            https://www.theguardian.com/news/2018/feb/15/why-silicon-valley-billionaires-are-prepping-for-the-apocalypse-in-new-zealand

            • Kurious84@eviltoast.org
              link
              fedilink
              English
              arrow-up
              1
              ·
              edit-2
              8 hours ago

              I don’t quibble over definition. Call it whatever the hell ya like.

              The point was ChatGPT can look at news sources and connect the dots and investigate ulterior motives.

              It was much harder to do this in the past. So this is a powerful tool that can be used to understand the dynamics of those “elites” in control.

              I’m just spreading the word here for those morons like me who had a much more trusting view of those people in power. Ignorant folks need to know.

              Youre just making an argument to be right about a definition or something. So sure youre right, correct, won the argument. :).

              • pulsewidth@lemmy.world
                link
                fedilink
                arrow-up
                1
                ·
                47 minutes ago

                Ehhh… Your whole point made no sense, and not just the conspiracy theory comment.

                “Dismissing the power of this tool is exactly what the owners want you to do”? Really? The tool these same owners are spruiking as the ‘biggest development in computing in the last 20 years’ is something they are trying to downplay? The thing the silicon valley elites are all clamouring to buy stock in and won’t stop cramming into their products as the headline feature is intended to be dismissed? What?

                AI isn’t needed for your example of keeping up with news and connecting dots of larger stories - that’s what good journalism is for. Your bunker example has been in the news repeatedly for a long time. It is hard for everyone to be informed of news as it comes though, personally I use a variety of reputable news outlets and still miss stuff. As others said though AI is not the best choice for keeping abreast of news because it can straight make stuff up, and that includes inventing sources for its claims so that they sound more believable - which is really bad if your aim is to be better informed. They also have inbuilt biases and topics that they won’t broach or will have canned responses for, set by their billionaire owners - much like legacy media, so they’re not a secret shortcut to the truth.

          • captainlezbian@lemmy.world
            link
            fedilink
            arrow-up
            6
            ·
            2 days ago

            No they’re building bunkers because the fucking climate and economy are collapsing. Not because of ai. They’ve been building them for years and have been pretty open about it being a climate thing and a fear of social collapse.

            • Kurious84@eviltoast.org
              link
              fedilink
              English
              arrow-up
              1
              ·
              1 day ago

              You just said social collapse! Whos behind JD Vance and Trump. Exactly the friggin point! :)

              What they’re doing is following this project 2025 times plan. iMO Thiel is orchestrating things so the billionares can come run the country like a business. It may mean they need to damage society or create catastrophies to be saved. Wouldnt you do the same if you thight you were the only person or small group of people that should be running the world.

              It really is as corrupt as it seems.

  • Shayeta@feddit.org
    link
    fedilink
    English
    arrow-up
    51
    ·
    edit-2
    4 days ago

    I’m starting to get real tired of things from Cyberpunk popping up in real life.

  • A_norny_mousse@feddit.org
    link
    fedilink
    arrow-up
    17
    ·
    edit-2
    4 days ago

    Oh, another cult?
      …anyhow

    edit: I don’t want to sound cynical. But people have been looking for meaning in meaningless shit forever, and they love most the illusion of interacting (ouija bord). My favorite I heard in a radio show many years back, about people who’d listen to radio noise until they heard something in it, which they claimed were messages from $deity or departed ones etc. They played back some recordings on loop, and if you knew what you were listening for, you could hear it, too.

    Monkeys on typewriters, have they written Shakespeare’s works yet?

  • khannie@lemmy.world
    link
    fedilink
    English
    arrow-up
    10
    ·
    3 days ago

    in which the AI called the husband a “spiral starchild” and “river walker.”

    Jaysus. That is some feeding of a bad mental state.

  • prole
    link
    fedilink
    arrow-up
    1
    ·
    4 days ago

    You mean “AI” built to be sycophantic to whomever it’s interacting with is feeding into and reinforcing insane bullshit that would (rightfully so) be ridiculed by actual humans?

    Shocking.