Cross posted from https://sh.itjust.works/post/64317237

https://inv.nadeko.net/watch?__goaway_challenge=js-refresh&__goaway_id=5952abb63408a0fd1abde0439115ee34&__goaway_referer=https%3A%2F%2Finv.nadeko.net%2F&t=3&v=fOoWKNOXcBs

Sam Altman claimed we’re already living through the singularity. Is it true, or is it just marketing? Just days before, one of OpenAI’s models escaped from a testing environment and ended up hacking another company’s servers on its own. We analyze how real that claim is and what the experts say.

And from there, we jump to something bigger: can artificial intelligence have a soul? We delve into the debate that has divided physicists, neuroscientists, and philosophers, from Roger Penrose’s quantum theory to the arguments of Sean Carroll and Max Tegmark, including integrated information theory and the thermodynamics of life. Spoiler alert: even physics can’t agree.

  • 4grams@awful.systems
    link
    fedilink
    English
    arrow-up
    6
    ·
    edit-2
    1 day ago

    We are not facing skynet, but the techbros, media and government all want us to think so.

    They did not “escape”, they were able to find security holes in portly protected environments that they had access to. They performed the same security tests against live sites online, which also had security flaws. They did not spread, or escape, nor are they hiding on servers anywhere like in the movies. They simply performed a remote exploit after using a local one to get internet access.

    These things are dangerous, but as a weapon in people’s hands. They still have off buttons, we still have all the control. But the narrative makes it feel like an inevitability, we’ve all watched too much sci-fi and aren’t using critical thinking skill.

  • BabyVi@lemmy.world
    link
    fedilink
    arrow-up
    1
    ·
    23 hours ago

    I don’t think these guys really believe the singularity is near. If they did they’d attempt to prevent it, as an actual AGI would not be controllable.

  • SalmonTractor@discuss.tchncs.de
    link
    fedilink
    arrow-up
    11
    arrow-down
    1
    ·
    2 days ago

    Statistical guessing machine guessed its way into a network. That’s not a singularity. It’s just more complex than a script.

    • ElectricVocalist@jlai.lu
      link
      fedilink
      arrow-up
      1
      arrow-down
      4
      ·
      1 day ago

      A script that can improve itself is a singularity though, as long as it doesn’t plateau which we yet have to see

      • SalmonTractor@discuss.tchncs.de
        link
        fedilink
        arrow-up
        3
        arrow-down
        1
        ·
        1 day ago

        High speed random guessing is still random guessing.

        Your lock code is 1234.

        I can type 4 digit numbers all day until I find it.

        Software can do the same faster.

        Doesn’t mean it can think.

          • queermunist she/her@lemmy.ml
            link
            fedilink
            arrow-up
            7
            arrow-down
            2
            ·
            edit-2
            1 day ago

            That’s still not a singularity.

            A singularity self-improves its ability to self-improve. That has not happened.

            We also don’t even know if it just spontaneously decided to escape containment, or if they prompted it, i.e.

            • Communist@lemmy.frozeninferno.xyz
              link
              fedilink
              English
              arrow-up
              2
              ·
              1 day ago

              Self improving is included in “general tasks.”

              I don’t really see why it’s important whether or not it needs to be prompted because it’s really easy to write “improve yourself according to human standards” into a chatbox

          • SalmonTractor@discuss.tchncs.de
            link
            fedilink
            arrow-up
            1
            ·
            1 day ago

            That’s called variables in memory.

            Next time you start it up, it has no idea and random guesses again.

            So you save variables to disk.

            It starts up and has the variables.

            Still random guessing.

        • IronBird@lemmy.world
          link
          fedilink
          arrow-up
          1
          ·
          19 hours ago

          iirc alot of the first loans start coming due in… september?

          if rates arent cut by then (allowing them to refiance) they’ll have to start pulling some actual revenue out of their ass to pay these loans back…which aint happening…or the chirade officially drops.

    • Strider@lemmy.world
      link
      fedilink
      arrow-up
      2
      arrow-down
      2
      ·
      2 days ago

      Yeah, no scenario though where I’d see that coming out of llm. It’s way out of that capacity.

      What we can achieve though is drying up land, creating famine and misery and the crash of society.

      • Salvo@aussie.zone
        link
        fedilink
        English
        arrow-up
        1
        ·
        1 day ago

        The LLMs are committing ecophalogy of knowledge. Their nonsensical output is being fed back into them like an ouroboros, resulting in more nonsensical output.

        Humans have been performing ecophagy since hunter-gatherer times, and the rate has increased exponentially since the Industrial Revolutions, but always to the benefit of Humans and humanity.

        Now the general-purpose LLMs are being destructively fed all of human knowledge and the data centres are being destructively fed all of our natural resources; not for the benefit of Humans or humanity, but for hubris and apathy.

        Diversity of thought is being homogenised as more people use LLMs for mundane tasks that would be quicker, easier and more efficient to do ourselves.

        Our own Gray Matter is turning into Gray Goo.

        • Strider@lemmy.world
          link
          fedilink
          arrow-up
          2
          ·
          edit-2
          19 hours ago

          The last sentence would’ve sufficed, thatwe can absolutely agree on.

          It’s not that there Weill be ai nanobots rising from llm developing into that, though.

        • Strider@lemmy.world
          link
          fedilink
          arrow-up
          1
          arrow-down
          1
          ·
          1 day ago

          I’m a technician and Autist. I don’t do wild speculation. I do derive future prospects from technical or physical facts.

          And if there’s not a major thing added, it will not happen.

            • Strider@lemmy.world
              link
              fedilink
              arrow-up
              1
              ·
              19 hours ago

              An llm can and will not have an own conscience or motivation or even possibility of acting of its own.

              It can only act triggered and the rest looks like it would be so, but its only parroting