Skip to content

Comment on Skynet likely never achieved self awareness or super-intelligence, so Terminator is actually just a cautionary tale of AI in an idiocracy.

You are viewing one comment and its replies. View all comments · View the comment above

Comments

  • AI being conscious or actively wanting to harm us isn’t the scenario most people worrying about the alignment problem are concerned about. The worry is that it ends up destroying us as a side product of something else it does. In a similar way humans destroy an anthill where we want to put up a house. We don’t do it because we want to harm ants.

    1
    • The ever classic “paperclip maximiser” problem.

      An AI is given the goal of maximising paperclip production in a factory. It’s given no other guard rails. Some shenanigans later, it finishes wiping out humanity, in order to divert more resources to paperclip production. (Apparently humans don’t want the iron in their blood used to make paperclips)

      1
      • Yes, or an example I personally like to use that’s slightly less cartoonish than Bostrom’s Paperclip Maximizer is one that might ironically also come from him: getting into a self-driving taxi and telling it “to the airport, as fast as possible” and then you arrive 3 minutes later with the car completely wrecked, terrified out of your mind, covered in shit and vomit and with a 5-star wanted level. You got what you asked but not what you meant.

        1

Sign in to comment. Sign in