Skip to content

Comment on Black high school students sue after AI mistakes Doritos bag for gun

You are viewing one comment and its replies. View all comments

Comments

  • @draeath@lemmy.sdf.org· · edited

    School and police officials cancelled the alert, but armed police were dispatched anyway because school and police officials failed to have sufficient protocols in place to prevent cancelled alerts from triggering armed police responses.

    This case is a policy issue, and not a technology issue.

    5
    • @floofloof@lemmy.caOP· · edited

      It’s probably both. In particular, there’s a concern that if your training data is racist, your AI will be racist. And if your cops are racist, they will be selective about guarding against false positives.

      12
    • Choosing a technology known for a significant rate of serious mistakes to work without proper supervision in situations were mistakes have nasty consequences, is itself a policy issue.

      This applies just as much here as it does when the US Military used AI for target selection without proper veting and thus blew up schools full of children.

      It always boils down to humans being in decision-making positions whilst either being incompetent, corrupt or not giving a shit about the consequences for others of their choices.

      Blaming the tech is always the humans that chose to have that tech in that situation and used in that way trying to evade their responsability for that choice.

      2
      • without proper supervision

        But it was supervised, both the school staff and the police apparently caught it and tried to waive it off. The problem was that the police (different department?) proceeded anyway.

        1

Sign in to comment. Sign in