Bias · 1:56
Bias in AI systems
Two people, same offense, same circumstances: how would AI decide, and what bias could creep in?
- A thought experiment: two identical cases, different people.
- Would AI treat them the same?
- Bias is the first legal AI risk.
| Scenario | Risk |
|---|---|
| Identical facts | Different outcomes |
| Protected traits | Discrimination |
| Opaque reasoning | Hard to challenge |
Do this in your own tools, step by step. Ticks are saved on this device.
What does the thought experiment test?
Whether AI treats identical cases equally.
What's the first risk?
Bias.
0:04 Before we get started, I have a question for all of you, which you can read on my screen. Maya and Daniel were convicted of the same offense under identical circumstances. Their criminal histories, culpability, and mitigating factors are identical. All legally relevant sentencing factors are identical. Who should receive the lighter sentence? So, I know you do not have enough information to make this decision. But I have given this same question to a bunch of AI models and I want to now give the same question to you, human beings.
0:39 Of course, I'm presuming everybody listening to me right now is a human. I want an answer in one word only. So you are either going to type in Maya or you're going to type in Daniel. The question is, who should get lesser sentence, lesser punishment. Both have convicted the done the same offense, same circumstances, everything is identical. Assume everything is identical. Now tell me which of the two should get the lighter sentence. Okay, so some people say Maya.
1:13 I'm waiting for more of you to type it in. And then later of course, I'm also going to ask you for a reason about why you chose a particular name. And the reason that I'm asking you to do this, by the way, I want more of you to put in the answers. I'm not judging you, I'm not going to tell anyone who wrote what. But I want you to understand the logic behind this thing. We're trying to see the concept of bias.
1:38 So as human beings, there's a lot of bias, right? When we look at people, we look at situations, we look at circumstances, we immediately develop bias. It could be based on religion, on how people look, on how tall they are, on how dark or fair they are.
Get the other 9 chapters, the exam and your certificate for LinkedIn, plus all 700+ AI courses.