Plain English
Bias
When an AI’s output is skewed or unfair, usually because of patterns in the data it learned from.
A systematic slant in what an AI produces, such as assuming a manager is a man or describing some groups less favorably. It usually comes from the data a model learned from, and can also come from how a tool is designed or used.
Why it matters
Bias turns into unfair treatment of real customers, applicants or staff, and your business is responsible for it. Keep a person in charge of any decision about an individual.
At work
Run the same customer complaint through your reply prompt a few times with two different names. If the tone or the offer keeps changing with the name, you’ve found bias.
Think of it like a new hire trained only on old office files: they pick up the know-how, and the outdated habits along with it.
Related terms
Where it appears