Understand · Judgment & risk

Judgment & risk

What AI should never decide without human review

Pricing, contracts, compliance and anything you can’t undo.

5 min readPlain English

Read it in

In one sentence

AI can draft, sort and suggest, but a person makes the final call on money, contracts, compliance, decisions about people and anything you can’t undo.

Think of it like…

A good trainee can draft the quote, prepare the contract and sort the mail. You still set the price, sign the contract and decide who gets hired. Give AI the trainee’s job, not yours.

How it works

Sort each task by two questions: what happens if it’s wrong, and can you undo it? The answers put it on one of four levels.

  1. 1AI draftsLow stakes and easy to fix, like internal notes, first drafts and ideas. AI does the work; you skim it.
  2. 2A person checksAnything a customer sees, or anything with a name, number or date. A person reads and corrects it before it’s used.
  3. 3A person decidesPrices, refunds, contracts, legal or compliance wording, hiring and pay. AI can lay out the options; a named person makes the call.
  4. 4A person actsAnything you can’t undo: payments, deletions, signed agreements, cancellations. No AI tool does these alone, even if the settings allow it.

When in doubt, move a task one level stricter until you’ve seen it work on real cases.

Good at, bad at

Good at

  • Laying out the options, with pros and cons
  • Flagging questions to ask about a contract or quote
  • Drafting the routine version for you to approve

Bad at

  • Knowing your context: a loyal customer, a past promise, a tight month
  • Taking responsibility when it’s wrong
  • Knowing current rules and rates where you operate

Where you’ll see it at work

  • Quotes at a plumbing firm. AI drafts the quote from the job notes. The owner checks every price against the price list before it’s sent.

  • Refunds at an online shop. The assistant suggests yes or no, with a reason. A person approves each one, because it moves money.

  • Hiring at a design studio. AI helps write the job ad and interview questions. People read every application and make every decision.

Myth vs reality

Myth: “Once it’s been right for a month, it can decide on its own.”

Reality: A good track record shows where it’s reliable, not that it’s accountable. For money, contracts and anything you can’t undo, the rare mistake is what costs you, so a person still signs off.

Words to know

Human in the loopAgentAutomationHallucinationPrompt injection
Test yourselfNo grades

Which of these tasks is fine to leave to AI with only a quick skim?

In the news this week

From understanding to doing