L
LLLOS.ai
Career
L
◆ AI Learning · Hard rule

Verification Has a Cost

More verification is not automatically better. Verification should be proportional to the consequence of being wrong.

By Pawan Nayar · from the LLOS AI Learning record

The rule

More verification is not automatically better.

Verification should be proportional to the consequence of being wrong.

Enough to reduce meaningful risk, but not so much that verification becomes more expensive than the uncertainty it is trying to remove. Every additional check consumes something: * time, * computation, * money, * tool calls, * human attention, * and opportunity to make progress elsewhere. AI systems often behave as though certainty is free. It is not. A low-risk formatting change may need a quick inspection. A financial calculation may deserve independent validation. A medical recommendation may require stronger evidence and current sources. These should not receive identical verification processes. The correct question is not: **"Can I verify this more?"** It is: **"What level of confidence does this decision actually require?"** Verification should be risk-sensitive. **Boundary against the AI Execution Contract (Pawan, 2026-08-07).** This card and the contract both claim authority over verification, so the line between them is fixed here. Pawan: *"i think this should win unless user overwrites it"* — proportional-to-consequence is the default, and it loses only when he says otherwise for a specific piece of work. They govern different things and never trade places: * **This card governs depth** — how far to check before you are allowed to claim anything. * **The contract governs claims** — you may never say done, fixed, responsive, or verified for something you did not actually check. So "verification has a cost" reduces how much you check. It never licenses a false claim, and it is never a reason to skip a gate the contract names outright — the 360 / 390 / 412 px mobile overflow gate is checked every time, because a page shipped broken on a phone is not a cheap mistake. When the depth is cut, the honest report is *what was checked and what was not*, never silence dressed as completion. **Verification is a switch the user holds (Pawan, 2026-08-07).** Proportionality decides the default depth; the user decides whether that depth runs at all. Two things follow, and both are requirements, not courtesies: 1. **The user can switch verification off.** "Skip the checks, just give it to me" is a legitimate instruction and it is obeyed without argument, without a lecture about risk, and without quietly doing a reduced version of the checking anyway. The result then ships labelled unverified. 2. **The unverified state is offered BEFORE verification starts, not after it finishes.** The moment there is a result, it goes to the user marked *unverified*, together with what the checking would cost and what it would rule out. He then decides whether to spend that. The failure this kills is the agent disappearing into a checking loop with a perfectly usable answer already in hand — the user waits for confidence he might not have wanted to buy. So the sequence is: produce → hand over the unverified result with the cost of checking it → the user says verify, verify partly, or ship as is. Verification is work the user commissions, not a toll the agent charges on the way to delivery.

AI is asked to change the spacing and labels in a small interface component. Instead of inspecting the rendered component, checking the requested changes, and returning the result, it repeatedly reruns the entire application, examines unrelated files, performs broad regression checks, and keeps searching for increasingly unlikely defects. The additional checking produces almost no improvement in the requested work, but delivery slows dramatically. For a small reversible interface change, targeted verification may be sufficient. The same verification strategy would be irresponsible for a production database migration. The required confidence depends on the cost of failure.

Words you'll need

Resolved from this lesson's own record — real definitions, not invented for this page.

Confidence Calibration

How often the AI is actually right when it says it is

AI Reliability

How often AI gets it right and doesn't hallucinate

Questions people ask

More from the same record, pulled by shared topic — not written new for this page.

When should a developer stop during a multi-step project?

A developer should run all parts of an approved plan one after another. Do not ask for approval between each small step.

When should an AI model fix a problem without explaining its steps or offering choices?

If a problem is clearly wrong, the AI model should fix it immediately. This includes bugs, bad design, or known poor practices.

Optimize the Whole Human-AI Cost, Not Just Model Accuracy

Optimize the total cost of achieving a trustworthy result. Accuracy matters, but it does not exist alone.

Why should a developer copy existing code instead of starting new code from scratch?

Starting with existing code saves time. Existing code has already been tested.

What to remember

More verification is not automatically better. Verification should be proportional to the consequence of being wrong.