← Glossary

Automation bias

The human tendency to trust the machine even when it is wrong. The danger is not that AI replaces your expertise but that it lulls it into disuse.

Give an experienced endoscopist an AI that highlights polyps, then take it away, and their detection rate falls by six per cent against where they started. The skill did not vanish. It went unexercised, because the machine was doing the looking. That is automation bias: the human tendency to trust the machine even when it is wrong, and to stop checking once it has been right often enough.

For a key account manager the equivalent is the research pack that reads well, the draft proposition that sounds right, and the growing habit of not reading the annual report because the summary was there. The danger is not that AI replaces your expertise. The danger is that AI lulls your expertise into disuse, and the skill you need to catch a hallucination is the one that atrophies first.

Set out in full in: Creating Customer Value Propositions with AI (Kogan Page, 2027), chapter 2.

Related terms

See the method run on one real account in three days: the One Page Proposition.