Anchoring Bias
The tendency to rely disproportionately on the first piece of information encountered (the “anchor”) when making subsequent estimates or judgments. Later adjustments from the anchor are systematically insufficient.
Origin
First described by Amos Tversky and Daniel Kahneman in their seminal 1974 paper “Judgment Under Uncertainty: Heuristics and Biases” (Science, 185, 1124–1131). One of the foundational demonstrations of the heuristics-and-biases research program.
Classic experiment: subjects asked to spin a wheel (rigged to land on 10 or 65), then estimate what percentage of African countries are in the UN. Median estimates: 25% (low anchor group) vs. 45% (high anchor group). The wheel result — demonstrably irrelevant — shaped their estimates.
Mechanism
The mind uses the anchor as a starting point and adjusts upward or downward. The adjustment is almost always insufficient — estimates remain closer to the anchor than warranted by the evidence. This persists even when:
- The anchor is known to be arbitrary
- Subjects are warned about anchoring
- Subjects are experts in the domain
Intelligence Analysis Context (per CIA Tradecraft Primer (2009))
Named directly in the primer’s cognitive bias taxonomy:
“Probability estimates are adjusted only incrementally in response to new information or further analysis.”
In analytic practice: anchoring to an initial assessment is one of the most common sources of analytic failure. Once an early judgment is formed (the anchor), subsequent evidence tends to be interpreted as adjustments rather than potential replacements of the original view.
LLM Agentic Systems Context
LLM agents exhibit strong anchoring behavior in multiple dimensions:
- Prompt anchoring: the framing of the initial prompt disproportionately shapes all subsequent reasoning
- Context window anchoring: the first interpretation of an ambiguous task propagates through the agent’s chain-of-thought
- Prior turn anchoring: in multi-turn interactions, the agent’s own prior output acts as an anchor for its next response
- Self-consistency anchoring: agents trained with RLHF show reduced willingness to revise initial outputs, even when shown contradicting evidence
See SATs for LLM Agents for SAT-based mitigations.
SATs That Control For This Bias
- Key Assumptions Check — forces explicit examination of the initial analytic line as an assumption to be challenged, not a baseline to adjust from
- Analysis of Competing Hypotheses (ACH) — builds all hypotheses simultaneously before evaluating evidence, preventing any single hypothesis from becoming an anchor
- What If? Analysis — assumes a different outcome has already occurred, displacing the current estimate as the anchor
- Brainstorming — deferred judgment rule prevents any early idea from becoming an anchor before alternatives are generated
Key References
- Tversky, A. & Kahneman, D. (1974). “Judgment Under Uncertainty: Heuristics and Biases.” Science, 185(4157), 1124–1131.
- Kahneman, D. (2011). Thinking, Fast and Slow. Farrar, Straus and Giroux. (Chapter 11: “Anchors”)
- Richards j. heuer jr. — The Psychology of Intelligence Analysis (1999), pp. 111–113
Empirical Evidence (LLM)
| Study | Finding |
|---|---|
| Echterhoff et al. (BiasBuster, 2024) | Direct measurement of anchoring across commercial and open-source models using a 13,465-prompt dataset. Anchoring is one of the strongest measured effects. Self-debiasing prompts (asking the model to identify and counter its own bias) reduce the effect. |
Implication for SATs: KAC-style prompts that surface prompt-embedded anchors have empirical support. See H3.
See Also
Cognitive Bias | Confirmation Bias | Overconfidence Bias | Mind-Set