Devil’s Advocacy
A SAT that challenges a single, strongly held view or consensus by building the best possible case for an alternative explanation.
Purpose
Provide a check on dominant mind-sets that can develop among even the best analysts. Primary value: compel analysts to review information with greater skepticism and expose hidden assumptions.
When to Use
- When there is a strong analytic consensus or widely-held view on a critically important question
- When a group has worked on an issue for a long period (strong mind-set is likely)
- On issues where you cannot afford to be wrong
- When a manager wants to reaffirm the group’s confidence in their judgments
Method
The Devil’s Advocate must:
- Outline the mainline judgment, key assumptions, and supporting evidence
- Select one or more assumptions that appear most susceptible to challenge (stated or unstated)
- Review information for questionable validity, possible deception, or major gaps
- Highlight evidence that could support a contrary hypothesis
- Construct the strongest possible alternative case
- Present the alternative with full rigor — not as a straw man
Possible Outcomes
The analyst may come away:
- More certain the current analytic line is sound
- Finding the argument is strongest, but specific areas need further analysis
- Identifying serious flaws in logic or evidence that require changing or heavily caveating the analytic line
Biases Primarily Controlled
| Bias | How this technique counters it |
|---|---|
| Confirmation Bias | Assigns the disconfirming role explicitly; the advocate must argue against the consensus |
| Groupthink | Institutionalizes dissent; gives permission and expectation to challenge consensus; reduces self-censorship |
| Motivated Reasoning | The advocate’s motivation is explicitly redirected: they are assigned the goal of disconfirming, not confirming |
| Status Quo Bias | The current analytic line is directly challenged rather than treated as the default to preserve |
| Mind-Set (link) | By constructing the best contrary case, hidden assumptions in the dominant mind-set become visible |
Relationship to Other Techniques
- More focused than team b (single analyst or small group vs. full parallel team)
- More targeted than Analysis of competing hypotheses (ach) (challenges one consensus rather than evaluating all hypotheses simultaneously)
- Shares the assumption-challenging goal of Key assumptions check but constructs an affirmative alternative case rather than just listing uncertainties
Applied in Cybersecurity
- Forensic Investigation: challenges prevailing assumptions about how evidence aligns with an attack narrative; prevents tunnel vision (Riley: SATs in Cybersecurity (2024))
- Vulnerability Analysis: challenges assumptions about severity or exploitability so no critical flaw is dismissed prematurely
- Threat Intelligence: counteracts groupthink and Confirmation bias