Introduction
Most interview processes are optimized to test for polish and pattern-matching to past experience — not for the judgment a role actually requires day to day. A candidate can have an impressive résumé and interview smoothly while still lacking the judgment that will determine whether they succeed in the actual, ambiguous situations the role will present. New managers, often building or inheriting a team without ever being trained to interview well, are especially prone to this gap.
Why Résumés and Standard Interviews Miss Judgment
A résumé shows what someone has done, not how well they reasoned through the decisions along the way. A standard interview, especially one built around common, predictable questions, rewards candidates who’ve rehearsed a polished narrative — which correlates with interview skill more than with the underlying judgment the role requires.
What to Look For Instead
- How a candidate reasons through a real decision, not just what they decided. Ask a candidate to walk through an actual ambiguous situation they navigated, and probe the reasoning specifically — what they considered, what they ruled out, and why.
- How a candidate responds to being told they’re wrong mid-interview. This reveals genuine intellectual flexibility and composure under a small amount of real pressure, which is difficult to fake and highly relevant to how they’ll handle disagreement on the job.
- Specific, verifiable examples over general claims. “I’m good under pressure” is a claim. A specific story about a real high-pressure situation, with concrete detail, is evidence.
- How a candidate handles ambiguity in the interview itself. A slightly underspecified question, given deliberately, can reveal whether someone asks clarifying questions, makes reasonable assumptions explicit, or freezes.
Common Interview Biases That Undermine Judgment-Based Hiring
- The halo effect — a strong first impression, an impressive credential, or confident delivery disproportionately shapes the rest of the interview’s evaluation, even when it isn’t relevant to the actual judgment being assessed
- Similarity bias — interviewers unconsciously favor candidates who think or communicate similarly to themselves, which can systematically screen out candidates with genuinely strong but differently expressed judgment
- Recency bias within the interview — the last few minutes of a conversation disproportionately shape the overall impression, regardless of how the rest of the interview went
A Practical Structure for Judgment-Focused Interviews
- Ask for a specific, real example of a decision made under genuine ambiguity
- Probe the reasoning in detail — what was considered, what wasn’t, why the final call was made
- Introduce a mild challenge or counter-argument and observe the response
- Evaluate every candidate against the same structured criteria, rather than an overall gut impression
