
Issue No. 03 covered why confidence often beats competence in the interview room. This issue covers why the unstructured interview, the format behind most PM searches, costs more and tells you less than a validated assessment.
Three findings reveal the gap between how most funds interview and what science suggests as an alternative.
An unstructured interview tests the interviewer as much as the candidate.
Ask five interviewers to run an unstructured conversation with the same candidate, and you will get five different tests: different questions, different follow-ups, and different weight on rapport versus substance. Schmidt and Hunter measured the cost of that variance directly. If you hire 10 people using unstructured interviews, 6 will perform above average. Structured interviews give better results. Using the same questions and the same scoring rubric for every candidate, you would get 7 above average performers out of those ten hires.
Bottom line: unstructured interviews inject variance into your teambuilding.
How fast do you want PMs to adapt?
Issue No. 02 covered why a candidate’s track record doesn’t follow them to a new company: new teams, new mandates, and new markets change how someone will perform. A cognitive ability test is one of the few tools that predicts how well someone handles that kind of change because it measures how fast a person learns in an unfamiliar domain. Schmidt and Hunter found it one of the two strongest single predictors of job performance, tied with structured interviews and just behind work sample tests.
Paired together, a structured interview and a cognitive test give you above-average hires 8 times out of 10.
The assessment costs a rounding error against the alternative.
A poor senior hire in financial services costs 10 to 15 times total compensation in replacement, disruption, and opportunity cost. If it were a trade, it would require a whole post-mortem and risk review. The cost of a validated assessment, booked as a trade, would not even raise an eyebrow.
The math fails if you never make a bad senior hire. And the math is against that, too.
If every interviewer on your panel asks a different question and grades on a different curve, would you call that a process, or noise?
Hiring a senior PM, promoting from within, and planning succession for a key-person transition all hinge on the same principles. If the process measures something different for every candidate, the decision it produces is a guess at best.
