Role design
Build a role scorecard interviewers can actually use
A useful scorecard contains a small set of role outcomes and capabilities, each with observable evidence and a primary assessor. Define what strong, mixed, and weak evidence look like before interviews. Keep notes separate from ratings until the evidence is recorded, and use the scorecard to explain a decision rather than reducing candidates to an unexplained total.
On this page
Choose criteria that can change a decision
Start from the hiring brief and select only outcomes and capabilities that genuinely matter. Remove duplicate criteria such as communication, stakeholder management, and collaboration when interviewers cannot distinguish them. A compact scorecard creates focus. If a criterion would never cause a candidate to advance or stop, it is probably decoration rather than a selection standard.
Write observable anchors
Describe evidence at several levels. Strong evidence might show that the candidate diagnosed a comparable problem, chose among options, and learned from results. Mixed evidence may show partial ownership or a less relevant context. Weak evidence means the interview did not establish the capability, not that the interviewer disliked the answer. Anchors reduce personal interpretation without pretending judgment disappears.
Assign one primary assessor
Each criterion needs an interviewer responsible for collecting enough evidence. Others may add observations, but duplicated ownership wastes candidate time and can amplify one polished story. Map a planned question, probe, or work sample to every criterion. Check that the full process covers the scorecard once and that no interview exists only because it always has.
Design the rating process
Ask interviewers to record examples and uncertainties before choosing a rating. Decide how missing evidence will be handled and which criteria are essential. Avoid averaging away a serious gap through a total score. The debrief should consider patterns, context, and role priorities while preserving the underlying observations.
- Criterion tied to a role outcome
- Evidence anchors written in advance
- Primary assessor and method named
- Decision rule handles missing evidence
Pilot before a live candidate
Illustrative example: a scorecard for a programme manager includes planning, influence, communication, and stakeholder management. In a mock interview, the team cannot tell the last three apart. They replace them with alignment under conflicting priorities and concise decision communication, then add distinct probes. The revised scorecard produces notes that point to different evidence instead of four versions of the same impression.
Maintain the scorecard carefully
Review whether questions produced useful evidence after a complete process, not after every unusual candidate. Change criteria only when the role changes or repeated interviews expose a design flaw. Document revisions and apply them consistently. Keep the scorecard useful for onboarding by sharing the selected person’s expected outcomes without carrying speculative or private interview judgments into their employment. Ask the manager to revisit those outcomes after the first real work cycle and separate a role-design error from an individual development need.
Next step
Run a mock interview with the current scorecard and remove any criterion the panel cannot define, observe, assign, or use in a decision.