AAI Agentic Handbook
Question 05 · Behavioural & leadership

Tell me about mentoring someone through their first production incident.

Reviewed Oct 2026
How to spend the time
  1. 1 min — the person, the incident, the stakes
  2. 2 min — how you set roles and guardrails, the questions you asked
  3. 1 min — resolution and the postmortem
  4. 1 min — the mentee's growth, the regret
01Concept

This tests whether you can let someone else lead while keeping customers safe — the balance between taking over and leaving them alone.

02Practical use case

A strong story has a clear moment where you chose not to take the keyboard, explicit guardrails that made that safe, and a measurable change in the person afterwards.

03Staff framing

Staff answers turn one mentoring moment into a reusable practice: shadow rotations, runbooks, game days — and measure on-call readiness across the team.

What the answer sounds like at each level

Mid

Helped a newer teammate debug a bug they owned.

Senior

Let a mentee lead a real incident with explicit guardrails and coached the postmortem.

Staff

Built the on-call development system (shadowing, game days, runbooks) and measured readiness across the team.

Follow-ups the interviewer will push

1When would you have taken over?

At the stated 30-minute line, or immediately if the blast radius grew — for example if wrong results, not empty ones, were reaching clinicians.

2How do you scale this beyond one person?

Shadow rotations before primary, quarterly game days on recorded incidents, and a runbook per alert that a new engineer can follow without context.

Red flags interviewers listen for

  • Candidate takes over and frames it as mentoring.
  • No guardrail for customer impact while the mentee learned.
  • No evidence of growth in the mentee afterwards.

How it's scored

DimensionWhat strong looks like
RestraintExplicit role split and a pre-stated takeover trigger.
Customer safetyBlast radius stated and bounded.
GrowthMeasurable change in the mentee and the team.
STAR · mentoring

Coaching through a retrieval outage

Illustrative example
SITUATION

A mid-level engineer, eight months on the team, was primary on-call for the first time when our clinical-guidelines search started returning empty results for ~18% of queries at 2 p.m. on a weekday. About 600 clinicians used it daily.

TASK

I was secondary on-call and her mentor. I had to keep the incident short without taking it over.

ACTION

I joined the call and said: 'You're incident lead; I'm here as a second pair of eyes; if we pass 30 minutes I'll suggest we roll back.' I asked questions rather than giving answers — 'what changed in the last 24 hours?', 'what does the empty slice have in common?'. She found the empty queries all carried a new department filter whose metadata field had been renamed by an ingestion change. She proposed reverting the ingestion config; I confirmed it was safe and she executed it. Recovery took 34 minutes. Afterwards I paired with her on the postmortem, and she presented it.

RESULT

Empty-result rate went back to 0.4%. She added a filter-schema contract test that blocked a similar rename three months later. Within a year she was running our on-call onboarding, and the team's median time-to-mitigate on her rotations fell from 52 to 31 minutes. My regret: I let it run four minutes past the 30-minute line I'd set, because she was close — I should have held the line I'd stated.