Field notes // For L&D leaders // July 2026

How to Measure Your Leadership Team's Soft Skills Without Another Survey

Your organization already measures leadership. The problem is what it measures with. Engagement surveys ask people how they feel. 360 reviews ask colleagues what they remember. Personality instruments ask leaders to describe themselves. Every one of those tools shares the same weakness. They measure perception, memory, and self image. None of them measures behavior.

That gap matters because the research on self perception is not kind. People are unreliable narrators of their own communication habits, and the leaders with the most confidence in their collaboration skills are often the ones whose teams have quietly stopped offering input. If your leadership development budget is justified by survey deltas, you are reporting on how people feel about the program, not on what the program changed.

What behavioral evidence actually means

Behavioral evidence is a record of observable actions. Who spoke. Who was asked for input, and who asked for it. How long a decision took once the relevant information was on the table. What happened to coordination when the situation degraded. These are not opinions about a person. They are things that happened, attributable to a moment, recoverable from a transcript.

Aviation solved this problem decades before the corporate world noticed it. After a string of accidents caused by crew coordination failures rather than technical ones, a 1979 workshop hosted by NASA catalyzed what became Crew Resource Management. For more than 40 years since, airlines and militaries have evaluated crews with structured behavioral markers, observable indicators of communication, workload management, and decision making, because impressions were not good enough when the cost of a coordination failure was a hull loss. The behavioral marker tradition, refined through frameworks like the Salas Big Five teamwork model, remains the standard for evaluating teams that cannot afford to fail.

The lesson for L&D is direct. If you want to know how your leadership team performs, do not ask them. Watch them, under conditions demanding enough that habits show.

Why pressure is the essential ingredient

Any leadership team can run a polite meeting. Composure under normal conditions is table stakes and tells you almost nothing. The patterns that decide outcomes show up when the clock compresses. Communication narrows. Some leaders start broadcasting and stop receiving. Others go quiet exactly when their information matters most. A few, and they are not always the senior ones, start knitting the team back together.

You cannot see those patterns in a conference room, and you should not wait to see them in a real crisis. That is the argument for simulation. A well designed simulation compresses months of decision situations into about 90 minutes, in a setting where the failure is fictional but the behavior is real.

What to require from any measurement approach

If you are evaluating options for leadership team soft skills measurement, hold every vendor, including us, to four requirements.

Observable behavior, not self report. The output should be built from what participants actually said and did, not from how they rated themselves afterward.

Attribution. Evidence is only useful if it is attached to a person and a moment. A report that says the team communicated poorly is an anecdote wearing a suit. A report that shows the specific handoff where coordination broke is coachable.

Honest limits. Ask what the measurement cannot see. A vendor who claims to measure everything is measuring nothing carefully. Look for confidence flags, stated caveats, and a clear line between observation and interpretation. Simulation based measurement is a young field. A 2024 meta analysis in the Journal of Intelligence found that game related indicators track traditional cognitive measures at a corrected correlation of about .45, encouraging convergence, and also a reminder that claims should stay modest and evidence should stay primary.

A debrief plan. The report is not the finish line. The conversation it starts is. Require a structured debrief framework, because the value lands when a leader reads what they actually did and decides what to do about it.

What this looks like in practice

Our version puts six leaders on a starship bridge with distinct officer stations and a mission that goes wrong on schedule. The Mission Analysis System transcribes the crew's voice traffic and attributes every utterance to a station using mission telemetry, then produces a role labeled report in plain language. Every claim carries a confidence flag. The report tells you what we observed, what we did not, and where the coordination actually broke.

The setting is theatrical. The evidence is not. Leaders forget the spaceship within minutes because the decisions are real, the information is distributed, and the clock does not care about titles.

If your team's soft skills are worth developing, they are worth measuring with something better than a survey.

Sources: the FAA's history of Crew Resource Management training in commercial aviation, and Bipp, T., Wee, S., Walczok, M., & Hansal, L. (2024), The Relationship Between Game-Related Assessment and Traditional Measures of Cognitive Ability, A Meta-Analysis, Journal of Intelligence 12(12), 129.