Organizational Resilience Training: How to Measure Whether Your Capability Would Actually Hold

Training completion is easy to count. Preparedness is harder to prove.

An employee may finish an online course, a department may hold a tabletop exercise, and a continuity plan may sit in a shared folder. Those are useful activities, but none, by itself, demonstrates that people can perform their roles when normal operations are disrupted.

To make organizational resilience training measurable, connect learning to observable actions. Define the capability your organization needs, check proficiency by role, collect evidence during exercises and plan reviews, and use findings to improve and retest. This approach applies to companies, universities, colleges, and public-sector health authorities that need to sustain essential functions and services.

Start with a capability statement, not a course list

A course describes what people learn. A capability statement describes what they should be able to do.

Write statements around a task, the conditions in which it must be performed, and what acceptable performance looks like. For example:

During a disruption affecting a critical function, designated team members can identify the activation trigger, follow the notification procedure, and document the decision using current procedures.

This is a sample, not a universal standard. Each organization should set its own conditions and performance expectations based on its risks, roles, and continuity priorities.

Keep statements specific enough to evaluate. “Understand continuity” is difficult to verify. “Locate the current continuity procedure and identify the person authorized to activate it” is observable. A useful capability statement should help answer three questions:

• Who is expected to act?

• What action should they take?

• What evidence would show that they did it effectively?

Link each statement to an important function, response responsibility, or continuity objective. FEMA’s Continuity Guidance Circular describes continuity as sustaining essential functions and recommends evaluating capabilities against relevant metrics. It also recognizes training, evaluation, and improvement planning as connected parts of maintaining capability.

Check proficiency by role

A general awareness course can establish a shared baseline, but different roles require different demonstrations. Senior leaders may need to make and document decisions; continuity coordinators may need to verify plan details; communications staff may need to follow approval and notification procedures; employees may need to identify where to find guidance and how to receive instructions.

Use a proficiency check that fits the role and task. Options include:

• A short knowledge check on responsibilities, procedures, or escalation paths

• A scenario question asking the learner to explain what they would do next

• A facilitated discussion in which participants make decisions using current plans

• A drill or functional test that checks whether a procedure or system works

• A plan review that confirms key information is current and usable

Completion data still matters: it can show which groups have been reached and where training remains outstanding. But completion is an activity measure, not proof that a task can be performed. Pair it with evidence of knowledge or demonstrated performance.

For each role-based check, define the rating method before the activity. A simple scale might record whether performance met the expected action, partly met it, did not meet it, or could not be observed. “Could not be observed” is important: it means the exercise did not provide enough evidence, not necessarily that the person failed.

Collect evidence from more than one source

A credible picture of capability combines different kinds of evidence. A tabletop may reveal decision-making and role clarity, while plan reviews may reveal outdated information or unclear procedures. No single source answers every question.

Useful evidence sources include:

• Drills and tests: Did notifications reach the intended people? Could staff use the procedure or system as planned?

• Tabletop performance: Did participants identify decision authority, use available information, coordinate across roles, and record decisions?

• Continuity plan updates: Were essential functions, contacts, responsibilities, and supporting procedures reviewed and corrected?

• After-action findings: What strengths and gaps did evaluators observe, and what changes were assigned?

• Training records and assessments: Which roles completed relevant learning, and what did role-specific checks show?

FEMA’s Homeland Security Exercise and Evaluation Program (HSEEP) resources describe exercises as opportunities to evaluate capabilities and assess progress toward targets. HSEEP’s 2020 revision information sheet also highlights data analysis and SMART corrective actions (specific, measurable, achievable, relevant, and time-bound) as part of improvement planning.

For each finding, preserve the basics: the capability being assessed, the expected action, what was observed, the source of evidence, the gap or strength identified, and the follow-up needed. This makes it easier to explain what the evidence supports, and what it does not.

Track outcomes, not just activity

A useful measurement set includes a few indicators tied to actual performance. Organizations might track:

• The share of designated roles that completed relevant training

• The share that met role-specific proficiency criteria

• Whether exercise objectives were demonstrated, partly demonstrated, or not observed

• The number of continuity plan updates prompted by reviews or exercises

• Corrective actions assigned, overdue, completed, and validated

• Whether previously identified issues appear again in a later test or exercise

These are examples, not universal targets. Set thresholds that make sense for your organization, then explain how they were selected. Avoid combining different roles or functions into one broad score if doing so hides important gaps.

For continuity, measures should connect to the organization’s essential functions: for example, whether the team can locate the relevant procedure, notify the right roles, access necessary information, and explain how the function would continue if normal operations were unavailable. FEMA’s circular emphasizes evaluation of continuity plans, procedures, and systems, and calls for corrective actions to be tracked toward completion.

Use a simple quarterly review cadence

A quarterly review can help keep evidence active instead of allowing exercise notes and plan updates to sit untouched. This is a practical operating rhythm, not a mandated schedule.

Quarter 1: Set the measures. Confirm priority functions, capability statements, role owners, expected evidence, and upcoming training or exercise activities.

Quarter 2: Practice and observe. Run a focused discussion, tabletop, drill, or test. Use observers or structured prompts to capture actions against the capability statements.

Quarter 3: Update and follow through. Review findings, update relevant plans or training, assign owners and due dates, and record what evidence will be needed to validate each action.

Quarter 4: Validate and reset. Retest priority improvements where practical. Review recurring gaps, outstanding actions, and changes in operations or responsibilities. Use the results to shape the next cycle.

A lightweight evidence register can keep this manageable. Include the capability statement, role or function, date assessed, evidence source, result, finding, action owner, due date, and validation method. A quarterly review should identify what changed and what still needs attention, not just count activities completed.

Make the evidence inclusive and usable

Capability should hold for the people expected to use it and the people affected by it. Check whether instructions, communication methods, training materials, and exercise conditions allow participants to demonstrate the intended task. For example, if a scenario tests notification or evacuation procedures, consider whether accessible communications and relevant support needs are addressed.

This is not a separate measurement exercise. It is part of defining whether a procedure works as intended. FEMA’s continuity guidance discusses accessibility in continuity planning and recommends evaluating measures that support employees and members of the public with disabilities.

Turn findings into demonstrated improvement

A completed action is not automatically an effective action. Updating a procedure is a step; checking that the right people can find and use it is stronger evidence. After an exercise, assign significant findings to an owner, set a due date, identify the expected change, and decide how you will validate it. Then look for improvement during a later exercise, test, or review.

This creates a traceable link:

Training → role-based practice → observed evidence → corrective action → validation.

If a gap repeats, revisit its cause. The issue may involve unclear authority, an outdated plan, a resource dependency, insufficient practice, or an inaccessible process, not simply a need to assign another course.

Alpha Research Group develops customized emergency management training for corporate and academic audiences, including corporate crisis exercise simulations. To learn more about training that can support your organization’s preparedness and continuity objectives, visit https://www.alpharesearchgrp.com/.