guide
How to measure training effectiveness
Satisfaction is not effectiveness. Here is a five-step way to measure what changed — one page of print, one email at day thirty, no tooling required.
Step one — put a transfer question in the room survey
One Likert row does most of the work: "I can name one thing from today I will use within two weeks." That is transfer intent — the bridge between reaction and behavior. Mean at 3.5 or higher, something will show up in the work. Below 3.0, the session was theater — and the suspect is the design, not the delivery.
Step two — collect commitments, not compliments
Ask "what will you do differently on Monday?" and count the answers that name a concrete action ("update the handover template") versus the ones that name a vibe ("communicate better"). Concrete answers are the only currency you can report — and every one of them becomes a line in the day-30 email.
Step three — ask what got in the way
The obstacle question ("what got in the way of your learning?") is free consulting for your next delivery. Sort answers into environment (room, time, tech), design (exercises, sequencing) and outside-the-room (workload, manager support). You control the first two; say so honestly when reporting the third. Two people naming the same obstacle is a finding; three is a redesign order.
Step four — send the day-30 email
Thirty days after the session, three questions to the same people: did you use it, how often; what helped or blocked; what support would make it stick. Expect about a third of the in-room response rate — that is normal, and behavior counts from a 30% sample are evidence, while satisfaction means from a 90% sample are not evidence of behavior at all. Schedule the email the day you run the training, before you forget who was in the room.
Step five — report the lowest item, always
A 4.1 average with a 2.2 on pace is a different session than a flat 4.1. Averaging hides exactly the rows that tell you what to fix. Report the mean and the minimum, reaction and behavior in separate sections, and one honest line where it applies: "self-report, no baseline."
What you are not claiming
None of this is Level 4. A survey plus a follow-up email measures through Level 3 — reaction, learning proxies, behavior counts. Business impact needs comparison and baselines beyond any form; the credibility of your L1-L3 numbers depends on saying that out loud.
The five steps
- Put a transfer-intent row in the survey One 1-5 item: "I can name one thing I will use within two weeks."
- Collect Monday commitments Count concrete actions, not compliments — each becomes a follow-up line.
- Ask what got in the way Sort obstacles into environment, design, outside-the-room. Three repeats = redesign.
- Send the day-30 email Three questions, thirty days on. A third response rate is normal and still evidence.
- Report mean and minimum, separately Reaction and behavior never averaged together; "self-report, no baseline" where true.
Questions people ask
How much time does this cost?
Five protected minutes in the room, twenty minutes to read a cohort of twenty, three minutes to schedule one email. The whole method is cheaper than a single post-mortem meeting.
Can I automate the collection?
Yes — every folder in the feedback-forms category ships a machine-readable assessment preset, so your agent (or a free online form) runs the same items and keeps the day-30 follow-up as a second collection.