Feedback forms for seminars and training: questions that show more than satisfaction
What a good feedback form asks after a seminar, why the usual satisfaction questions reveal little about transfer, and a template with questions you can use right away.
At the end of almost every seminar it is handed out or sent as a link: the feedback form. It is the most widespread tool of training evaluation. According to an ASTD study, 92 percent of companies use feedback forms to evaluate their training (ASTD, 2009).
Often the form is the only feedback a seminar ever gets. That makes it all the more important what it asks. This post shows which questions belong in a feedback form, which ones you can drop and how to get more out of the answers than an average of smiley faces.
What a feedback form measures and what it does not
Most feedback forms ask about satisfaction: How did you like the seminar? How satisfied were you with the trainer, the materials, the room, the catering? Transfer research therefore calls such forms happy sheets. In Kirkpatrick's four level model (1959) they measure the first level, the participants' reaction.
The problem: satisfaction says little about whether someone will later apply what they learned. Two meta analyses examined how the levels relate. Satisfaction ratings are hardly related to later behavior at work (Alliger & Janak, 1989; Alliger et al., 1997). A seminar can inspire and still change nothing. Conversely, a demanding seminar may get average ratings and achieve a lot.
There is also a signal that is often overlooked. Whatever the feedback form asks about is seen as the goal. If the form only asks about satisfaction, trainers learn: what matters is that the group is happy. How the Kirkpatrick levels relate is explained in the post The Kirkpatrick model: training evaluation in four levels.
Better questions: from satisfaction to usefulness
A first, simple step is to change the questions. Instead of asking whether people liked it, ask about usefulness and application. In the meta analysis by Alliger et al. (1997) such ratings are clearly more strongly related to later behavior than satisfaction ratings, even though the relationship remains moderate overall (r = 0.18). This is what the change looks like in practice:
- Asks about satisfactionHow did you like the seminar?Asks about usefulness and applicationHow useful is the seminar for your work?
- Asks about satisfactionThe content was interesting.Asks about usefulness and applicationThe content is relevant to my work.
- Asks about satisfactionHow satisfied were you with the methods?Asks about usefulness and applicationThe exercises helped me transfer what I learned to my work.
- Asks about satisfactionGrade the trainer.Asks about usefulness and applicationThe way the content was taught supported my learning.
- Asks about satisfactionThe seminar met my expectations.Asks about usefulness and applicationI specifically plan to put what I learned into practice.
The right side sends a different signal: the point is not that everyone goes home happy, but that what was learned arrives at work.
Template: feedback form for seminars and training
You can use the following ten questions right away. Participants answer the first eight on a scale from 1 (does not apply at all) to 7 (fully applies), the last two are open.
- The content of the seminar is relevant to my work.
- I gained knowledge or skills I did not have before.
- I feel able to apply what I learned in my own work.
- The exercises and examples fit my everyday work.
- The way the content was taught supported my learning.
- I specifically plan to apply what I learned within the next two weeks.
- My work gives me the opportunity to use what I learned.
- My manager supports me in putting what I learned into practice.
- What will you put into practice first?
- What could prevent you from applying what you learned?
Questions about the room, catering and organization may stay, but they belong at the end and rarely need more than one question. They help the organizers, but say nothing about the effect.
How to use the feedback form
- Keep it short: ten questions or fewer. Anyone who needs more than five minutes answers less carefully or not at all.
- Fill it in during the seminar: plan the last minutes before the goodbye for it, for example via a QR code on the smartphone. A link by email days later brings far fewer answers.
- Ask anonymously: honest answers only come when nobody has to fear consequences.
- Always the same scale: only with the same questions and the same scale can you compare seminars, trainers and formats.
- Follow up later: the form at the end of the seminar captures intention and confidence. Whether what was learned is actually applied shows in a short follow-up a few weeks later. How that works is explained in the post Follow-ups and assessments after the exam.
Evaluation: from a single form to a metric
An average per question is quickly calculated, but it hides a lot. Look at the distribution of answers: an average of 5 can mean that everyone is moderately satisfied, or that the group is split. How to evaluate answers on such a scale properly is shown in the post Analyzing a Likert scale.
Comparing many seminars requires a metric that is formed the same way in every course. That is exactly what PMScore does. At the end of the seminar, participants answer a short, anonymous assessment, and PMScore combines the answers into three components:
Competence gain
How much have participants learned?
Ability to apply
Do they feel able to use what they learned in their own work?
Transfer intention
Do they actually intend to put it into practice?
Together they make up the Transfer Effectiveness Score (TES) from 0 to 100. Where a value drops, PMScore asks why, for example missing examples from participants' own work. That turns the feedback form into a basis for improving the next seminar in a targeted way, and into a value you can compare across all courses and providers.
What to take away
- Check your feedback form: how many questions measure satisfaction, how many usefulness and application?
- Rephrase satisfaction questions into questions about relevance, applicability and intention to implement.
- Keep the form short, anonymous and the same in all seminars so you can compare.
- Add a short follow-up a few weeks after the seminar.
Refocus your feedback form on transfer?
Tell us what your feedback form looks like today. In a short conversation we show you how PMScore gives you the TES of your seminars without extra effort.
Sources
- Alliger, G. M., & Janak, E. A. (1989). Kirkpatrick's levels of training criteria: Thirty years later. Personnel Psychology, 42(2), 331-342.
- Alliger, G. M., Tannenbaum, S. I., Bennett, W., Jr., Traver, H., & Shotland, A. (1997). A meta-analysis of the relations among training criteria. Personnel Psychology, 50(2), 341-358.
- ASTD Research (2009). The Value of Evaluation: Making Training Evaluations More Effective. Alexandria, VA: ASTD Press.
- Kirkpatrick, D. L. (1959). Techniques for evaluating training programs. Journal of the American Society of Training Directors, 13(11), 3-9.