Skip to content
PMScore Logo
BlogKnowledge

Training controlling: steering learning and development with metrics that show transfer

What training controlling is, which phases and metrics belong to it, and how you measure whether training arrives at work instead of only counting training days.

Companies justify training as an investment. Participants are meant to learn and to apply what they learned successfully, and the organization expects better results from it. Successful transfer is therefore the central expectation behind every training budget.

What gets measured is usually something else. According to ASTD Research (2009), 92 percent of companies use feedback forms, mostly on the last day of training and mostly with questions about satisfaction. Training controlling, known in German as Bildungscontrolling, is meant to close exactly this gap. This post explains what training controlling is, which metrics and tools exist and how to get started with little effort.

What is training controlling?

Training controlling is the planning, steering and review of corporate learning and development based on goals and metrics. It is part of HR controlling and answers two questions: are we spending the training budget on the right things? And does what we get for it actually work?

The literature on training controlling describes a cycle that starts long before the training and only ends afterwards at work (overview in Meier, 2008). Five phases are typical:

After the training

  1. Phase 5Transfer controllingThis is where the value showsDo participants apply what they learned at work, and what does it bring the organization?

In the training

  1. Phase 4Learning controllingWhat knowledge and skills have participants gained?
  2. Phase 3Process controllingWhere most companies measureIs the training running as planned, and are participants satisfied?

Before the training

  1. Phase 2Goal controllingWhich learning and transfer goals should the training reach, and how will you recognize them?
  2. Phase 1Needs controllingWhich competences does the organization need, and which are missing?

The phases largely match the four Kirkpatrick levels: reaction, learning, behavior and results (Kirkpatrick, 1959). How these levels relate is explained in the post The Kirkpatrick model: training evaluation in four levels.

In practice, training controlling often ends in phase 3. Whether what was learned gets applied remains open. Yet that is exactly the reason for the investment.

Metrics in training controlling

The metrics you report decide what gets optimized in your learning and development. What gets measured gets done (Burke & Hutchins, 2008). Typical metrics in training controlling are:

  • number of participants and training days
  • cost per participant day or per year
  • number of trainings offered and average group size
  • satisfaction from the feedback form

These numbers are useful for budget and planning. They say nothing about impact. Satisfaction hardly helps either: two meta analyses show that it is not related to later behavior at work (Alliger & Janak, 1989; Alliger et al., 1997). Questions about how useful the training is for one's own work, on the other hand, are related to transfer, if only weakly (r = 0.18).

A simple test shows where your training controlling stands: could you convincingly tell your management or a large client right away how effective your trainings are at transfer? If not, a metric for transfer effectiveness is missing. It should show the status quo, what you can be proud of and where action is needed.

Tools of training controlling

Tools for transfer controlling differ widely in effort:

  • Self assessment by participants: a short, anonymous questionnaire. Quick, cheap and practical for almost any training.
  • Implementation talk with the manager: after the transfer phase, participant and manager jointly assess how far the transfer goals have been reached.
  • Implementation presentation or practice project: participants show what they have put into practice, for example to management or to the project's sponsor.
  • Observation and simulation: external observers watch the application in everyday work or in a staged practice situation.

The effort has to fit the training. For a one day training, an elaborate simulation is oversized and a standardized questionnaire is appropriate. For an expensive academy that runs several times a year, a more elaborate design pays off.

Timing matters too. After training on a tool, transfer often shows after a month, after a leadership training rather after six to nine months. So plan the assessment when you design the training.

Training controlling with the Transfer Effectiveness Score

PMScore provides the metric that training controlling usually lacks. At the end of the course, participants answer a short, anonymous assessment. It does not ask whether they liked the training, but about what matters for transfer:

  1. Competence gain

    How much have participants learned?

  2. Ability to apply

    Do they feel able to use what they learned in their own work?

  3. Transfer intention

    Do they actually intend to put it into practice?

Together they make up the Transfer Effectiveness Score (TES) from 0 to 100. The values in the example above are made up. Because every assessment yields the same TES, you can compare courses, formats, trainers and versions of a training and report to management or clients. Where the value drops, PMScore asks why. So your training controlling shows not only whether transfer succeeds, but also where to start improving.

The TES is based on participants' self assessment and does not replace observation at work. But it makes transfer effectiveness measurable in every course with little effort. For high budget trainings you can add a second assessment a few weeks later or talks with managers.

What to take away for your training controlling

  1. Decide before the training which transfer it should achieve and how you will recognize it.
  2. Add a metric for transfer effectiveness to volume and cost metrics, with the same questions in every course.
  3. Choose tools and timing to fit the training, and report the results where budget decisions are made.

Add the TES to your training controlling?

Tell us which trainings you steer. In a short conversation we show you how the TES fits into your reporting.

Thanks! We'll get back to you soon.

That didn't work right now. Please try again later or email us directly.

Sources

  • Alliger, G. M., & Janak, E. A. (1989). Kirkpatrick's levels of training criteria: Thirty years later. Personnel Psychology, 42(2), 331-342.
  • Alliger, G. M., Tannenbaum, S. I., Bennett, W., Jr., Traver, H., & Shotland, A. (1997). A meta-analysis of the relations among training criteria. Personnel Psychology, 50(2), 341-358.
  • ASTD Research (2009). The Value of Evaluation. ASTD Press.
  • Burke, L. A., & Hutchins, H. M. (2008). A study of best practices in training transfer and proposed model of transfer. Human Resource Development Quarterly, 19(2), 107-128.
  • Kirkpatrick, D. L. (1959). Techniques for evaluating training programs. Journal of the American Society of Training Directors, 13(11), 3-9.
  • Meier, R. (2008). Praxis Bildungscontrolling: Was Sie wirklich tun können, um Ihre Aus- und Weiterbildung qualitätsbewusst zu steuern. GABAL.