The Training Improvement Process provides a look at how evaluation information can be used and asks the trainer specific questions regarding data that determines the training process, the trainer’s personal performance and cost effectiveness/justification of the training. Each of these areas is addressed within the four levels of evaluation.
How will the data be used?
How the evaluation information will be used directly impacts how the data will be analyzed and reported.
- Will data be used to determine the PROCESS→ how to improve the training itself and/or the outcomes for the participants?
- Will the data be used to determine the trainer’s
PERSONAL PERFORMANCE→ how well the trainer facilitated the training?
- Level I and Level II Evaluation typically cover these two areas.
Will the data be used to determine the COST EFFECTIVENESS? → Can the training be justified to the administrators and/or to the funding source?
- Level III and Level IV Evaluation typically cover this area.
Analysis of data is important because those hiring you to train care about their “return on investment” otherwise referred to as ROI.
Who will receive the results?
These individuals could be interested:
- Session Participants
- Funding Source
What specific information will they need?
The information trainers need from an evaluation include:
- Participant Reactions
- Results and Impact
- Behavior Change
- Content Learned
What dissemination format?
What dissemination format will be most appropriate?
- Copies of Evaluations
- Narrative Report
- Summary of Evaluations
How to disseminate information?
How will the information be disseminated?
- Face-to-Face Presentation
- An emailed 1-2 page Summary of comments and calculated averages
- Written Narrative via email
- Hard-copy of Summary/Narrative; hand delivered/mailed
Review of Important Reporting Questions
Reporting questions that need to be asked and answered…
- Who will receive the results?
- What specific information will they need?
- What dissemination format will be most appropriate?
- How will the information be disseminated?
When you take the time to analyze your data, you then have the needed information to make refinements in your training style, the training content and the subsequent training delivery. The next part of the training improvement process is looking at the connection between evaluation and refinement of your training.