knowzies-logo
PortfolioMenu

Through Our Looking Glass: The Kirkpatrick Model

In the last few weeks we have analyzed and compared various Instructional Design models and learning theories. In the same spirit of understanding, we would like to present in our words the famous Kirkpatrick model for Evaluating Training Programs. It is popularly also known as Kirkpatrick's 4 Levels.

The History

Donald L. Kirkpatrick, Professor Emeritus at the University of Wisconsin in the United States and a past president of the American Society for Training and Development (ASTD), described the "The Four Levels of Learning Evaluation" in a series of articles that appeared in the US Training and Development Journal in 1959. It was then published in Kirkpatrick’s 1994 book titled, “Evaluating Training Programs.”

Overview

As learning service providers, we are all well aware of the need for evaluating the learning/training programs. Kirkpatrick's 4 Levels categorizes the ways of evaluation into four levels: 1] Reaction, 2] Learning, 3] Behavior on Transfer, and 4] Results.

The Levels in Detail

While the first two levels are quite popularly used, and are short-term, levels 3 and 4 are more observation based and take longer time to come to a conclusion. The Kirkpatrick-certified facilitators emphasize on planning the learning design based on the results expected, or the behavioral and skill changes envisaged.

Level 1: Learner’s Reaction

It is almost the most immediate evaluation that is done as soon as a training session comes to end. The learners are asked to give their opinion about the session. In the past, it was done through verbal communication, but these days smile sheets, survey forms, questionnaires etc. are used to understand whether or not the learners find the learning to be relevant, interactive, easy to understand etc.

A few things to be vary about while creating level 1 evaluation elements are:

  • Clearly Know what you want to find out
  • Design something that can quantify the reactions, yet capture the emotions through written comments and suggestions
  • Try to get complete participation and honest responses
  • Create a scale that is acceptable

Online evaluation at this level, makes it easier to organize and analyze.

Level 2: Learning Results

In simple words how do you find out whether the learners have learnt? These days we use pre-and post-assessments to do just that. The results allow trainers and learning developers to understand the gaps that need to be filled, and also make an analysis about the impact of the learning program. In the recent years, the use of this level of evaluation has gained prominence and almost become a standard part of eLearning modules, along with quizzes and other elements to get better clarity.

A few things to keep in mind here:

  • Try to use a control group wherever applicable
  • Use a test to measure knowledge and attitudes and also to measure skills. Incorporate pre-and Ensure participation.

Level 3: Behavior in Workplace (Knowledge Transfer)

Tests give immediate results but do they indicate that the learning sticks? Good scores do not always imply knowledge. Knowledge and skills are acquired over time through actions/implementations. Level 3 evaluation is a quite tricky as it looks at the behavioral change as a result of learning.

This level of evaluation can only be conducted after the passage of certain amount of time. Observation surveys, scorecards etc. are used by supervisors to keep a tab on the observable changes. Surveys can be also used to analyze it from both learner and administrative point-of-view.

  • A few things to note here:
  • Give it time.
  • Use a control group if possible.
  • Keep records of the behavior/skills before and after.
  • Ensure 100% participation.
  • Evaluate from time to time.
  • Think in terms of ROI.

Level 4: Business Result

Organizational growth, increased profit, increase in overall performance or the average turn around- any of these factors can be used to evaluate the results. However, it isn’t as easy as it sounds. Each of those aspects are connected to various other variables that keep fluctuating hence making it really difficult to attribute the changes to learning programs alone. Such interlinked analysis at an organizational level is often too difficult to quantify.

Level 3 and Level 4 Evaluation of Kirkpatrick’s model are conditional and greatly influenced by the operational environment, which is why most organizations ted to follow the 2011, Atlanta-based Kirkpatrick Partners modification of the learning and evaluation model that gave us an easier indicator the “return on expectations (ROE) of stakeholders.”

With the broadening in channels of learning delivery that ranges from face-to-face to formal and informal learning, the levels of evaluation too have to be flexible and adaptive. xAPI does allows to track and measure informal learning activities, but what we do with the data is entirely up to us.

So, how are you evaluating the effectiveness of your training programs? Let us know. We are open to hear your views on this.

Leave a Reply

Your email address will not be published. Required fields are marked *

Subscribe With Us

Recent Posts
September 7, 2022
6 Benefits of Outsourcing Your eLearning

Are you evaluating the decision of where you must do you eLearning development inhouse or outsource. Here are some of the tips on benefits of custom eLearning outsourcing for you.

Read More
September 1, 2022
Importance of eLearning in Remote Onboarding of Employees

eLearning is important for remote onboarding. Instead of going the traditional way of listing out the importance, what if we use a scenario instead?

Read More
August 22, 2022
Gamification for Safety Training

“Jack fell down and Broke his Crown, and Jill came tumbling after”.The lines from a rhyme that most of us chanted during childhood, but now that I look back, Jack must have been severely injured, and Jill too, considering the fact that both tumbled down the hill.

Read More
Recent Case Studies
December 19, 2020
Only Assessment Skill Assessment App

Knowzies Team developed a solution that consisted of a responsive web application with admin and user functionality. The admin can create assessments and assign those to users based on time and date. There are 6 different types of questions that can be created or bulk uploaded by the admin. This is a highly scalable architecture and is built to handle the load of as much as more than 5000 concurrent users. It had 4 types of users viz super admin, evaluator, and user.

Read More
December 17, 2020
On the cloud.io: SAAS Software Review Platform

Knowzies team offered a solution that consisted of a responsive web application that is available in 4 different languages- English, Spanish, Italian, and French. The main portal offered an excellent search facility to search the required product based on category, feature, pricing, country, etc. It also showed the latest trends in the industry and top 3 products based on the user’s reviews. It had 5 different types of modules like Main Page, Categories (further split into subcategories), market analysis and trends, and some useful resources.

Read More
December 14, 2020
Compliance Training App

Knowzies team created a solution that consisted of a responsive web application with multi-portal functionality. The main portal was integrated with the client’s website. An iOS, as well as an Android mobile app, is also part of the solution. It had 4 types of users viz super admin, master admin, sub-admin, and learner. Knowzies team adopted SCRUM methodology for managing this solution which was built across 8 sprints.

Read More
Knowzies Technology Solutions 
#5, Third Floor Trident Apartment,
Bavdhan, Pune, India
Email: info@knowzies.com

© 2024
 All Rights Reserved
Privacy PolicySitemap
envelopecrossarrow-up linkedin facebook pinterest youtube rss twitter instagram facebook-blank rss-blank linkedin-blank pinterest youtube twitter instagram