SlideShare una empresa de Scribd logo
1 de 25
+
    KIRKPATRICK’S
      LEVELS OF
     EVALUATION

              Cindy Yew
       Curriculum Project Manager
      Knowledge Universe, CIRC-AIC




       Asian International College, Singapore
                 31 January 2012
Dr Donald




                         +
Kirkpatrick’s
ideas on
measuring
training
effectiveness
were originally
published in
1959.

        Four level model.
                  Simple.
                 Flexible.
           Comprehensive.



                   Iae or : im. ro
                   mg suc g . m
                         e pc
The four levels of evaluation…




                                                  +
                                 kirkpatrick’s model
  Level 4:




  Level 3:




  Level 2:




  Level 1 :

                                       Image source: uncw.edu
+
  Level 1.
  Reaction
Level 1: Reaction




                                                                  +
measures how those who participate in the programme
          react to the learning experience
 “a measure of customer satisfaction” - Dr Don Kirkpatrick
                                                      Image source: wordpress.com
Level 1: Reaction




                                                                         +
     Level 1 evaluates reaction
     e.g.,
               Questionnaire           Content
                                       Methods
                                       Media
                                       Trainer style
                                       Facilities
                                       Course materials




                      •   Did the participants like the training?
                      •   Did they consider the training relevant?
                      •   Did they find the trainer engaging?

Iae or : ma rgnloto
mg suc es inad yu m
      e    u   a .c
Level 1: Reaction




                                                 +
How to collect reactions?




                                           6.
                                         Measure
                                   reactions against
                                     the standard &
                                    follow-up where
                                        necessary
+
  Level 2.
  Learning
Level 2: Learning




                                                                   +
the extent to which participants change attitudes,
improve knowledge, and/or increase skill
as a result of attending the programme




                                               “in order to
                                                  evaluate
                                             learning, the
                                                   specific
                                          objectives must
                                          be determined”
                                           - Dr Don Kirkpatrick

                                                    Image source: cartoonstock.com
Level 2: Learning




                                                                     +
          Level 2 measures learning
          e.g.,
                Interviews
                Surveys
                Tests (pre- and post-)
                Observations
                Combinations




                      • Did the participants learn what was intended to
                        be taught?
                      • Did the participants experience what was
                        intended for them to experience?
Iae or : ma rgnloto
mg suc es inad yu m
      e    u   a .c
Level 2: Learning




                                               +
How to collect learning?
+
  Level 3.
  Behaviour
Level 3: Behaviour




                                                                  +
  the extent to which change in behaviour has occurred
because the participant attended the training programme.




                           One primary question for training
                           at this level is if there is a transfer
                               of knowledge to application at
                                                 daily activities?



                                                         Iae or : b oso g . o
                                                         mg suc o k olcm
                                                               e     .g e
Level 3: Behaviour
     Level 3 refers to behaviour




                                                                       +
     e.g.,
               Survey the people who
               observes the participant in       Monetary
               action back on the job            Efficiency
                                                 Morale
                                                 Teamwork
                                                 etc…




                        • Did the participants put their learning into
                          effect when back on the job?
                        • Were the relevant skills and knowledge used?
                        • Was there a measurable change in the
                          activity and performance of the participants
                          when back in their roles?
Iae or : ma rgnloto
mg suc es inad yu m
      e    u   a .c
Level 3: Behaviour




                                                 +
How to collect behaviour?
+
  Level 4.
  Results
defined as the final results that   Level 4: Results




                                                             +
occurred because the participants
attended the programme.




                                                       Iae or : b g o.cm
                                                       mg suc l s to
                                                             e op
Level 4: Results
     Level 4 looks at results




                                                                          +
     e.g.,
               Key Performance Indicators      Volume
                                               Values
                                               Percentages
                                               Timescales
                                               Return on Investment
                                               Other quantifiable aspects of
                                                organisational performance,
                                                e.g. no. of attrition, wastage,
                                                quality rating, achievement of
                                                quality and standards, etc.



                       • Did the KPI improve?
                       • To what extent has it improved?

Iae or : ma rgnloto
mg suc es inad yu m
      e    u   a .c
Level 4: Results




                                             +
How to collect results?
Summary




          Iosuc: kka icpr e .cm
          n or ir t ka nr o
           f  e pr      t s
+
  Level 5.
  Return On
  Investment
kirkpatrick-philip’s model




                                           +
     ROI = evaluating the return on investment
+
    Credits
    Sources:

    Evaluating Training Programs: The Four Levels (3rd Edition) - http://bit.ly/uothqS
    Kirkpatrick's Four-Level Model of Training Evaluation - http://bit.ly/vUuY6c
    Kirkpatrickpartners -
    www.kirkpatrickpartners.com/OurPhilosophy/tabid/66/Default.aspx
    Kirkpatrick’s Four Level of Evaluation - http://youtu.be/oBpI0B5PtaA
    ROI in Education: Increasing Innovation and Choice -
    http://youtu.be/qRm9htSI3FM

Más contenido relacionado

La actualidad más candente

Kirkpatrick 4 level evaluation model
Kirkpatrick 4 level evaluation modelKirkpatrick 4 level evaluation model
Kirkpatrick 4 level evaluation modelzhumin
 
Kirk Patrick's Level of Evaluation
Kirk Patrick's Level of EvaluationKirk Patrick's Level of Evaluation
Kirk Patrick's Level of EvaluationPeinee Chaw
 
Training evaluation
Training evaluationTraining evaluation
Training evaluationNancy Raj
 
Training evaluation
Training evaluationTraining evaluation
Training evaluationdhruvt35
 
Kirkpatricks Levels Presentation
Kirkpatricks Levels PresentationKirkpatricks Levels Presentation
Kirkpatricks Levels PresentationLarry Weas
 
Measuring the Effectiveness of Training - Myth or Reality?
Measuring the Effectiveness of Training - Myth or Reality?Measuring the Effectiveness of Training - Myth or Reality?
Measuring the Effectiveness of Training - Myth or Reality?Accord
 
Training & Development - Evaluating Effectiveness of Training
Training & Development - Evaluating Effectiveness of TrainingTraining & Development - Evaluating Effectiveness of Training
Training & Development - Evaluating Effectiveness of TrainingM R Jhalawad
 
Training Evaluation workshop slides.may2011
Training Evaluation workshop slides.may2011Training Evaluation workshop slides.may2011
Training Evaluation workshop slides.may2011BeckmanKH
 
The Kirkpatrick Evaluation Model
The Kirkpatrick Evaluation ModelThe Kirkpatrick Evaluation Model
The Kirkpatrick Evaluation ModelAcorn
 
Training evaluation
Training evaluationTraining evaluation
Training evaluationMis bah
 
Kirkpatrick's Four Levels Of Evaluation Model
Kirkpatrick's Four Levels Of Evaluation ModelKirkpatrick's Four Levels Of Evaluation Model
Kirkpatrick's Four Levels Of Evaluation Modelsikojp
 
Training Feedback and Evaluation, Training Audit, Training as Continuous Process
Training Feedback and Evaluation, Training Audit, Training as Continuous ProcessTraining Feedback and Evaluation, Training Audit, Training as Continuous Process
Training Feedback and Evaluation, Training Audit, Training as Continuous ProcessAshish Hande
 
Evaluation of training Program
Evaluation of training ProgramEvaluation of training Program
Evaluation of training ProgramSomya Tiwari
 
9:Evaluation of Training Effectiveness
9:Evaluation of Training Effectiveness9:Evaluation of Training Effectiveness
9:Evaluation of Training EffectivenessRichardBrennan
 
Training and Development
Training and DevelopmentTraining and Development
Training and DevelopmentDivine Dizon
 
Four Levels Of Evaluation (Kirkpatrick Model) By Ravinder Tulsiani
Four Levels Of Evaluation (Kirkpatrick Model) By Ravinder TulsianiFour Levels Of Evaluation (Kirkpatrick Model) By Ravinder Tulsiani
Four Levels Of Evaluation (Kirkpatrick Model) By Ravinder TulsianiRavinder Tulsiani
 
The Evaluation of Learning
The Evaluation of Learning The Evaluation of Learning
The Evaluation of Learning Emma Weber
 

La actualidad más candente (20)

Kirkpatrick 4 level evaluation model
Kirkpatrick 4 level evaluation modelKirkpatrick 4 level evaluation model
Kirkpatrick 4 level evaluation model
 
Kirk Patrick's Level of Evaluation
Kirk Patrick's Level of EvaluationKirk Patrick's Level of Evaluation
Kirk Patrick's Level of Evaluation
 
Training evaluation
Training evaluationTraining evaluation
Training evaluation
 
Training evaluation
Training evaluationTraining evaluation
Training evaluation
 
Kirkpatricks Levels Presentation
Kirkpatricks Levels PresentationKirkpatricks Levels Presentation
Kirkpatricks Levels Presentation
 
Measuring the Effectiveness of Training - Myth or Reality?
Measuring the Effectiveness of Training - Myth or Reality?Measuring the Effectiveness of Training - Myth or Reality?
Measuring the Effectiveness of Training - Myth or Reality?
 
Training & Development - Evaluating Effectiveness of Training
Training & Development - Evaluating Effectiveness of TrainingTraining & Development - Evaluating Effectiveness of Training
Training & Development - Evaluating Effectiveness of Training
 
Training Evaluation workshop slides.may2011
Training Evaluation workshop slides.may2011Training Evaluation workshop slides.may2011
Training Evaluation workshop slides.may2011
 
The Kirkpatrick Evaluation Model
The Kirkpatrick Evaluation ModelThe Kirkpatrick Evaluation Model
The Kirkpatrick Evaluation Model
 
Training evaluation
Training evaluationTraining evaluation
Training evaluation
 
Kirkpatrick's Four Levels Of Evaluation Model
Kirkpatrick's Four Levels Of Evaluation ModelKirkpatrick's Four Levels Of Evaluation Model
Kirkpatrick's Four Levels Of Evaluation Model
 
Training Feedback and Evaluation, Training Audit, Training as Continuous Process
Training Feedback and Evaluation, Training Audit, Training as Continuous ProcessTraining Feedback and Evaluation, Training Audit, Training as Continuous Process
Training Feedback and Evaluation, Training Audit, Training as Continuous Process
 
Evaluation of training Program
Evaluation of training ProgramEvaluation of training Program
Evaluation of training Program
 
9:Evaluation of Training Effectiveness
9:Evaluation of Training Effectiveness9:Evaluation of Training Effectiveness
9:Evaluation of Training Effectiveness
 
Training and Development
Training and DevelopmentTraining and Development
Training and Development
 
Four Levels Of Evaluation (Kirkpatrick Model) By Ravinder Tulsiani
Four Levels Of Evaluation (Kirkpatrick Model) By Ravinder TulsianiFour Levels Of Evaluation (Kirkpatrick Model) By Ravinder Tulsiani
Four Levels Of Evaluation (Kirkpatrick Model) By Ravinder Tulsiani
 
The Evaluation of Learning
The Evaluation of Learning The Evaluation of Learning
The Evaluation of Learning
 
Training evaluation
Training evaluationTraining evaluation
Training evaluation
 
Training and Development
Training and DevelopmentTraining and Development
Training and Development
 
Training & development
Training & developmentTraining & development
Training & development
 

Destacado

KIRKPATRICK MODEL OF EVALUATION (LEO CHANDRA)
KIRKPATRICK MODEL OF EVALUATION (LEO CHANDRA)KIRKPATRICK MODEL OF EVALUATION (LEO CHANDRA)
KIRKPATRICK MODEL OF EVALUATION (LEO CHANDRA)vina serevina
 
The Benefits Of Utilizing Kirkpatrick’S Four Levels Of
The Benefits Of Utilizing Kirkpatrick’S Four Levels OfThe Benefits Of Utilizing Kirkpatrick’S Four Levels Of
The Benefits Of Utilizing Kirkpatrick’S Four Levels Ofwendystein
 
Module 8: Assessment and Evaluation
Module 8: Assessment and EvaluationModule 8: Assessment and Evaluation
Module 8: Assessment and EvaluationCardet1
 
Adlt 606 class 11 kirkpatrick's evaluation model short version
Adlt 606 class 11 kirkpatrick's evaluation model short versionAdlt 606 class 11 kirkpatrick's evaluation model short version
Adlt 606 class 11 kirkpatrick's evaluation model short versiontjcarter
 
Measuring Learning - Evaluation Levels and Instrunments
Measuring Learning - Evaluation Levels and InstrunmentsMeasuring Learning - Evaluation Levels and Instrunments
Measuring Learning - Evaluation Levels and InstrunmentsMichael Woodard, MA., PTE, PI
 
Curriculum Evaluation
Curriculum EvaluationCurriculum Evaluation
Curriculum Evaluationvalarpink
 
Training evaluation ppt 6
Training evaluation   ppt 6Training evaluation   ppt 6
Training evaluation ppt 6SBMC Jobs
 
effective evaluation ارزشیابی اثربخش
effective evaluation ارزشیابی اثربخشeffective evaluation ارزشیابی اثربخش
effective evaluation ارزشیابی اثربخشMohsen Sharifirad
 
Evaluation form level 2
Evaluation form level 2Evaluation form level 2
Evaluation form level 2Flatio
 
The addie instructor design model
The addie instructor design modelThe addie instructor design model
The addie instructor design modelGaurav Patil
 
2013-11-01 Tampere Coaching Circle - GROW intro
2013-11-01 Tampere Coaching Circle - GROW intro2013-11-01 Tampere Coaching Circle - GROW intro
2013-11-01 Tampere Coaching Circle - GROW introJuho-Pekka Pöyry
 
LOEX 2016 Future ReImagined: Shaping Teaching Through Design
LOEX 2016 Future ReImagined: Shaping Teaching Through DesignLOEX 2016 Future ReImagined: Shaping Teaching Through Design
LOEX 2016 Future ReImagined: Shaping Teaching Through DesignAmanda Roth
 
Training and development planning ISO 10015 Implementation
Training and development planning ISO 10015 ImplementationTraining and development planning ISO 10015 Implementation
Training and development planning ISO 10015 ImplementationReza Seifollahy
 
Assessment strategies for online learning
Assessment strategies for online learningAssessment strategies for online learning
Assessment strategies for online learningCaroline Conlon
 
Morrison, Ross & Kemp (MRK) Model
Morrison, Ross & Kemp (MRK) ModelMorrison, Ross & Kemp (MRK) Model
Morrison, Ross & Kemp (MRK) Modelshortele
 
Curriculum constrction sem i evaluation models
Curriculum constrction sem i   evaluation modelsCurriculum constrction sem i   evaluation models
Curriculum constrction sem i evaluation modelsRaj Kumar
 

Destacado (19)

Levels 1-4 Evaluation
Levels 1-4 EvaluationLevels 1-4 Evaluation
Levels 1-4 Evaluation
 
KIRKPATRICK MODEL OF EVALUATION (LEO CHANDRA)
KIRKPATRICK MODEL OF EVALUATION (LEO CHANDRA)KIRKPATRICK MODEL OF EVALUATION (LEO CHANDRA)
KIRKPATRICK MODEL OF EVALUATION (LEO CHANDRA)
 
The Benefits Of Utilizing Kirkpatrick’S Four Levels Of
The Benefits Of Utilizing Kirkpatrick’S Four Levels OfThe Benefits Of Utilizing Kirkpatrick’S Four Levels Of
The Benefits Of Utilizing Kirkpatrick’S Four Levels Of
 
Training Evaluation
Training EvaluationTraining Evaluation
Training Evaluation
 
Module 8: Assessment and Evaluation
Module 8: Assessment and EvaluationModule 8: Assessment and Evaluation
Module 8: Assessment and Evaluation
 
Adlt 606 class 11 kirkpatrick's evaluation model short version
Adlt 606 class 11 kirkpatrick's evaluation model short versionAdlt 606 class 11 kirkpatrick's evaluation model short version
Adlt 606 class 11 kirkpatrick's evaluation model short version
 
Measuring Learning - Evaluation Levels and Instrunments
Measuring Learning - Evaluation Levels and InstrunmentsMeasuring Learning - Evaluation Levels and Instrunments
Measuring Learning - Evaluation Levels and Instrunments
 
Curriculum Evaluation
Curriculum EvaluationCurriculum Evaluation
Curriculum Evaluation
 
Training evaluation ppt 6
Training evaluation   ppt 6Training evaluation   ppt 6
Training evaluation ppt 6
 
effective evaluation ارزشیابی اثربخش
effective evaluation ارزشیابی اثربخشeffective evaluation ارزشیابی اثربخش
effective evaluation ارزشیابی اثربخش
 
Evaluation form level 2
Evaluation form level 2Evaluation form level 2
Evaluation form level 2
 
Global Training Advisory Board
Global Training Advisory BoardGlobal Training Advisory Board
Global Training Advisory Board
 
The addie instructor design model
The addie instructor design modelThe addie instructor design model
The addie instructor design model
 
2013-11-01 Tampere Coaching Circle - GROW intro
2013-11-01 Tampere Coaching Circle - GROW intro2013-11-01 Tampere Coaching Circle - GROW intro
2013-11-01 Tampere Coaching Circle - GROW intro
 
LOEX 2016 Future ReImagined: Shaping Teaching Through Design
LOEX 2016 Future ReImagined: Shaping Teaching Through DesignLOEX 2016 Future ReImagined: Shaping Teaching Through Design
LOEX 2016 Future ReImagined: Shaping Teaching Through Design
 
Training and development planning ISO 10015 Implementation
Training and development planning ISO 10015 ImplementationTraining and development planning ISO 10015 Implementation
Training and development planning ISO 10015 Implementation
 
Assessment strategies for online learning
Assessment strategies for online learningAssessment strategies for online learning
Assessment strategies for online learning
 
Morrison, Ross & Kemp (MRK) Model
Morrison, Ross & Kemp (MRK) ModelMorrison, Ross & Kemp (MRK) Model
Morrison, Ross & Kemp (MRK) Model
 
Curriculum constrction sem i evaluation models
Curriculum constrction sem i   evaluation modelsCurriculum constrction sem i   evaluation models
Curriculum constrction sem i evaluation models
 

Similar a Kirkpatrick's model

Measuring roi of training
Measuring roi of trainingMeasuring roi of training
Measuring roi of trainingZaini Ithnin
 
WillowDNA 2011 Alternative to Moodle seminar
WillowDNA 2011 Alternative to Moodle seminarWillowDNA 2011 Alternative to Moodle seminar
WillowDNA 2011 Alternative to Moodle seminarWillowDNA
 
Model of evaluation
Model of evaluationModel of evaluation
Model of evaluationu069072
 
Model of evaluation
Model of evaluationModel of evaluation
Model of evaluationu069072
 
Tier II for Work Avoidance (Implementer's Forum 2011)
Tier II for Work Avoidance (Implementer's Forum 2011)Tier II for Work Avoidance (Implementer's Forum 2011)
Tier II for Work Avoidance (Implementer's Forum 2011)Cynthia Anderson
 
Kirk patrick's simplistic approach
Kirk patrick's simplistic approachKirk patrick's simplistic approach
Kirk patrick's simplistic approachrhimycrajan
 
Teaching and Learning Process
Teaching and Learning ProcessTeaching and Learning Process
Teaching and Learning ProcessJaser Daher
 
Data Driven Continuous Improvement
Data Driven Continuous ImprovementData Driven Continuous Improvement
Data Driven Continuous ImprovementJohn Rinderle
 
Tugasan 4 penilaian kendiri teks
Tugasan 4 penilaian kendiri teksTugasan 4 penilaian kendiri teks
Tugasan 4 penilaian kendiri tekstengkunini
 
Kirkpatricks four levels_of_evaluation_271
Kirkpatricks four levels_of_evaluation_271Kirkpatricks four levels_of_evaluation_271
Kirkpatricks four levels_of_evaluation_271sapnatiwari90
 
Integrating Clickers into Assessment for Learning
Integrating Clickers into Assessment for LearningIntegrating Clickers into Assessment for Learning
Integrating Clickers into Assessment for LearningChi Yan Lam
 
Assessing quality: Learner analytics, or human intuition?
Assessing quality: Learner analytics, or human intuition?Assessing quality: Learner analytics, or human intuition?
Assessing quality: Learner analytics, or human intuition?Brandon Muramatsu
 
Lecture 7. student evaluation
Lecture 7. student evaluationLecture 7. student evaluation
Lecture 7. student evaluationShafiqur Rehman
 
Absorb activities 2
Absorb activities 2Absorb activities 2
Absorb activities 2lgoins55
 
Absorb activities 2
Absorb activities 2Absorb activities 2
Absorb activities 2lgoins55
 
Transforming in-class and out-of-class student engagement through active lear...
Transforming in-class and out-of-class student engagement through active lear...Transforming in-class and out-of-class student engagement through active lear...
Transforming in-class and out-of-class student engagement through active lear...John Couperthwaite
 

Similar a Kirkpatrick's model (20)

Measuring roi of training
Measuring roi of trainingMeasuring roi of training
Measuring roi of training
 
WillowDNA 2011 Alternative to Moodle seminar
WillowDNA 2011 Alternative to Moodle seminarWillowDNA 2011 Alternative to Moodle seminar
WillowDNA 2011 Alternative to Moodle seminar
 
Model of evaluation
Model of evaluationModel of evaluation
Model of evaluation
 
Model of evaluation
Model of evaluationModel of evaluation
Model of evaluation
 
Chapter 1 marzano
Chapter 1 marzanoChapter 1 marzano
Chapter 1 marzano
 
Tier II for Work Avoidance (Implementer's Forum 2011)
Tier II for Work Avoidance (Implementer's Forum 2011)Tier II for Work Avoidance (Implementer's Forum 2011)
Tier II for Work Avoidance (Implementer's Forum 2011)
 
Fidelity at Tier II
Fidelity at Tier IIFidelity at Tier II
Fidelity at Tier II
 
Kirk patrick's simplistic approach
Kirk patrick's simplistic approachKirk patrick's simplistic approach
Kirk patrick's simplistic approach
 
Teaching and Learning Process
Teaching and Learning ProcessTeaching and Learning Process
Teaching and Learning Process
 
Data Driven Continuous Improvement
Data Driven Continuous ImprovementData Driven Continuous Improvement
Data Driven Continuous Improvement
 
Tugasan 4 penilaian kendiri teks
Tugasan 4 penilaian kendiri teksTugasan 4 penilaian kendiri teks
Tugasan 4 penilaian kendiri teks
 
Kirkpatricks four levels_of_evaluation_271
Kirkpatricks four levels_of_evaluation_271Kirkpatricks four levels_of_evaluation_271
Kirkpatricks four levels_of_evaluation_271
 
Integrating Clickers into Assessment for Learning
Integrating Clickers into Assessment for LearningIntegrating Clickers into Assessment for Learning
Integrating Clickers into Assessment for Learning
 
Assessing quality: Learner analytics, or human intuition?
Assessing quality: Learner analytics, or human intuition?Assessing quality: Learner analytics, or human intuition?
Assessing quality: Learner analytics, or human intuition?
 
Lecture 7. student evaluation
Lecture 7. student evaluationLecture 7. student evaluation
Lecture 7. student evaluation
 
Absorb activities 2
Absorb activities 2Absorb activities 2
Absorb activities 2
 
Absorb activities 2
Absorb activities 2Absorb activities 2
Absorb activities 2
 
Sandra Mc Carthy Cit Conference 2009 Detroit
Sandra Mc Carthy Cit Conference 2009 DetroitSandra Mc Carthy Cit Conference 2009 Detroit
Sandra Mc Carthy Cit Conference 2009 Detroit
 
Sandra Mc Carthy Cit Conference 2009 Detroit
Sandra Mc Carthy Cit Conference 2009 DetroitSandra Mc Carthy Cit Conference 2009 Detroit
Sandra Mc Carthy Cit Conference 2009 Detroit
 
Transforming in-class and out-of-class student engagement through active lear...
Transforming in-class and out-of-class student engagement through active lear...Transforming in-class and out-of-class student engagement through active lear...
Transforming in-class and out-of-class student engagement through active lear...
 

Último

Making communications land - Are they received and understood as intended? we...
Making communications land - Are they received and understood as intended? we...Making communications land - Are they received and understood as intended? we...
Making communications land - Are they received and understood as intended? we...Association for Project Management
 
Python Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docxPython Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docxRamakrishna Reddy Bijjam
 
SOC 101 Demonstration of Learning Presentation
SOC 101 Demonstration of Learning PresentationSOC 101 Demonstration of Learning Presentation
SOC 101 Demonstration of Learning Presentationcamerronhm
 
Food safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdfFood safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdfSherif Taha
 
Jamworks pilot and AI at Jisc (20/03/2024)
Jamworks pilot and AI at Jisc (20/03/2024)Jamworks pilot and AI at Jisc (20/03/2024)
Jamworks pilot and AI at Jisc (20/03/2024)Jisc
 
FSB Advising Checklist - Orientation 2024
FSB Advising Checklist - Orientation 2024FSB Advising Checklist - Orientation 2024
FSB Advising Checklist - Orientation 2024Elizabeth Walsh
 
Graduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - EnglishGraduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - Englishneillewis46
 
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...ZurliaSoop
 
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptxBasic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptxDenish Jangid
 
How to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POSHow to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POSCeline George
 
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptxHMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptxEsquimalt MFRC
 
How to setup Pycharm environment for Odoo 17.pptx
How to setup Pycharm environment for Odoo 17.pptxHow to setup Pycharm environment for Odoo 17.pptx
How to setup Pycharm environment for Odoo 17.pptxCeline George
 
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdf
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdfUnit 3 Emotional Intelligence and Spiritual Intelligence.pdf
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdfDr Vijay Vishwakarma
 
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptx
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptxHMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptx
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptxmarlenawright1
 
On National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan FellowsOn National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan FellowsMebane Rash
 
Application orientated numerical on hev.ppt
Application orientated numerical on hev.pptApplication orientated numerical on hev.ppt
Application orientated numerical on hev.pptRamjanShidvankar
 
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...Pooja Bhuva
 
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptxMaritesTamaniVerdade
 
Google Gemini An AI Revolution in Education.pptx
Google Gemini An AI Revolution in Education.pptxGoogle Gemini An AI Revolution in Education.pptx
Google Gemini An AI Revolution in Education.pptxDr. Sarita Anand
 
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdfUGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdfNirmal Dwivedi
 

Último (20)

Making communications land - Are they received and understood as intended? we...
Making communications land - Are they received and understood as intended? we...Making communications land - Are they received and understood as intended? we...
Making communications land - Are they received and understood as intended? we...
 
Python Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docxPython Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docx
 
SOC 101 Demonstration of Learning Presentation
SOC 101 Demonstration of Learning PresentationSOC 101 Demonstration of Learning Presentation
SOC 101 Demonstration of Learning Presentation
 
Food safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdfFood safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdf
 
Jamworks pilot and AI at Jisc (20/03/2024)
Jamworks pilot and AI at Jisc (20/03/2024)Jamworks pilot and AI at Jisc (20/03/2024)
Jamworks pilot and AI at Jisc (20/03/2024)
 
FSB Advising Checklist - Orientation 2024
FSB Advising Checklist - Orientation 2024FSB Advising Checklist - Orientation 2024
FSB Advising Checklist - Orientation 2024
 
Graduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - EnglishGraduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - English
 
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
 
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptxBasic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
 
How to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POSHow to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POS
 
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptxHMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
 
How to setup Pycharm environment for Odoo 17.pptx
How to setup Pycharm environment for Odoo 17.pptxHow to setup Pycharm environment for Odoo 17.pptx
How to setup Pycharm environment for Odoo 17.pptx
 
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdf
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdfUnit 3 Emotional Intelligence and Spiritual Intelligence.pdf
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdf
 
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptx
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptxHMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptx
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptx
 
On National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan FellowsOn National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan Fellows
 
Application orientated numerical on hev.ppt
Application orientated numerical on hev.pptApplication orientated numerical on hev.ppt
Application orientated numerical on hev.ppt
 
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
 
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
 
Google Gemini An AI Revolution in Education.pptx
Google Gemini An AI Revolution in Education.pptxGoogle Gemini An AI Revolution in Education.pptx
Google Gemini An AI Revolution in Education.pptx
 
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdfUGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
 

Kirkpatrick's model

  • 1. + KIRKPATRICK’S LEVELS OF EVALUATION Cindy Yew Curriculum Project Manager Knowledge Universe, CIRC-AIC Asian International College, Singapore 31 January 2012
  • 2. Dr Donald + Kirkpatrick’s ideas on measuring training effectiveness were originally published in 1959. Four level model. Simple. Flexible. Comprehensive. Iae or : im. ro mg suc g . m e pc
  • 3. The four levels of evaluation… + kirkpatrick’s model Level 4: Level 3: Level 2: Level 1 : Image source: uncw.edu
  • 4.
  • 5. + Level 1. Reaction
  • 6. Level 1: Reaction + measures how those who participate in the programme react to the learning experience “a measure of customer satisfaction” - Dr Don Kirkpatrick Image source: wordpress.com
  • 7. Level 1: Reaction + Level 1 evaluates reaction e.g., Questionnaire  Content  Methods  Media  Trainer style  Facilities  Course materials • Did the participants like the training? • Did they consider the training relevant? • Did they find the trainer engaging? Iae or : ma rgnloto mg suc es inad yu m e u a .c
  • 8. Level 1: Reaction + How to collect reactions? 6. Measure reactions against the standard & follow-up where necessary
  • 9. + Level 2. Learning
  • 10. Level 2: Learning + the extent to which participants change attitudes, improve knowledge, and/or increase skill as a result of attending the programme “in order to evaluate learning, the specific objectives must be determined” - Dr Don Kirkpatrick Image source: cartoonstock.com
  • 11. Level 2: Learning + Level 2 measures learning e.g., Interviews Surveys Tests (pre- and post-) Observations Combinations • Did the participants learn what was intended to be taught? • Did the participants experience what was intended for them to experience? Iae or : ma rgnloto mg suc es inad yu m e u a .c
  • 12. Level 2: Learning + How to collect learning?
  • 13. + Level 3. Behaviour
  • 14. Level 3: Behaviour + the extent to which change in behaviour has occurred because the participant attended the training programme. One primary question for training at this level is if there is a transfer of knowledge to application at daily activities? Iae or : b oso g . o mg suc o k olcm e .g e
  • 15. Level 3: Behaviour Level 3 refers to behaviour + e.g., Survey the people who observes the participant in  Monetary action back on the job  Efficiency  Morale  Teamwork  etc… • Did the participants put their learning into effect when back on the job? • Were the relevant skills and knowledge used? • Was there a measurable change in the activity and performance of the participants when back in their roles? Iae or : ma rgnloto mg suc es inad yu m e u a .c
  • 16. Level 3: Behaviour + How to collect behaviour?
  • 17. + Level 4. Results
  • 18. defined as the final results that Level 4: Results + occurred because the participants attended the programme. Iae or : b g o.cm mg suc l s to e op
  • 19. Level 4: Results Level 4 looks at results + e.g., Key Performance Indicators  Volume  Values  Percentages  Timescales  Return on Investment  Other quantifiable aspects of organisational performance, e.g. no. of attrition, wastage, quality rating, achievement of quality and standards, etc. • Did the KPI improve? • To what extent has it improved? Iae or : ma rgnloto mg suc es inad yu m e u a .c
  • 20. Level 4: Results + How to collect results?
  • 21. Summary Iosuc: kka icpr e .cm n or ir t ka nr o f e pr t s
  • 22. + Level 5. Return On Investment
  • 23. kirkpatrick-philip’s model + ROI = evaluating the return on investment
  • 24.
  • 25. + Credits Sources: Evaluating Training Programs: The Four Levels (3rd Edition) - http://bit.ly/uothqS Kirkpatrick's Four-Level Model of Training Evaluation - http://bit.ly/vUuY6c Kirkpatrickpartners - www.kirkpatrickpartners.com/OurPhilosophy/tabid/66/Default.aspx Kirkpatrick’s Four Level of Evaluation - http://youtu.be/oBpI0B5PtaA ROI in Education: Increasing Innovation and Choice - http://youtu.be/qRm9htSI3FM

Notas del editor

  1. Each level is different. Level 1 evaluates Reaction ; Level 2 measures Learning; Level 3 refers to Behavior. Level 4 looks at Results.
  2. At this level, it is important to: collect reactions to instructor, programme, and the learning environment communicate to participants that their feedback is valued Rationale for this level: Reaction can make or break a training programme. Positive reactions are important for trainers who run both in-house and public programmes, e.g., what participants say is often reflected to the managers, who make decisions about the future of training programmes.
  3. Level 1 evaluates Reaction, hence, it is important that people give a positive impression when relating their experience to others who might decide whether to experience the same
  4. Kirkpatrick identified 3 ways of learning that can be accomplished as a result of attending training programmes: Change attitudes - programmes dealing with topics like diversity in the workforce aim primarily at changing attitudes. Improve knowledge - understand new concepts, principles, and/or techniques being taught Increase skills - technical programmes/OJT aim at developing/improving skills. Programmes on topics like leadership, motivation, and communication can aim at all three objectives Rationale for level 2 Learning has taken place when one or more of the following occurs: * Attitudes are changed * Knowledge is increased * Skills is improved
  5. Level 2 measures Learning.
  6. Rationale for level 3: Two reasons for evaluation of behaviour: 1) Benefit of the change 2) Identify if change of behaviour did not occur
  7. Level 3 refers to Behavior, such as “ What behaviour/impact has the training achieved? ” Impacts can be monetary, efficiency, morale, teamwork, etc.
  8. The final results can include increased production, improve quality, decreased costs, reduced frequency, and/or severity of accidents, increased sales, reduced turnover, and higher profits. These are the important reasons for having training programmes. Therefore, state these terms in the final objectives of the training program. These terms can be on long-term basis.
  9. Level 4 looks at Results
  10. No shortcut for the Kirkpatrick’s 4 levels of evaluation. Evaluation bypassing levels 1 & 2 in order to measure changes in behaviour (level 3) is a serious mistake. For e.g., suppose no change in behaviour is discovered. Assumed conclusion is that the programme was ineffective and should be discontinued. This conclusion may not be accurate. Reactions may have been accomplished, but the level 3 or 4 conditions may not have been present. In order for change to occur, four conditions are necessary: 1. The person must have a desire to change 2. The person must know what to do and how to do it 3. The person must work in the right climate 4. The person must be rewarded for changing The training programme can accomplish the first two requirements by creating a positive attitude toward the desired change and by teaching the necessary knowledge and skills. The third condition, right climate, refers to the participant ’s immediate supervisor. Without the right climate, participants may not attempt to use what they have learned. Ways to create a positive job climate: * involve bosses in the development of the programme, for e.g., asking bosses to help determine the needs of subordinates. Such involvement helps to ensure that a programme teaches practical concepts, principles, and techniques. *present the training programme to the bosses/supervisors before the participants are trained.
  11. The fifth level “ROI” was a recent addition to the model by Phillip. It refers to evaluating the return on investment; but this was not in Kirkpatrick’s original model. Putting into perspective ROI in education, what does it mean? How do we know if the training investment pay off? Think about that.
  12. This is an hour long video about ROI in education at the 2010 Social Enterprise Conference, where Professor Jonah Rockoff leads a discussion of how capital is being raised for education reform, and where is it being used to develop innovative, scalable, and sustainable solutions in education. At this point, as ROI is not the focus for this Kirkpatrick’s 4 levels of evaluation presentation, I do encourage you to watch it at your own time. This video is definitely informative and will expand your knowledge about the understanding for the returns on investment in education. See the relevance of what you are instilling in the training evaluation model and you will see the returns on investment soon to come.