12. Question – we develop and implement training that Absolutely Un True= 1 ; Absolutely True = 5 Link needs to business solutions 1 2 3 4 5 Based on assessment of current vs. desired performance 1 2 3 4 5 Isolate application and business impact objectives 1 2 3 4 5 Ensures communication of expectations to stakeholders and participants 1 2 3 4 5 Ensures the work environment supports reinforcement of implementation and application 1 2 3 4 5 Builds partnerships with managers 1 2 3 4 5 Measures at more than reaction and learning level 1 2 3 4 5 Communicates the results to all stakeholders 1 2 3 4 5
13. How Does Your Organization Score 8-15 Activity based Little Focus on Results 24-31 Significant progress To Results Based 16-23 Moderate shift Or Shift in Certain Areas 32- 40 Fully Integrated Results Based System Which Individual Areas Do You Need to Address?
14. Activity Results No established business need Business case Little relation to performance Focus on improving performance/change behavior No/little focus on objectives/competencies Demonstrating competence over time No/Little focus on preparing the environment Prepare environment to ensure transfer and reinforcement No/Little focus on measuring impact and value System geared to preparing and proving the case Mainly input focused Sound balance between input and output
18. Evaluation Approach Element Description Reaction Happiness with learning interventions Learning Changes in knowledge, skills and attitudes Transfer/application Changes in on the job behaviors over time (competence) Business Impact Changes in impact variables ROI Intervention benefits in relation to cost Intangibles Intervention benefits in relation to policy and/or strategic direction and related factors
19. Evaluation Approach Administrator Business Partner Customer Focus Data Availability Value of Case (relative) Intangibles ROI Business Impact Application and implementation Learning Reaction Element Assessment Complexity Limited/Low Wide/High Consumer Client Readily Research Limited/Low Wide/Complex
23. Isolation Framework External Factors Management Attention Incentives Systems/Procedures Changes Learning Program TOTAL IMPROVEMENT AFTER PROGRAM EFFECT OF LEARNING ON IMPROVEMENT
24. Calculation Benefit/Cost Ratio = Benefits ROI = Program Benefits Program Costs Net Program Benefit Program Costs X 100 1