Identifies and analyzes learning and performance problems
Design, plans, and develops instructional interventions using appropriate strategies and techniques
Develops an evaluation plan for a project based on stated goals and recognized standards
Narrative
The document I chose for the competency Apply Instructional Design Principles is the evaluation plan I created for EDCI 577. The modules are directed at retirement plan members within 5 years of retirement who are preparing by investigating how to calculate their benefit amounts.
Identifies and analyzes learning and performance problems
The Executive Summary describes the learning challenges faced by Colorado PERA. The organization provides a variety of tools for members to use to generate their own benefit estimates. However, the plan members are reluctant to use those calculators because they do not understand them. In lieu of the organization re-designing the tools to make them more intuitive, the organization can re-design workshops to drive members to the website and teach them how to use the tools effectively in their retirement planning process. The ultimate goal of the training, aside from increasing member usage of the web-based calculators is to reduce the number of written Retirement Benefit Estimates requested through the Customer Service Division and generated by the Benefit Services Division.
Design, plans, and develops instructional interventions using appropriate strategies and techniques
The modules, described in the section, Evaluation Goals and Scope: Modules and Audiences, are classroom-based. The first in the series, Module 2.0, covers concepts and information that are critical to understand before using the calculators. Module 2.5 directly addresses using the relevant calculators for benefit estimation.
Develops an evaluation plan for a project based on stated goals and recognized standards
The evaluation data collected for Kirkpatrick's Level 4 will measure the impact of any plan members' behavior change on Benefits Services and Customer Service. The data collection will include:
Number of written benefit estimates processed by Benefit Services
Number of requests for assistance with calculators handled by Customer Service
Number of Individual Appointments for the sole purpose of obtaining a retirement benefit estimate
Usage of the Highest Average Salary Calculator (HAS)
Usage of the Retirement Benefit Estimate Calculator
This data will be collected both before and after training implementation. The process is described in the evaluation plan as are expected trends in member behavior.