performance accountability pp

1. WIOA
Performance
Accountability
Overview
Wednesday, October 25, 2017

2. Workforce Innovation and Opportunity Act: Summary
34 CFR Parts 361 and 463
The Departments of Education (ED) and Labor (DOL) issue this Joint Final Rule
to implement jointly administered activities authorized by title I of the
Workforce Innovation and Opportunity Act (WIOA) signed into law on July 22,
2014. Through these regulations, the departments implement workforce,
education, and employment system reforms and strengthen the nation’s
public workforce development system.
This Joint WIOA Final Rule provides guidance for State and local workforce
development systems that increase the skill and credential attainment,
employment, retention, and earnings of participants, especially those with
significant barriers to employment, thereby improving the quality of the
workforce, reducing dependency on public benefits, increasing economic
opportunity, and enhancing the productivity and competitiveness of the nation.
2

3. WIOA GOAL
Number 1:
Serving
Job Seekers
Workforce InnovationOpportunity
Act - Serving Job Seekers
Employment
Education
Training
Support Services
3

4. WIOA GOAL
Number 2:
Serving
Employers
Workforce InnovationOpportunity
Act - Serving Employers
SkilledWorkers
Information
Job Fairs
Support Services
4

5. WIOA Combining Labor and Education Programs
In Illinois that means 4 Core Agencies have to figure out how to blend 6 Core Programs.
U.S. Department of Labor
• Title I – Adults, Dislocated Workers,
Youth
• Title III –Wagner-Peyser
U.S. Department of
Education
• Title II – Adult Education
• Title IV – Rehabilitative Services
5

6. WIOA Aligning
Performance
Objectives
• Align Performance-related definitions
• Streamline performance indicators
• Integrate reporting
• Collect comparable data across 6 programs
• Implement Program Specific Requirements
Performance Accountability
6

7. Workforce Innovation and Opportunity Act
Timeline July 2014 – WIOA enacted into law - Reformed the performance measures for
core programs existing measures changed and new measures added.
July 2015 – WIOA law in effect – Determine how to report on the new
performance measures. Not accountable for reporting on them yet.
July 2016 – New Performance Measures Effective – Illinois will start reporting on
some of the measures while DOL extended the deadline of other new baseline
measures.
July 2018 –The first full year ofWIOA performance reporting on outcomes for
all six measures for all Core Partners.
7

8. KeyTerms and Definitions
Reportable Individual: An individual who has taken action that demonstrates an intent to use program
services and who meets specific reporting criteria of the program.
Participant: A reportable individual who has received services after satisfying all applicable
programmatic requirements for the provision of services, such as eligibility determination.
Program Exit: The date of exit from the program is the last date of service. The date cannot be
determined until 90 days have lapsed since the participant received his last services and no future
services are planned.
Participant Individual Record Layout (PIRL): The data layout that provides a standardized set of
data elements, definitions, and reporting instructions that will be used to describe the characteristics,
activities and outcomes ofWIOA participants.
8

9. KeyTerms and Definitions
Secondary School Diploma: A high school diploma or its equivalency.
Supplemental Wages: Compensation received from employment that is in addition to
the regular, ordinary salary or wages.
Unsubsidized Employment: Employment in the private or public sector for which the
employer does not receive a subsidy from public funds to offset all or a part of the wages
and costs of employing an individual.
9

10. WIOA Primary Indicators of Performance
Employment
Rate 2nd Quarter
After Exit
Employment
Rate 4th Quarter
After Exit
Median Earnings
2nd Quarter After
Exit
Credential
Attainment
Measurable Skill
Gains
Effectiveness in
Serving
Employers
10

11. Primary Indicator # 1 – Employment Rate 2nd Quarter
After Exit
• Define:The percentage of
participants who are in unsubsidized
employment during the second
quarter after exit from the program.
• Title IYouth can be in employment
OR education to count as a positive
in this measure.
• Supplemental wage information is
allowed to verify employment.
• Calculation/ Methodology:
The number of participants who
exited during the reporting period
who are found to be employed in the
second quarter after exit DIVIDED
by the number of participants who
exited during the quarter.
11

12. Primary Indicator # 2 – Employment Rate 4th Quarter
After Exit
• Define:The percentage of
participants who are in unsubsidized
employment during the fourth
quarter after exit from the program.
• Title IYouth can be in employment
OR education to be counted as a
positive in this measure.
• Supplemental wage records are
allowed to verify employment.
• Calculation/ Methodology:
The number of participants who
exited during the reporting period
who are found to be employed, in
the 4th quarter after the exit quarter
DIVIDED by the number of
participants who exited during the
reporting period.
12

13. Primary Indicator # 3 – Median Earning 2nd Quarter After
Exit
• Define:The median earnings of
participants who are in unsubsidized
employment during the second
quarter after exit from the program.
• Participants who exited and are not
employed in the 2nd exit quarter will
not count in this measure.
• Supplemental wage information
can be used to verify wages.
• Calculation/ Methodology:
Total quarterly earnings for all participants
employed in the second quarter after exit
are collected. The wage information values
are listed in order from the lowest to
highest value and the value in the middle of
this list is the median earnings value.
TheWage Conversion Chart is used to
convert supplemental wage values that
don’t represent the total amount the
participant earned in the second quarter
and should be used only when earnings
information is not available.
13

14. Primary Indicator # 4 – Credential Attainment
• Define:The percentage of those participants
enrolled in an education or training program who
attain a recognized postsecondary credential or
a secondary school diploma, or its recognized
equivalent, during participation in or within one
year after exit from the program.
• Only includes those who received training or
education.
• On –the –JobTraining (OJT) and customized
training do not count as credentials for this
measure
• Credentials can be obtained during the program
or within 1 year following exit.
• If a participant obtains a secondary school
diploma or equivalent, in order to count in the
numerator, (as a positive) they must also be
employed or in an education/training program
leading to a postsecondary credential within one
year after exit.
• Participants who achieve multiple credentials
should be reported based on the highest
credential attained for that period of
participation.
• A participant should only be included in the
numerator and denominator of this indicator once
per period of participation.
• (SeeTEGL 10-16 Change 1. page 12 for
Methodology/Calculation.)
https://wdr.doleta.gov/directives/corr_doc.cfm?D
OCN=3255
14

15. Primary Indicator # 4
– Credential
Attainment
1. Secondary School Diploma or recognized equivalent
2. Associate’s Degree
3. Bachelor’s Degree
4. Graduate Degree for purposes of theVR program
5. Occupational Licensure
6. Occupational Certificate, including Registered
Apprenticeship and Career andTechnical Education
educational certificates
7. Occupational Certification
8. Other recognized certificates of industry/occupational
skills completion sufficient to qualify for entry-level or
advancement in employmentTypes of Acceptable Credentials
15

16. Primary Indicator # 4 – Credential Attainment
What type of credentials count?
• A recognized postsecondary credential is defined as a credential
consisting of an industry-recognized certificate or certification a
certificate of completion of an apprenticeship, a license recognized by
the State or Federal Government, or an associate or baccalaureate
degree
• Such certificates must recognize technology or industry/occupational
skills for the specific industry/occupation rather than general skills
related to safety, hygiene, etc., even if such general skills certificates are
broadly required to qualify for entry-level employment or advancement
in employment.
16

17. Primary Indicator # 4 – Credential Attainment
What type of credentials DO NOT count?
• Certificates that DO NOT document the measurable technical or
industry/ occupational skills necessary to gain employment or advance
within an occupation.
• Examples include:
– OSHA 10 or OSHA 30 hour safety courses,
– Work readiness certificates, ie; food handlers, CPR/First Aid
certifications…
– Completion of orientation or mobility training
– Workforce Development Board (WDB) certificates
17

18. Primary Indicator # 5 – Measurable Skill Gains (MSG)
• Define:The percentage of participants who, during a
program year, are in an education or training
program that leads to a recognized postsecondary
credential or employment and who are achieving
measurable skill gains, defined as documented
academic, technical, occupational, or other forms of
progress, towards such a credential or employment.
• This measures interim programs of participants for a
specified reporting period and is not an exit based
measure.
• Intended to capture important progress through
pathways offering different needs based services that
can help fulfill a diverse workforce system tailored to
individual needs and goals.
• OJT’s and Customized training DO count for this
indicator.
• Does not apply toTitle III.
• Calculation/ Methodology:
Calculation includes all participants:
The number of program participants who are in an
education or training program leading to a recognized
post secondary credential or employment and are
achieving measurable skill gains based on attainment of
at least one type of gain DIVIDED by the number of
program participants during the reporting period who
are in an education or training program that leads to a
recognized postsecondary credential or employment.
• A participant may have achieved more than one type
of gain in a reporting period; however only one gain
per participant in a reporting period may be used
towards success in the MSG indicator.
• The MSG indicator is the only measureTitle II is
reporting on for the first two years ofWIOA.
18

19. Primary Indicator # 5
– Measurable Skill
Gains (MSG)
1. Documented achievement of at least one educational
functioning level of a participant who is receiving
instruction below the postsecondary education level:
2. Documented attainment of a secondary school diploma
or its recognized equivalent;
3. Secondary or post secondary transcript or report cards for
a sufficient number of credit hours that shows a
participant is meeting the State unit’s academic
standards;
4. Satisfactory or better progress report, toward established
milestones, such as completion of an OJT or completion
of one year of an apprenticeship program or similar
milestones, from an employer or training provider who is
providing training
5. Successful passage of an exam that is required for a
particular occupation or progress in attaining technical or
occupational skills as evidenced by trade-related
benchmarks such as knowledge-based exams.
Documented Progress Defined
19

20. Primary Indicator # 5
– Measurable Skill
Gains (MSG)
Two ways to gain an Educational Functioning
Level (EFL):
1. Accomplish the following:
A. Comparing the participant’s pretest with
the participant’s post-test, using a NRS
approved test
B. Awarding of Carnegie Units or credits in
an adult high school program
C. Enrollment in postsecondary education
and training after exit-Developmental
Education enrollments WILL count toward
MSG
2. Obtaining a secondary credential or its
recognized equivalentEducational Functioning Level
20

21. Primary Indicator # 5 – Measurable Skill Gains
Operational Parameter
• The appropriateTypes
of measurable skill
gains for each core
program are detailed
in the table to the right
• These parameters are
intended to focus
performance
accountability under
measureable skill gains
on the services that are
allowable under the
respective statutory
provisions
21

22. Primary Indicator # 6 – Effectiveness in Serving
Employers
• Purpose - Establish a primary
indicator of performance for
effectiveness of serving
employers
• ThreeApproaches:
1. Retention with same employer
2. Repeat Business Customers
3. Employer Penetration Rate
• Calculation/ Methodology:
At an IWIB meeting on
September 21, 2017 it was voted
on by the board and the Illinois
pilot programs for measuring the
effectiveness of serving
employers will be…
• Approach 1 and Approach 3.
•Agencies are now meeting to
discuss this calculation process.
22

23. Primary Indicator # 6
– Effectiveness of
Serving Employers
• Since this indicator is a new approach for
measuring performance, Departments have
implemented a pilot program during which
States must select 2 of the 3 approaches.
• States may also voluntarily develop an
additional State-specific approach.
• The Departments will evaluate State
experiences with the various approaches and
plan to identify a standardized indicator.
• The Departments anticipate it will be
implemented no later than the beginning of
ProgramYear 2019.New Approach
23

24. Primary Indicators
of Performance:
Unified Reporting
“not quite there yet”
WIOA Section 116(b)(2)(A)
24
The ultimateWIOA performance goal
is for all core agencies to negotiate
and report collaboratively to
DOL/DOE. The states would not
report independently but in one
unified performance dashboard on
the 6 primary indicators.

25. Primary Indicator s-
Baseline Performance
Metrics vs. Required
Indicators
• States will not propose an expected level of
performance in the unified state plan
submission for baseline indicators.
• States will not need to come to an agreement
with the DOL and DOE on negotiated level of
performance for baseline indicators.
• States will not be given sanctions by the
Department of Labor nor the Department of
Education(DOL/DOE) for baseline indicators.
• States will collect data and report on the
baseline indicators to establish the reference
point or “baseline” numbers for the baseline
indicators.
Progress not Perfection
25

26. Primary Indicator s- List of Baseline Performance Metrics
26
Measureable Skills Gain –
A, DW,Youth
Median Earnings 2nd
Quarter after Exit –Youth
Effectiveness in Serving
Employers
Effectiveness in Serving
Employers
Employment 2nd quarter
after exit
Employment 4th quarter
after exit
Median Earnings 2nd
quarter after exit
Credential Attainment
Rate
Effectiveness in Serving
Employers
Employment 2nd quarter
after exit
Employment 4th quarter
after exit
Median Earnings 2nd
quarter after exit
Credential Attainment
Rate
Measurable Skills Gain
Effectiveness in Serving
Employers
Agencies are still in the exploratory and pilot
phases of collecting data on these performance
measures in order to calculate and determine the
“baseline” or “reference point” numbers from
which to begin setting performance standards.

27. Primary Indicator s- List of Reportable Indicators
27
Employment 2nd Quarter
after Exit– A, DW,Youth
Employment 4th Quarter
after Exit – A, DW
Median Earnings 2nd
Quarter after Exit– A, DW
Credential Attainment – A,
DW,Youth
Employment 2nd Quarter
after Exit
Employment 4th Quarter
after Exit
Median Earnings 2nd
Quarter after Exit
Measurable Skills Gain All indicators are currently
baseline for DHS. They do
not have WIOA Reportable
Indicators yet.
Agencies are required to negotiate and report on
these performance standards.

28. Primary Indicators
of Performance:
Where we stand today.
WIOA Section 116(b)(2)(A)
28
Reportable Indicators
Baseline metrics

29. QUESTIONS?
Thank you!
• Title I - Patti Schnoor, DCEO, 217-524-4441;
patricia.schnoor@illinois.gov
• Title II – Ben McDaniel, ICCB, 217-558-5669;
ben.mcdaniel@illinois.gov
• Title III – Sergio Estrada, IDES, 312-793-6213;
sergio.estrada@illinois.gov
• Title IV – Doug Morton, IDHS, 312-814-1936;
douglas.morton@illinois.gov
PanelistContact Information
29