SlideShare una empresa de Scribd logo
1 de 31
Putting Research into Action for Student,
      School and System Success




                Christopher T. King
            The University of Texas at Austin
    Ohio Education Research Center Conference
                     Columbus, OH
                     June 28, 2012
Outline
Background
Central Texas: A Multifaceted, Multi-sector
 Effort
Collective (or Individual) Impact?
Student Futures Project: Research in Action
Successes
Lessons Learned
Our Story Begins

A school board member, a chamber VP, a
 nonprofit director and an academic walk into
 a bar ...
Each is concerned about problems facing the
 education system in Central Texas.
Timely data about the situation and how best
 to address it are difficult to access, of
 dubious quality, and in short supply.
Background
Closing the Gaps reports (2000, 2004) cite the
  challenge of changing demographics: rising %
  Hispanic, first-gen students with much lower college-
  going rates.
2004 Market Street Report highlights growing shortage
  of college-educated talent as problem for Austin v.
  other ‘benchmark’ cities/regions.
2004-2005, Greater Austin Chamber (GAC) asks UT’s
  Ray Marshall Center (RMC) for help with data access
  and use, forms task force to address talent shortage.
2007, Texas creates 3 Education Research Centers
  (ERCs). RMC partners with UT-Dallas and others.
Collective Impact?
Five (5) conditions—
• Common Agenda
• Shared Measurement
• Mutually Reinforcing Activities
• Continuous Communication
• Backbone Support


Does GAC’s Central Texas Initiative qualify?

Source: Hanleybrown, Kania & Kramer, “Channeling Change: Making
Collective Impact Work,” Stanford Social Innovation Review (2012)
Common Agenda
Shared vision for change with common understanding of the
 problem and joint approach to solving it.


    Goals
•   To increase the direct-
    to-college enrollment
    rate to 62% in 2010,
    and to 70% in 2015.
•   To increase college
    and career-readiness
    rates (added later).
Backbone Support
Separate organization with staff and specialized skills serving as
 ‘backbone support’ for the effort and coordinating participating
 organizations.
Greater Austin Chamber (GAC) has:
•   Played a vital, visible, respected role in educational
    policy, programming and systems change.
•   Raised funds via Opportunity Austin and advocated for
    bond elections.
•   Staff highly skilled and experienced in education at all
    levels, and expertise in policy advocacy and coordination
    of complex, multi-faceted efforts.
•   Pressed for accountability at all levels, serving as a
    ‘critical friend’.
Mutually Reinforcing
            Activities
Activities differentiated but coordinated through a mutually
 reinforcing plan of action.
•   Proactive college and career-readiness counseling
    (ISDs, campuses)
•   Tutoring to bring students up to college/career standards
    (nonprofits)
•   Financial Aid Saturdays (GAC, TG, ISDs, volunteers)
•   Early College Connection (Austin Community College)
•   Data collection & analysis (Student Futures Project of
    the RMC, some ISDs)
•   Lobbying for policy and systems change (GAC)
Continuous Communication
Consistent, open communication building trust, assuring mutual
 objectives and creating common motivation.
•   Monthly College Readiness and Enrollment Support
    Team (CREST) meetings, chaired by ISD counselor
    with reps from ISDs, campuses, colleges, non- and for-
    profits.
•   Periodic Financial Aid Task Force meetings.
•   Real-time FAFSA and Common Application reports.
•   Regular ISD and community briefings, including
    reports from the Student Futures Project.
Shared Measurement
Collect data and measure results consistently across actors to
 ensure efforts are aligned and actors are accountable.
•   Student Futures Project collects and analyzes data over
    time.
•   In addition to real-time FAFSA and Common App
    reports, Chamber produces periodic ISD and college
    progress reports.
•   Monthly CREST meetings convened by GAC serve as
    key neutral venues for presenting and discussing results
    and their implications for policies and programs.



Student Futures Project and its role …
Our Story Continues
The school board member, Chamber VP and nonprofit
 director convince the academic to:
•   Identify and assess best practices for data
    collection, analysis and performance management
•   Design an approach to meet Central Texas’ needs


The 2004-2005 LBJ School study led to the launch of
 the Central Texas Student Futures Project, which
 began with a 4 ISD pilot in Spring 2005.
Research Questions
 What are graduating seniors’ high school
    experiences, plans and preparation for life after
    high school?
   What share of high school graduates enroll in
    postsecondary education, become employed,
    or do both in the fall after graduation?
   What share of graduates are enrolled and/or
    employed over time?
   Which factors are significantly associated with
    positive postsecondary education and
    employment outcomes?
   How do outcomes change over time for cohorts of
    graduates and selected populations groups?
Reports can be found at: www.centexstudentfutures.org
Data Sources

   Historical                   Senior Surveys
 School Records                 Family background/
  Student demographics           influences
  Courses taken                High school experiences
  Course grades                Preparation for life after
                                  high school



 Postsecondary
Education Records             Employment Records
  National Student             Texas Unemployment
                                  Insurance (UI) wage records
    Clearinghouse
  Texas Education Research
 Center records
Student Futures Successes

SFP research has informed and contributed to policy
and practice improvements since mid-2000s. For
example:
•   Data on 2- and 4-year, in- and out-of-state college
    enrollments and labor market outcomes
•   ‘Aspiration gap’ and strategies for addressing it
•   Role of financial aid processes and uncertainty
•   Understanding cumulative effects of key activities
    on college-going and variation by student subgroup
•   Describing and understanding varying college,
    training, career & other pathways (underway via
    WDQI & ERC)
Composition of Graduates
                      (2007 Districts)
Shares of Hispanic and low-income graduates gradually increasing.
                                         Class Class Class
                                           of    of     of
                                          2007  2008 2009
                                  Totals 9,410 10,452 10,793
  Ethnicity
   Asian                                   6%      6%     6%
   Black                                  11%     12%    12%
   Hispanic                               29%     31%    32%
   White                                  52%     52%    48%
  Gender
   Female                                 48%     50%    50%
   Male                                   50%     50%    50%
  Family Income Status
   Low-income                             21%     23%    26%
   Not Low-income                         73%     73%    70%
  Special Education Status
   Special Education                       9%      9%     9%
   Not Special Education                  85%     87%    87%
Postsecondary Enrollment of
               Central Texas Graduates in Fall
                    Following Graduation
                       by College Type, Ethnicity and Income Status

                                                    2007                      2008                 2009*

                                            2-Year       4-Year       2-Year       4-Year   2-Year     4-Year

Enrolled Graduates (%)                        22%          40%         22%           39%     23%           38%

Ethnicity
  Asian                                       21%          57%         20%           63%     17%           64%
  Black                                       23%          35%         22%           33%     26%           36%
  Hispanic                                    22%          22%         23%           22%     25%           23%
  White                                       23%          49%         22%           49%     23%           46%
Income Status
  Low-income                                  21%          19%         20%           19%     24%           21%
  Not low-income                              23%          47%         23%           47%     24%           46%
  Unknown                                     21%          12%         21%           12%     19%           5%
* Overall demoninator includes 100 students who lacked enough information to link to NSC
records; 61% reflects the best possible rate using NSC and THECB data.
Regional, State, and National
              Postsecondary Enrollment
                      Outcomes
75%

                                                   70%
70%                                  69%                           68%          68%
                     67%
      66%
65%
                     62%                                                        62%
                                     61%           61%             61%
60%
      57%

55%

                                     54%           54%
                                                                   53%
50%                                                                             52%
      50%            51%


45%
      2006           2007            2008          2009            2010         2011
             TX Enrollment (In-State, THECB)   Central Texas Enrollment (NSC)
             National Enrollment (BLS)
Percent of 2009 Graduates Enrolled in
            Fall 2009, by College Type and District
                          (N=11,993)
80%
                                                        72%
70%

60%

50%
                                                                                                                    44%
                                                                                41%
40%     38%
                    36%                                                                                 35%
                                                                    30%                                                         28%
30%                                                                       27%                     27%
      23%     23%         22%         22%                     25%                           23%               24%
                                18%         19%                                       20%
20%                                               15%                                                                     15%

10%

0%




                                              2-Year                      4-Year
Percent of 2009 Graduates Enrolled
                 in Fall 2009, by Location and District
                               (N=11,993)
80%

70%
                                                                      61%                              60%
60%                                               57%                                       57%
      54%
                 52%                                          52%
50%
                            40%        39%                                       39%                              39%
40%
                                                        30%
30%

20%

10%         7%         7%                                                   7%                               8%
                                                                3%                     3%         4%                    4%
                                  1%         2%
0%




                                       In-State                     Out-of-State
Employment Status, Graduation to Fall 2011
                       Five Quarters Post High School
70%
        2006          2007             2008             2009       2010
      0.61313156   0.628103134      0.552161532    0.539831686   54%

60%




50%




40%
                                                                          2006
                                                                          2007
                                                                          2008
30%
                                                                          2009
                                                                          2010

20%                                                                       2011




10%




0%
Median Wages, Graduation to Fall 2011
                                      Fall After of High School Graduation
                            2007            2008            2009              2010
$6,000
                   $2,064          $1,913          $1,737            $1,842



$5,000




$4,000



                                                                                     2006
$3,000                                                                               2007
                                                                                     2008
                                                                                     2009

$2,000                                                                               2010
                                                                                     2011



$1,000




   $0
College Enrollment Aspiration
                    Gap
100%
                                                  Aspiration Gap
80%                 89%          91%         91%           91%         91%
       82%                                    Want to go to college but
                                                   face barriers, some of
60%                                                them financial
                                              Subset of these students
40%                                                might be considered
                          62%          61%         “low-hanging fruit”
                                                   61%          61%        62%
             57%                              A little help might go a
20%
                                                   long way to increasing
                                                   regional DTC rates.
 0%
        2006          2007         2008        2009        2010         2011

              College Intention (Survey)     College Enrollment (NSC)
College Enrollment
        Aspiration Gap, 2006 through 2011

100%

80%                 89%          91%         91%         91%            91%
       82%
60%

40%
             57%          62%          61%         61%         61%            62%
20%

 0%
        2006          2007         2008       2009         2010          2011

              College Intention (Survey)     College Enrollment (NSC)
Participation in College
                   Preparation Activities,
                               2006 through 2011

100%

80%                                                             89%         91%
                                                                                  24% Points
                                                   81%
                                     77%
60%          67%         70%

                                             55%          56%         58%         18% Points
40%                51%
                               46%
       40%
20%

 0%
        2006        2007        2008           2009         2010       2011

                   FAFSA Submission        College Entrance Test
Senior Survey Recent Trends
                 Plans for Postsecondary Enrollment
100%      91%    91%                           91%
                          86%           88%                           88% 88%
                                                         82%                        81%
75%


50%


25%


 0%
                Overall                       Hispanic                   Low-Income

                                2008           2009            2010



       Primary Reason for Not Choosing Postsecondary Enrollment
40%
                                                                                    36% 36%
             31% 29%                                                          32%
30%
       24%                                23%
20%                                              16% 18%
                          14% 12%
                                  11%
10%                                                             7% 6% 6%

 0%
         Financial         Academic            Personal          Personal           Other
                                              preference         obligation

                                 2008            2009             2010
Senior Survey Recent Trends
          Primary Reason for Not Submitting FAFSA

50%
                                         40% 39%
40%

30%
      22% 22%                22% 22%
20%
                                                    11% 10%
10%              5% 7%

0%
       Do not     Parents    Probably      Don't     Don't
      need aid      not        won't       know       plan
                   willing    qualify     process   to enroll

                     2009               2010
Predicted Cumulative Effects on College
                             Enrollment
                                                                           Baseline Enrollment        Cumulative Effect Enrollment


                             -65%                                                        Overall      4% 3%



                                           -48%                                         Hispanic       6%     6%   5%



                                             -45%                                    Low Income        6%     4% 3% 3% 3%



                                           -49%                                  First Generation       10%        8%   5% 4% 3%



             -81%                                                                   Top Quartile       6%



                        -70%                                                     Second Quartile      6% 3% 3%



                                    -60%                                           Third Quartile      6%     5%



                                                     -39%                           Last Quartile      6%     5% 3%


-100%            -80%               -60%             -40%                   -20%                   0%                   20%
        Met w/Counselor about College             Completed FAFSA                                  Plan to Pay for College Using Loans

        Took SAT/ACT Prep. Course                 Participated in College Fair                     Considered Financial Aid Easy
Lessons Learned
Establishing a robust data-driven approach to shaping
policies and programs is time-consuming and complex.
Turnover will occur among leaders, supervisors,
operating staff, counselors and others. Trusting
relationships must be continually rebuilt.
A continuous improvement, learning process is
preferred to more traditional accountability ones.
Posing the right questions and getting the right
answers are two very different things. The latter may
not be as susceptible to scheduling as the former.
Ongoing researcher/practitioner engagement, top-to-
bottom, is critical, in part to ensure researchers
understand data that practitioners are providing.
Lessons …
Be mindful of unintended consequences; they are
inevitable on both sides. (See “The Importance of
Trusting Relationships”)
Despite recent progress, FERPA may still be a 4-letter
word. Data access can be fragile.
Engaging non-education, non-researcher
stakeholders—especially business and civic leaders—
is difficult and time consuming, but it pays large
dividends over time.
Maintaining research capacity based within colleges or
universities is valuable and lends additional credibility
to educational improvement efforts.
Our Story Isn’t Over Yet
The school board member, Chamber VP and nonprofit
 director and the academic are still working together,
 now joined by an ever wider circle of partners and
 stakeholders.
The Student Futures Project has grown to 12 ISDs,
 surveys 85% of seniors in the 4-county region and
 has 50,000+ students in its longitudinal database.
 Other areas interested in replicating the GAC/SFP
 model.
The Texas ERC now allows survey and job training
 data to be uploaded and linked to education and
 employment records. ERCs are being rebid at
 present, though state support is lacking.
For More Information

Christopher T. King, Director
Ray Marshall Center
Lyndon B. Johnson School of Public Affairs
The University of Texas at Austin
ctking@raymarshallcenter.org
512.471.2186

www.centexstudentfutures.org
www.raymarshallcenter.org

Más contenido relacionado

Destacado

Entrepreneurship Education in SETA
Entrepreneurship Education in SETAEntrepreneurship Education in SETA
Entrepreneurship Education in SETA
lancedafric.org
 
Design and implementation techniques for location-based learning games
Design and implementation techniques for location-based learning gamesDesign and implementation techniques for location-based learning games
Design and implementation techniques for location-based learning games
Javier Melero
 
Data Analysis, Presentation and Interpretation of Data
Data Analysis, Presentation and Interpretation of DataData Analysis, Presentation and Interpretation of Data
Data Analysis, Presentation and Interpretation of Data
Roqui Malijan
 
Data analysis powerpoint
Data analysis powerpointData analysis powerpoint
Data analysis powerpoint
jamiebrandon
 

Destacado (13)

Improving Student Outcomes Through Early Warning Systems
Improving Student Outcomes Through Early Warning SystemsImproving Student Outcomes Through Early Warning Systems
Improving Student Outcomes Through Early Warning Systems
 
Improving Student Outcomes Through Data Dashboards
Improving Student Outcomes Through Data DashboardsImproving Student Outcomes Through Data Dashboards
Improving Student Outcomes Through Data Dashboards
 
Entrepreneurship Education in SETA
Entrepreneurship Education in SETAEntrepreneurship Education in SETA
Entrepreneurship Education in SETA
 
Design and implementation techniques for location-based learning games
Design and implementation techniques for location-based learning gamesDesign and implementation techniques for location-based learning games
Design and implementation techniques for location-based learning games
 
Research paper competition- "Recent Developments in Indian Higher Education"
Research paper competition- "Recent Developments in Indian Higher Education"Research paper competition- "Recent Developments in Indian Higher Education"
Research paper competition- "Recent Developments in Indian Higher Education"
 
Research paper powerpoint presentation for public viewing
Research paper powerpoint presentation for public viewingResearch paper powerpoint presentation for public viewing
Research paper powerpoint presentation for public viewing
 
Konsep & Kaedah Penyelidikan
Konsep & Kaedah PenyelidikanKonsep & Kaedah Penyelidikan
Konsep & Kaedah Penyelidikan
 
Data Analysis, Presentation and Interpretation of Data
Data Analysis, Presentation and Interpretation of DataData Analysis, Presentation and Interpretation of Data
Data Analysis, Presentation and Interpretation of Data
 
Market Research Presentation
Market Research PresentationMarket Research Presentation
Market Research Presentation
 
Quantitative Data Analysis
Quantitative Data AnalysisQuantitative Data Analysis
Quantitative Data Analysis
 
Data analysis powerpoint
Data analysis powerpointData analysis powerpoint
Data analysis powerpoint
 
"Past Present and Future of Entrepreneurship Education" presentation at USASB...
"Past Present and Future of Entrepreneurship Education" presentation at USASB..."Past Present and Future of Entrepreneurship Education" presentation at USASB...
"Past Present and Future of Entrepreneurship Education" presentation at USASB...
 
Research Methodology Lecture for Master & Phd Students
Research Methodology  Lecture for Master & Phd StudentsResearch Methodology  Lecture for Master & Phd Students
Research Methodology Lecture for Master & Phd Students
 

Similar a Ohio Education Research Center: Christopher King Keynote Presentation

EOPS-Celebrating 40 Years Of Service
EOPS-Celebrating 40 Years Of ServiceEOPS-Celebrating 40 Years Of Service
EOPS-Celebrating 40 Years Of Service
Nazaryan
 
How Well is Kentucky Preparing all Students for College, Career, and Life
How Well is Kentucky Preparing all Students for College, Career, and LifeHow Well is Kentucky Preparing all Students for College, Career, and Life
How Well is Kentucky Preparing all Students for College, Career, and Life
nkyec
 
FMP Northwest Planning Area
FMP Northwest Planning AreaFMP Northwest Planning Area
FMP Northwest Planning Area
psnotebook
 
DevFuturesWork_JCPS
DevFuturesWork_JCPSDevFuturesWork_JCPS
DevFuturesWork_JCPS
Sabeen Nasim
 
INET Results-Based Accountability Workshop: May 2, 2014
INET Results-Based Accountability Workshop: May 2, 2014INET Results-Based Accountability Workshop: May 2, 2014
INET Results-Based Accountability Workshop: May 2, 2014
Navicate
 
MOOC Crafting an Effective Writer Overview
MOOC Crafting an Effective Writer OverviewMOOC Crafting an Effective Writer Overview
MOOC Crafting an Effective Writer Overview
Pat James Hanz
 
Microsoft power point drop-out prevention conference presentation 2-12-12
Microsoft power point   drop-out prevention conference presentation 2-12-12Microsoft power point   drop-out prevention conference presentation 2-12-12
Microsoft power point drop-out prevention conference presentation 2-12-12
brunscoschools
 
2010 Annual Report
2010 Annual Report2010 Annual Report
2010 Annual Report
kaufnic
 

Similar a Ohio Education Research Center: Christopher King Keynote Presentation (20)

Utrecht sa- jacqueline e. king
Utrecht  sa- jacqueline e. kingUtrecht  sa- jacqueline e. king
Utrecht sa- jacqueline e. king
 
EOPS-Celebrating 40 Years Of Service
EOPS-Celebrating 40 Years Of ServiceEOPS-Celebrating 40 Years Of Service
EOPS-Celebrating 40 Years Of Service
 
Implementing Effective Family Engagement Strategies
Implementing Effective Family Engagement StrategiesImplementing Effective Family Engagement Strategies
Implementing Effective Family Engagement Strategies
 
Using connect edu student impact data to improve your academy
Using connect edu student impact data to improve your academyUsing connect edu student impact data to improve your academy
Using connect edu student impact data to improve your academy
 
Addressing Issues of Access, Equity and Participation - Belize
Addressing Issues of Access, Equity and Participation - BelizeAddressing Issues of Access, Equity and Participation - Belize
Addressing Issues of Access, Equity and Participation - Belize
 
Governor's Education Summit 10-15-2012
Governor's Education Summit 10-15-2012Governor's Education Summit 10-15-2012
Governor's Education Summit 10-15-2012
 
How Well is Kentucky Preparing all Students for College, Career, and Life
How Well is Kentucky Preparing all Students for College, Career, and LifeHow Well is Kentucky Preparing all Students for College, Career, and Life
How Well is Kentucky Preparing all Students for College, Career, and Life
 
FMP Northwest Planning Area
FMP Northwest Planning AreaFMP Northwest Planning Area
FMP Northwest Planning Area
 
Seeing Students Through: Tools and Strategies for Tracking Students through C...
Seeing Students Through: Tools and Strategies for Tracking Students through C...Seeing Students Through: Tools and Strategies for Tracking Students through C...
Seeing Students Through: Tools and Strategies for Tracking Students through C...
 
A Mixed Methods Approach to Examine Factors Affecting College Students' Time ...
A Mixed Methods Approach to Examine Factors Affecting College Students' Time ...A Mixed Methods Approach to Examine Factors Affecting College Students' Time ...
A Mixed Methods Approach to Examine Factors Affecting College Students' Time ...
 
Moving Beyond Access: Exploring a Continuum of Collaboration and Care to Prom...
Moving Beyond Access: Exploring a Continuum of Collaboration and Care to Prom...Moving Beyond Access: Exploring a Continuum of Collaboration and Care to Prom...
Moving Beyond Access: Exploring a Continuum of Collaboration and Care to Prom...
 
DevFuturesWork_JCPS
DevFuturesWork_JCPSDevFuturesWork_JCPS
DevFuturesWork_JCPS
 
INET Results-Based Accountability Workshop: May 2, 2014
INET Results-Based Accountability Workshop: May 2, 2014INET Results-Based Accountability Workshop: May 2, 2014
INET Results-Based Accountability Workshop: May 2, 2014
 
DE-MYSTIFYING THE U.S. NEWS RANKINGS
DE-MYSTIFYING THE U.S. NEWS RANKINGSDE-MYSTIFYING THE U.S. NEWS RANKINGS
DE-MYSTIFYING THE U.S. NEWS RANKINGS
 
Improvement through the use of data 2015
Improvement through the use of data 2015Improvement through the use of data 2015
Improvement through the use of data 2015
 
MOOC Crafting an Effective Writer Overview
MOOC Crafting an Effective Writer OverviewMOOC Crafting an Effective Writer Overview
MOOC Crafting an Effective Writer Overview
 
Be the Change 2017 - College Access and Completion Panel
Be the Change 2017 - College Access and Completion PanelBe the Change 2017 - College Access and Completion Panel
Be the Change 2017 - College Access and Completion Panel
 
Microsoft power point drop-out prevention conference presentation 2-12-12
Microsoft power point   drop-out prevention conference presentation 2-12-12Microsoft power point   drop-out prevention conference presentation 2-12-12
Microsoft power point drop-out prevention conference presentation 2-12-12
 
2010 Annual Report
2010 Annual Report2010 Annual Report
2010 Annual Report
 
2014 Education Perceptions Poll
2014 Education Perceptions Poll 2014 Education Perceptions Poll
2014 Education Perceptions Poll
 

Más de Ohio Education Research Center

Más de Ohio Education Research Center (20)

Building regional data tools
Building regional data toolsBuilding regional data tools
Building regional data tools
 
Streamlining data usage in michigan using ed fi
Streamlining data usage in michigan using ed fiStreamlining data usage in michigan using ed fi
Streamlining data usage in michigan using ed fi
 
How Arkansas is Effectively Using Data to Guide Instruction
How Arkansas is Effectively Using Data to Guide InstructionHow Arkansas is Effectively Using Data to Guide Instruction
How Arkansas is Effectively Using Data to Guide Instruction
 
Ohio's Student Success Dashboard
Ohio's Student Success DashboardOhio's Student Success Dashboard
Ohio's Student Success Dashboard
 
OCTEO Keynote Presentation
OCTEO Keynote Presentation OCTEO Keynote Presentation
OCTEO Keynote Presentation
 
Getting Ahead of WIOA Standards
Getting Ahead of WIOA StandardsGetting Ahead of WIOA Standards
Getting Ahead of WIOA Standards
 
ODJFS Conference Slides
ODJFS Conference SlidesODJFS Conference Slides
ODJFS Conference Slides
 
The Kentucky Longitudinal Data System – Connecting Education & Outcomes
The Kentucky Longitudinal Data System – Connecting Education & OutcomesThe Kentucky Longitudinal Data System – Connecting Education & Outcomes
The Kentucky Longitudinal Data System – Connecting Education & Outcomes
 
Impact of Career Pathways on Participant and Employer Outcomes
Impact of Career Pathways on Participant and Employer OutcomesImpact of Career Pathways on Participant and Employer Outcomes
Impact of Career Pathways on Participant and Employer Outcomes
 
WORKFORCE OUTCOMES OF WIA-FUNDED ON-THE-JOB TRAINING IN OHIO
WORKFORCE OUTCOMES OF WIA-FUNDED ON-THE-JOB TRAINING IN OHIOWORKFORCE OUTCOMES OF WIA-FUNDED ON-THE-JOB TRAINING IN OHIO
WORKFORCE OUTCOMES OF WIA-FUNDED ON-THE-JOB TRAINING IN OHIO
 
Return on Investment and Performance Measurement of Workforce Development Pro...
Return on Investment and Performance Measurement of Workforce Development Pro...Return on Investment and Performance Measurement of Workforce Development Pro...
Return on Investment and Performance Measurement of Workforce Development Pro...
 
Investing in Career Pathways for Regional Workforce Success
Investing in Career Pathways for Regional Workforce Success Investing in Career Pathways for Regional Workforce Success
Investing in Career Pathways for Regional Workforce Success
 
Measuring Postsecondary Employment Outcomes
Measuring Postsecondary Employment OutcomesMeasuring Postsecondary Employment Outcomes
Measuring Postsecondary Employment Outcomes
 
4th Federal Reserve District Economic Conditions
4th Federal Reserve District Economic Conditions4th Federal Reserve District Economic Conditions
4th Federal Reserve District Economic Conditions
 
An Introduction To and Hands-On Tutorial of OLDA EMIS DATA
An Introduction To and Hands-On Tutorial of OLDA EMIS DATAAn Introduction To and Hands-On Tutorial of OLDA EMIS DATA
An Introduction To and Hands-On Tutorial of OLDA EMIS DATA
 
Bridging the Mathematics Gap in Southern Ohio
Bridging the Mathematics Gap in Southern OhioBridging the Mathematics Gap in Southern Ohio
Bridging the Mathematics Gap in Southern Ohio
 
Using Visualization to Turn Data into Knowledge
Using Visualization to Turn Data into KnowledgeUsing Visualization to Turn Data into Knowledge
Using Visualization to Turn Data into Knowledge
 
Enhancing Decision Making Using Workforce Outcomes in Ohio
Enhancing Decision Making Using Workforce Outcomes in OhioEnhancing Decision Making Using Workforce Outcomes in Ohio
Enhancing Decision Making Using Workforce Outcomes in Ohio
 
OERC Fall 2014 Conference
OERC Fall 2014 ConferenceOERC Fall 2014 Conference
OERC Fall 2014 Conference
 
Pathway to Early Literacy and Reading Proficiency
Pathway to Early Literacy and Reading ProficiencyPathway to Early Literacy and Reading Proficiency
Pathway to Early Literacy and Reading Proficiency
 

Último

Último (20)

Exploring_the_Narrative_Style_of_Amitav_Ghoshs_Gun_Island.pptx
Exploring_the_Narrative_Style_of_Amitav_Ghoshs_Gun_Island.pptxExploring_the_Narrative_Style_of_Amitav_Ghoshs_Gun_Island.pptx
Exploring_the_Narrative_Style_of_Amitav_Ghoshs_Gun_Island.pptx
 
REMIFENTANIL: An Ultra short acting opioid.pptx
REMIFENTANIL: An Ultra short acting opioid.pptxREMIFENTANIL: An Ultra short acting opioid.pptx
REMIFENTANIL: An Ultra short acting opioid.pptx
 
Application orientated numerical on hev.ppt
Application orientated numerical on hev.pptApplication orientated numerical on hev.ppt
Application orientated numerical on hev.ppt
 
Micro-Scholarship, What it is, How can it help me.pdf
Micro-Scholarship, What it is, How can it help me.pdfMicro-Scholarship, What it is, How can it help me.pdf
Micro-Scholarship, What it is, How can it help me.pdf
 
Fostering Friendships - Enhancing Social Bonds in the Classroom
Fostering Friendships - Enhancing Social Bonds  in the ClassroomFostering Friendships - Enhancing Social Bonds  in the Classroom
Fostering Friendships - Enhancing Social Bonds in the Classroom
 
On_Translating_a_Tamil_Poem_by_A_K_Ramanujan.pptx
On_Translating_a_Tamil_Poem_by_A_K_Ramanujan.pptxOn_Translating_a_Tamil_Poem_by_A_K_Ramanujan.pptx
On_Translating_a_Tamil_Poem_by_A_K_Ramanujan.pptx
 
General Principles of Intellectual Property: Concepts of Intellectual Proper...
General Principles of Intellectual Property: Concepts of Intellectual  Proper...General Principles of Intellectual Property: Concepts of Intellectual  Proper...
General Principles of Intellectual Property: Concepts of Intellectual Proper...
 
How to setup Pycharm environment for Odoo 17.pptx
How to setup Pycharm environment for Odoo 17.pptxHow to setup Pycharm environment for Odoo 17.pptx
How to setup Pycharm environment for Odoo 17.pptx
 
How to Add New Custom Addons Path in Odoo 17
How to Add New Custom Addons Path in Odoo 17How to Add New Custom Addons Path in Odoo 17
How to Add New Custom Addons Path in Odoo 17
 
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptxHMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
 
Plant propagation: Sexual and Asexual propapagation.pptx
Plant propagation: Sexual and Asexual propapagation.pptxPlant propagation: Sexual and Asexual propapagation.pptx
Plant propagation: Sexual and Asexual propapagation.pptx
 
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...
 
ICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptxICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptx
 
Interdisciplinary_Insights_Data_Collection_Methods.pptx
Interdisciplinary_Insights_Data_Collection_Methods.pptxInterdisciplinary_Insights_Data_Collection_Methods.pptx
Interdisciplinary_Insights_Data_Collection_Methods.pptx
 
Wellbeing inclusion and digital dystopias.pptx
Wellbeing inclusion and digital dystopias.pptxWellbeing inclusion and digital dystopias.pptx
Wellbeing inclusion and digital dystopias.pptx
 
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdf
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdfUnit 3 Emotional Intelligence and Spiritual Intelligence.pdf
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdf
 
Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)
 
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
 
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptx
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptxHMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptx
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptx
 
Kodo Millet PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...
Kodo Millet  PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...Kodo Millet  PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...
Kodo Millet PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...
 

Ohio Education Research Center: Christopher King Keynote Presentation

  • 1. Putting Research into Action for Student, School and System Success Christopher T. King The University of Texas at Austin Ohio Education Research Center Conference Columbus, OH June 28, 2012
  • 2. Outline Background Central Texas: A Multifaceted, Multi-sector Effort Collective (or Individual) Impact? Student Futures Project: Research in Action Successes Lessons Learned
  • 3. Our Story Begins A school board member, a chamber VP, a nonprofit director and an academic walk into a bar ... Each is concerned about problems facing the education system in Central Texas. Timely data about the situation and how best to address it are difficult to access, of dubious quality, and in short supply.
  • 4. Background Closing the Gaps reports (2000, 2004) cite the challenge of changing demographics: rising % Hispanic, first-gen students with much lower college- going rates. 2004 Market Street Report highlights growing shortage of college-educated talent as problem for Austin v. other ‘benchmark’ cities/regions. 2004-2005, Greater Austin Chamber (GAC) asks UT’s Ray Marshall Center (RMC) for help with data access and use, forms task force to address talent shortage. 2007, Texas creates 3 Education Research Centers (ERCs). RMC partners with UT-Dallas and others.
  • 5. Collective Impact? Five (5) conditions— • Common Agenda • Shared Measurement • Mutually Reinforcing Activities • Continuous Communication • Backbone Support Does GAC’s Central Texas Initiative qualify? Source: Hanleybrown, Kania & Kramer, “Channeling Change: Making Collective Impact Work,” Stanford Social Innovation Review (2012)
  • 6. Common Agenda Shared vision for change with common understanding of the problem and joint approach to solving it. Goals • To increase the direct- to-college enrollment rate to 62% in 2010, and to 70% in 2015. • To increase college and career-readiness rates (added later).
  • 7. Backbone Support Separate organization with staff and specialized skills serving as ‘backbone support’ for the effort and coordinating participating organizations. Greater Austin Chamber (GAC) has: • Played a vital, visible, respected role in educational policy, programming and systems change. • Raised funds via Opportunity Austin and advocated for bond elections. • Staff highly skilled and experienced in education at all levels, and expertise in policy advocacy and coordination of complex, multi-faceted efforts. • Pressed for accountability at all levels, serving as a ‘critical friend’.
  • 8. Mutually Reinforcing Activities Activities differentiated but coordinated through a mutually reinforcing plan of action. • Proactive college and career-readiness counseling (ISDs, campuses) • Tutoring to bring students up to college/career standards (nonprofits) • Financial Aid Saturdays (GAC, TG, ISDs, volunteers) • Early College Connection (Austin Community College) • Data collection & analysis (Student Futures Project of the RMC, some ISDs) • Lobbying for policy and systems change (GAC)
  • 9. Continuous Communication Consistent, open communication building trust, assuring mutual objectives and creating common motivation. • Monthly College Readiness and Enrollment Support Team (CREST) meetings, chaired by ISD counselor with reps from ISDs, campuses, colleges, non- and for- profits. • Periodic Financial Aid Task Force meetings. • Real-time FAFSA and Common Application reports. • Regular ISD and community briefings, including reports from the Student Futures Project.
  • 10. Shared Measurement Collect data and measure results consistently across actors to ensure efforts are aligned and actors are accountable. • Student Futures Project collects and analyzes data over time. • In addition to real-time FAFSA and Common App reports, Chamber produces periodic ISD and college progress reports. • Monthly CREST meetings convened by GAC serve as key neutral venues for presenting and discussing results and their implications for policies and programs. Student Futures Project and its role …
  • 11. Our Story Continues The school board member, Chamber VP and nonprofit director convince the academic to: • Identify and assess best practices for data collection, analysis and performance management • Design an approach to meet Central Texas’ needs The 2004-2005 LBJ School study led to the launch of the Central Texas Student Futures Project, which began with a 4 ISD pilot in Spring 2005.
  • 12. Research Questions  What are graduating seniors’ high school experiences, plans and preparation for life after high school?  What share of high school graduates enroll in postsecondary education, become employed, or do both in the fall after graduation?  What share of graduates are enrolled and/or employed over time?  Which factors are significantly associated with positive postsecondary education and employment outcomes?  How do outcomes change over time for cohorts of graduates and selected populations groups? Reports can be found at: www.centexstudentfutures.org
  • 13. Data Sources Historical Senior Surveys School Records  Family background/  Student demographics influences  Courses taken  High school experiences  Course grades  Preparation for life after high school Postsecondary Education Records Employment Records  National Student  Texas Unemployment Insurance (UI) wage records Clearinghouse  Texas Education Research Center records
  • 14. Student Futures Successes SFP research has informed and contributed to policy and practice improvements since mid-2000s. For example: • Data on 2- and 4-year, in- and out-of-state college enrollments and labor market outcomes • ‘Aspiration gap’ and strategies for addressing it • Role of financial aid processes and uncertainty • Understanding cumulative effects of key activities on college-going and variation by student subgroup • Describing and understanding varying college, training, career & other pathways (underway via WDQI & ERC)
  • 15. Composition of Graduates (2007 Districts) Shares of Hispanic and low-income graduates gradually increasing. Class Class Class of of of 2007 2008 2009 Totals 9,410 10,452 10,793 Ethnicity Asian 6% 6% 6% Black 11% 12% 12% Hispanic 29% 31% 32% White 52% 52% 48% Gender Female 48% 50% 50% Male 50% 50% 50% Family Income Status Low-income 21% 23% 26% Not Low-income 73% 73% 70% Special Education Status Special Education 9% 9% 9% Not Special Education 85% 87% 87%
  • 16. Postsecondary Enrollment of Central Texas Graduates in Fall Following Graduation by College Type, Ethnicity and Income Status 2007 2008 2009* 2-Year 4-Year 2-Year 4-Year 2-Year 4-Year Enrolled Graduates (%) 22% 40% 22% 39% 23% 38% Ethnicity Asian 21% 57% 20% 63% 17% 64% Black 23% 35% 22% 33% 26% 36% Hispanic 22% 22% 23% 22% 25% 23% White 23% 49% 22% 49% 23% 46% Income Status Low-income 21% 19% 20% 19% 24% 21% Not low-income 23% 47% 23% 47% 24% 46% Unknown 21% 12% 21% 12% 19% 5% * Overall demoninator includes 100 students who lacked enough information to link to NSC records; 61% reflects the best possible rate using NSC and THECB data.
  • 17. Regional, State, and National Postsecondary Enrollment Outcomes 75% 70% 70% 69% 68% 68% 67% 66% 65% 62% 62% 61% 61% 61% 60% 57% 55% 54% 54% 53% 50% 52% 50% 51% 45% 2006 2007 2008 2009 2010 2011 TX Enrollment (In-State, THECB) Central Texas Enrollment (NSC) National Enrollment (BLS)
  • 18. Percent of 2009 Graduates Enrolled in Fall 2009, by College Type and District (N=11,993) 80% 72% 70% 60% 50% 44% 41% 40% 38% 36% 35% 30% 28% 30% 27% 27% 23% 23% 22% 22% 25% 23% 24% 18% 19% 20% 20% 15% 15% 10% 0% 2-Year 4-Year
  • 19. Percent of 2009 Graduates Enrolled in Fall 2009, by Location and District (N=11,993) 80% 70% 61% 60% 60% 57% 57% 54% 52% 52% 50% 40% 39% 39% 39% 40% 30% 30% 20% 10% 7% 7% 7% 8% 3% 3% 4% 4% 1% 2% 0% In-State Out-of-State
  • 20. Employment Status, Graduation to Fall 2011 Five Quarters Post High School 70% 2006 2007 2008 2009 2010 0.61313156 0.628103134 0.552161532 0.539831686 54% 60% 50% 40% 2006 2007 2008 30% 2009 2010 20% 2011 10% 0%
  • 21. Median Wages, Graduation to Fall 2011 Fall After of High School Graduation 2007 2008 2009 2010 $6,000 $2,064 $1,913 $1,737 $1,842 $5,000 $4,000 2006 $3,000 2007 2008 2009 $2,000 2010 2011 $1,000 $0
  • 22. College Enrollment Aspiration Gap 100% Aspiration Gap 80% 89% 91% 91% 91% 91% 82% Want to go to college but face barriers, some of 60% them financial Subset of these students 40% might be considered 62% 61% “low-hanging fruit” 61% 61% 62% 57% A little help might go a 20% long way to increasing regional DTC rates. 0% 2006 2007 2008 2009 2010 2011 College Intention (Survey) College Enrollment (NSC)
  • 23. College Enrollment Aspiration Gap, 2006 through 2011 100% 80% 89% 91% 91% 91% 91% 82% 60% 40% 57% 62% 61% 61% 61% 62% 20% 0% 2006 2007 2008 2009 2010 2011 College Intention (Survey) College Enrollment (NSC)
  • 24. Participation in College Preparation Activities, 2006 through 2011 100% 80% 89% 91% 24% Points 81% 77% 60% 67% 70% 55% 56% 58% 18% Points 40% 51% 46% 40% 20% 0% 2006 2007 2008 2009 2010 2011 FAFSA Submission College Entrance Test
  • 25. Senior Survey Recent Trends Plans for Postsecondary Enrollment 100% 91% 91% 91% 86% 88% 88% 88% 82% 81% 75% 50% 25% 0% Overall Hispanic Low-Income 2008 2009 2010 Primary Reason for Not Choosing Postsecondary Enrollment 40% 36% 36% 31% 29% 32% 30% 24% 23% 20% 16% 18% 14% 12% 11% 10% 7% 6% 6% 0% Financial Academic Personal Personal Other preference obligation 2008 2009 2010
  • 26. Senior Survey Recent Trends Primary Reason for Not Submitting FAFSA 50% 40% 39% 40% 30% 22% 22% 22% 22% 20% 11% 10% 10% 5% 7% 0% Do not Parents Probably Don't Don't need aid not won't know plan willing qualify process to enroll 2009 2010
  • 27. Predicted Cumulative Effects on College Enrollment Baseline Enrollment Cumulative Effect Enrollment -65% Overall 4% 3% -48% Hispanic 6% 6% 5% -45% Low Income 6% 4% 3% 3% 3% -49% First Generation 10% 8% 5% 4% 3% -81% Top Quartile 6% -70% Second Quartile 6% 3% 3% -60% Third Quartile 6% 5% -39% Last Quartile 6% 5% 3% -100% -80% -60% -40% -20% 0% 20% Met w/Counselor about College Completed FAFSA Plan to Pay for College Using Loans Took SAT/ACT Prep. Course Participated in College Fair Considered Financial Aid Easy
  • 28. Lessons Learned Establishing a robust data-driven approach to shaping policies and programs is time-consuming and complex. Turnover will occur among leaders, supervisors, operating staff, counselors and others. Trusting relationships must be continually rebuilt. A continuous improvement, learning process is preferred to more traditional accountability ones. Posing the right questions and getting the right answers are two very different things. The latter may not be as susceptible to scheduling as the former. Ongoing researcher/practitioner engagement, top-to- bottom, is critical, in part to ensure researchers understand data that practitioners are providing.
  • 29. Lessons … Be mindful of unintended consequences; they are inevitable on both sides. (See “The Importance of Trusting Relationships”) Despite recent progress, FERPA may still be a 4-letter word. Data access can be fragile. Engaging non-education, non-researcher stakeholders—especially business and civic leaders— is difficult and time consuming, but it pays large dividends over time. Maintaining research capacity based within colleges or universities is valuable and lends additional credibility to educational improvement efforts.
  • 30. Our Story Isn’t Over Yet The school board member, Chamber VP and nonprofit director and the academic are still working together, now joined by an ever wider circle of partners and stakeholders. The Student Futures Project has grown to 12 ISDs, surveys 85% of seniors in the 4-county region and has 50,000+ students in its longitudinal database. Other areas interested in replicating the GAC/SFP model. The Texas ERC now allows survey and job training data to be uploaded and linked to education and employment records. ERCs are being rebid at present, though state support is lacking.
  • 31. For More Information Christopher T. King, Director Ray Marshall Center Lyndon B. Johnson School of Public Affairs The University of Texas at Austin ctking@raymarshallcenter.org 512.471.2186 www.centexstudentfutures.org www.raymarshallcenter.org