In a webinar in the Annie E. Casey Foundation’s Using What Works to Improve Child Well-Being series, an expert panel discusses how the Youth Experience Survey, one of the key tools in the Evidence2Success framework, generates data on risk and protective factors that help communities address problems for youth before they start.

1. 1
THE ANNIE E. CASEY FOUNDATION
WEBINAR
identifying
community
priorities
JULY 21, 2016

2. Partnerships
Goals
Data
Actions
Coordinated
Accessible
Well-
Attended
High Quality
Developmentally On Track:
Productive
Connected
Healthy & Safe
Webinar Host: The Forum for Youth Investment
2

3. Programs
and
Services
Leaders
Child and
Youth
Outcomes
The Need for Alignment and Precision
3

4. Today’s Presenters
4
Thaddeus
Ferber,
The Forum
for Youth
Investment
(Host and
moderator)
Ilene
Berman,
The Annie E.
Casey
Foundation
Kevin
Haggerty,
Social
Development
Research
Group
Jeremiah
Newell,
Mobile Area
Education
Foundation
Rebecca
Boxx,
Providence
Children and
Youth
Cabinet

5. 5
Communicate with us using the Q&A window at the
right of the presentation window.
• Type questions for the panel at any time during the
webinar.
• Use the box to let us know if you are having
technical difficulties.
Communicating During the Webinar

6. Ilene Berman
The tools of Evidence2Success
6

7. The Annie E. Casey Foundation
develops solutions to
build a brighter future for
children, families
and communities.
7

8. Governance
structure
including public
systems and
community
Strategic use of
data
Comprehensive
financing
strategies
Implementation
of tested,
effective
programs
Performance
measures
8
The Evidence2Success Framework

9. 9
The Evidence2Success Process
Youth
Experience
Survey
Fund-
Mapping Tool
and
Strategies
Blueprints
Database of
Evidence-
Based
programs
Implemen-
tation
Dashboard

10. 10
Preventing Problems Before They Start (April 28)
Concepts of Prevention Science and Finding Proven Programs
Listen to the Recording:
http://www.aecf.org/blog/webinar-recording-experts-prescribe-
prevention-science-to-keep-kids-on-right-path/
Identifying Community Priorities (July 21)
Gathering data from the Youth Experience Survey and working
together to choose priority outcomes
Strategic Financing for Tested, Effective Programs (October 13)
Using financing tools and strategies to identify resources for tested,
effective programs
The Using What Works Webinar Series

11. • Assess local levels of risk, protection and
developmental outcomes in youth in a
way that allows prioritization of needs
within each community
• Provide youth a voice on their perceptions
of what is happening in their community
• Match prioritized risk, protection and
outcomes with evidence based prevention
and early intervention programs
Goal of Youth Experience Survey
Community-Wide Assessment
11

12. 12
• Data from Youth Experience
Survey
– Developmental outcomes
– Risk and protective
factors
• National and state comparison
data
• Administrative data — to
complement outcome data,
e.g., graduation rates
Types of Data Used in Community Assessment

13. 13
Q. Do you use survey data to
determine community priorities for
young people?
Check “yes” or “no” in the polling area to the
right.
Answer the Poll!

14. Kevin Haggerty
About the Youth Experience Survey
14

15. The Evidence2Success Youth Experience Survey
• Student-report classroom survey for
students in grades 6 & 8 (middle school),
and 10 & 12 (high school)
• Survey includes valid and reliable scales
from other validated community surveys,
such as the Communities that Care
Youth Survey, the Strengths and
Difficulties Questionnaire and others
15

16. Common risk factors can predict multiple outcomes
P
16
P

17. 17
Child well-being outcomes
• Five outcome areas
1. Education
2. Behavior
3. Emotional well-being
4. Positive relationships
5. Physical health
The survey shows how children are doing and
areas of elevated risk that predict poor outcomes
Risk and protective factors
• Four domains of influence
1. Peer/individual
2. Family
3. Community
4. School

18. Risk Factors by Domain Measured by YES
Community
Low Neighborhood Attachment
Community Disorganization
Transitions and Mobility
Perceived Availability of Drugs
Perceived Availability of Handguns
Perceived Racial Discrimination
Family
Poor Family Management
Family Conflict
Parental Attitudes Favoring Drug Use
Parental Attitudes Favoring Antisocial
Behavior
Peer/Individual
Rebelliousness
Early Problem Behavior
Early Initiation of Drug Use
Low Perceived Risk of Drug Use
Friends’ Antisocial Behavior
Friends’ Gang Involvement
Victim of Repeated Aggression
Employed More 20 Hrs./Week
School
Academic Failure
Low Commitment to School
Past Grade Retention
18

19. Example of Scale and Items: Perceived Risk of
Drug Use
19

20. 0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
PercentReportingRisk
2016 (83.2%) BH Comparison
Community FamilySchool Peer-Individual
Year of Administration (Response Rate)
Less than 50% of students responded to the questions measuring this factor.* Items only asked in High School
J
L
20
SAMPLE RISK PROFILE, 10TH GRADE

21. Protective Factors by Domain Measured by YES
Community
Opportunities for prosocial
involvement in the community
Recognition for prosocial involvement
in the community
Collective efficacy
Family
Attachment to parents
Family opportunities for prosocial
involvement
Family recognition for prosocial
involvement
Parental use of positive discipline
strategies
Parental involvement in education
Peer/Individual
Social skills
Clear standards for behavior
Prosocial friends
Rewards for prosocial involvement
Prosocial Involvement
Physical activity
School Academic self-efficacy
School opportunities for prosocial
involvement
School recognition for prosocial
involvement
21

22. 22
Example School Protective Factor Scales and Items

23. 23
SAMPLE PROTECTIVE PROFILE, 10TH GRADE
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
PercentReportingProtection
2016 (83.2%) BH Comparison
Community School Family Peer-Individual
Year of Administration (Response Rate)
Less than 50% of students responded to the questions measuring this factor.* Items only asked in High School
L
J

24. Outcomes Measured by YES
Behaviors Prosocial behavior
Antisocial behavior (delinquency, conduct problems, gang
involvement)
Sexual behavior (risky sexual behavior, STI, pregnancy)
Substance use (alcohol, tobacco, other drugs)
Education Academic performance (self-reported grades)
School suspensions/expulsions
Emotional wellbeing Emotional regulation
Anxiety and depression
Suicidal thoughts
Relationships With peers, parents/caregivers and other adults
Physical health Chronic health problems (e.g., asthma, ADHD)
Sick days past month
24

25. 1. Gives youth a voice about their perceptions
of how life is going in your community
2. Provides a picture of youth well-being
across the community and the root causes
affecting it.
3. Allows communities and public system
partners to use local data to set shared
priorities.
4. Allows you to speak the same language for
data-driven decision making.
Benefits of the Youth Experience Survey (YES)
25

26. 26
Q. Do you gather survey data on
the risk and protective factors for
young people in your community?
Check “yes” or “no” in the polling area to the
right.
Answer the Poll!

27. Jeremiah Newell
Launching the Youth Experience Survey
in Mobile
27

28. 28
Why Evidence2Success for Mobile?
Mobile joined Evidence2Success because…
• We need to focus on needs of youth and families in
our community.
• We believe in multi-agency and authentic community
collaboration.
• We want to ensure we are using tested, proven
programs and practices.
• We must use data on strengths and needs to
determine priorities and track progress.

29. 29
Why the Youth Experience Survey?
We cannot foster healthy youth development
without understanding youths’ experiences at
school, at home and in our community.
Youth Experience
Survey

30. Youth Experience Survey Addresses Many
Domains
30
Children’s
Health and
Development
Behavior
Educa-
tional
Achieve-
ment
Emotional
Well-
being
Physical
Health
Relation-
shipsYouth
Experience
Survey

31. 31
Barriers to Survey Administration
Not another
survey!
We don’t have
the time...
Our community
isn’t ready for
this kind of
survey.
Who’s to blame if
the data aren’t
good?

32. 32
Garnering Support for the Youth Experience
Survey
1. Partner with the school district to improve youth
outcomes….not just administer a survey
2. Share the survey with the school district to
determine how to best administer it
3. Be prepared and willing to make adjustments to the
survey, if needed
4. Make survey administration as easy as possible for
schools
5. Select a time in the school year that works, be
prepared for administration and thoroughly
communicate with all parties during administration

33. 33
Next Steps for Youth Experience Survey
Review risk
and protective
factors from
survey
Identify priority
youth
outcomes
Correlate
survey data
with
administrative
data
Select tested,
proven
programs to
address
priority areas
Re-administer
YES Survey
every three
years

34. 34
Q. What are the benefits and
barriers you might face in trying to
administer the Youth Experience
Survey?
Enter your thoughts in the Chat box to
your right.
Tell Us What You Think

35. Rebecca Boxx
Continuous data collection in Providence
35

36. 36
• Providence is the pilot site for Evidence2Success
• Our first accomplishment was administering the YES
survey to 6,000 youth
• Concern at the outset over ‘another survey’ was
mitigated by prevention-focus
In the beginning…

37. 37
Sample Data from Providence’s Youth Experience
Survey

38. 38
Know Your Data Meetings

39. 39
Joint Priority Setting

40. 40
Program Selection – Blueprints Database

41. 41
• We recently re-administered
the YES Survey in March
2016!
• Using the data to make the
case for funding, allocating
resources
• Continuing the practice of
priority-setting based on
voices of our youth
Gaining Traction, Ensuring Sustainability

42. 42
Please use the Q&A function on your
screen to submit questions.
A recording of this webinar will be sent to
those who registered and posted at
www.aecf.org/blog.
Questions?

43. 43
Strategic Financing for Tested, Effective Programs
2 p.m. — 3 p.m. ET
Thursday, Oct. 13, 2016
Register at http://bit.ly/29ZjEKP
For additional information after this webinar:
Kate Shatzkin, kshatzkin@aecf.org
For supplemental materials and more information about
Evidence2Success tools: www.aecf.org
Next in Our Webinar Series