This presentation examines inter-rater reliability of the HSP portfolio rubric in addition to student and faculty experiences with the Capstone course.

1. Capstone Portfolio Assessment Project Susan Kincaid and Jackie Baker-Sennett Department of Human Services and Rehabilitation Western Washington University This project was made possible through support from the Woodring College of Education Assessment Committee, WWU

3. Background: The HSP Curriculum As part of a comprehensive curriculum revision in 2006 the Human Services Program moved to a standards based curriculum, with student learning assessed through a comprehensive Capstone Portfolio.

6. While most Human Services programs in the US require students to complete some type of showcase portfolio, to our knowledge Western Washington University is unique in requiring a comprehensive standards-based capstone portfolio as a benchmark assessment for program completion.

10. Completion

12. Spring 2008, Bellingham

18. Table 1: Mean (SD) Rubric Scores by Section 9.83 (.58) 8.79 (1.79) 9.0 (1.2) 9.91 (.31) 8.68 (1.06) Professional Self (10pt) 9.58 (1.44) 6.96 (2.29) 9.73 (.72) 9.64 (.67) 8.83 (.97) Technology (10pt) 10 (0) 6.92 (2.4) 9.73 (.70) 9.55 (.82) 8.40 (2.11) Information Literacy (10pt) 9.5 (1.73) 7.0 (2.45) 8.0 (2.83) 9.27 (1.0) 8.68 (1.17) Critical Thinking (10pt) 10 (0) 7.29 (2.14) 9.27 (1.32) 9.36 (1.57) 8.92 (1.09) Writing Proficiency (10pt) 39.79 (.72) 34.29 (5.65) 35.75 (3.8) 37.9 (4.41) 34.53 (3.93) National Standards (40pt) 10 (0) 8.21 (1.6) 9.50 (.96) 9.55 (.82) 9.10 (.85) Portfolio Organization (10pt) #5 98.71 #4 79.46 #3 90.98 #2 95.18 #1 87.13 Section Mean Total n= 103, Includes Bellingham, Everett, and Bremerton sections

20. Intraclass Correlations Coefficient NS .491 Total Score .009 .712 7. Professional Self NS .275 6. Technology [Tied to ISTE standards] NS .153 5. Information literacy [Tied to ALA standards] NS .463 4. Critical Thinking NS .259 3. Writing proficiency NS .524 2. CSHSE National Standards [for HS Education] NS .399 1. Organization P-value Intraclass Correlation Coefficient Dimension

26. Student Exit Survey Results * * Includes 112 exiting seniors, Spring 2008. Statement Agree Disagree My capstone portfolio demonstrates that I meet CSHSE Standards. 56% 45% Creating a Capstone Portfolio was a valuable part of my learning experience. 27% 45% Overall: Satisfaction with HS quality of course content. 91% 9%

33. “ A portfolio tells a story. It is the story of knowing. Knowing about things... Knowing oneself... Knowing an audience... Students prove what they know with samples of their work.” (Paulson & Paulson, 1991, p.2)