Breakout presentation given at the 2014 WASC Core Competencies Retreat on Information Literacy and Critical Thinking in Oakland, CA. Program information: http://www.wascsenior.org/content/retreat-core-competencies-critical-thinking-and-information-literacy

1. S T R A T E G I E S
for holistic assessment
of student IL learning

2. C H A R B O O T H
S T R A T E G I E S
for holistic assessment
of student IL learning
T H E C L A R E M O N T C O L L E G E S L I B R A R Y

3. C H A R B O O T H
S A R A L O W E S E A N S T O N E
N A T A L I E T A G G E D A N I B R E C H E R
S T R A T E G I E S
for holistic assessment
of student IL learning
T H E C L A R E M O N T C O L L E G E S L I B R A R Y

4. holistic assessment
*
of student IL learning

5. holistic assessment
*
of student IL learning

6. a u t h e n t i c
differentiated
holistic assessment
*
of student IL learning
i n t e g r a t e d

7. holistic assessment
*
of student IL learning

8. holistic assessment
*
of student IL learning

9. holistic assessment
*
of stRudUenB t R ILI CleaS rning

10. holistic assessment
*
of stRudUenB t R ILI CleaS rning

11. M A P P I N G
holistic assessment
*
of stRudUenB t R ILI CleaS rning

12. { M A P P I N G
}
R U B R I C S
I L i n f r a s t r u c t u r e

13. { } T H E C L A R E M O N T C O L L E G E S
I L i n f r a s t r u c t u r e

14. { } T H E C L A R E M O N T C O L L E G E S

15. { } T H E L I B R A R Y

16. { }

17. { }
I L i n f r a s t r u c t u r e ?

18. { D I S C U S S :
does your campus/institution
have an infrastructure for
I L A S ? S E S S M E N T ?
}

19. { D I S C U S S :
does your campus/institution
have an infrastructure for
I L A S ? S E S S M E N T ?
} is it adequate to achieve
your STRATEGIC GOALS?

20. { M A P P I N G
} R U B R I C S

21. { }

22. { } C O N T E X T U A L / C U L T U R A L I N V E S T I G A T I O N

23. { C O N C E P T / M I N D M A P P I N G
} m i n d o m o . c o m

24. { C O N C E P T / M I N D M A P P I N G
} K N O W L E D G E M A N A G E M E N T

25. { C O N C E P T / M I N D M A P P I N G
} K N O W L E D G E M A N A G E M E N T

26. { C O N C E P T / M I N D M A P P I N G
} K N O W L E D G E M A N A G E M E N T

27. C U R R I C U L U M V I S U A L I Z A T I O N

28. C U R R I C U L U M V I S U A L I Z A T I O N
c a t a l o g s s c h e d u l e s w e b s i t e s

29. C U R R I C U L U M V I S U A L I Z A T I O N
c a t a l o g s s c h e d u l e s w e b s i t e s

30. C U R R I C U L U M V I S U A L I Z A T I O N

31. C A M P U S

32. P R O G R A M

33. R E Q U I R E M E N T S

34. O B J E C T I V E S / O U T C O M E S

35. A N N O T A T I O N S

36. S C A L I N G U P : I M L S S P A R K S ! G R A N T

37. T E M P L A T E S , S U P P O R T , & T R A I N I N G

38. I D E N T I F Y I N G S C A F F O L D E D I L S E Q U E N C E

39. A L I G N I N G P A S T P R A C T I C E T O F U T U R E T A R G E T S

40. A L I G N I N G P A S T P R A C T I C E T O F U T U R E T A R G E T S

41. D I S C I P L I N A R Y F A C U L T Y I L F O R U M S

42. I N S I G H T
+
S T R A T E G Y

43. I N S I G H T
+
S T R A T E G Y

44. { M A P P I N G
}
R U B R I C S
I L i n f r a s t r u c t u r e

45. { c u s t o m i z e d
R O A D M A P S
} o f l e a r n e r
C O M P E T E N C I E S
R U B R I C S

46. L I B R A R Y I L D E F I N I T I O N

47. I L P ERFORMANCE P ERCE P T I O N S GAP
100%
80%
60%
40%
20%
0%
Faculty
Student
Faculty
Student
Faculty
Student
Faculty
Student
Faculty
Student
Faculty
Student
Write
annotated
bibliographies
Provide
proper
attribution to
source
materials in
their academic
work
Use sources
to further an
argument/
thesis
Evaluate
sources to
determine if
they are
authoritative
Differentiate
between types
of information
sources (e.g.,
scholarly v.
popular
literature, fact
v. opinion)
Effectively use
Library
databases,
catalog(s),
and other
information
resources to
find relevant
source
material
Excellent/Very High
Above Average/High
Average/Moderate
Below Average/Low
Poor/None

48. I L P ERFORMANCE P ERCE P T I O N S GAP
100%
80%
60%
40%
20%
0%
Faculty
Student
Faculty
Student
Faculty
Student
Faculty
Student
Faculty
Student
Faculty
Student
Write
annotated
bibliographies
Provide
proper
attribution to
source
materials in
their academic
work
Use sources
to further an
argument/
thesis
Evaluate
sources to
determine if
they are
authoritative
Differentiate
between types
of information
sources (e.g.,
scholarly v.
popular
literature, fact
v. opinion)
Effectively use
Library
databases,
catalog(s),
and other
information
resources to
find relevant
source
material
Excellent/Very High
Above Average/High
Average/Moderate
Below Average/Low
Poor/None
* * * * * *
* * * * *

54. C A M P U S - L E V E L I M P L E M E N T A T I O N
S C R I P P S
PITZER
P O M O N A
C G U
H M C
K G I
C M C
Grassroots/
consensus
governance
with robust
committee
structure
Pitzer College
Consensus-based
governance
without much
committee
structure
Scripps College
Faculty
committees
with strong
departmental
autonomy
Pomona
College
Top-down/
federated
states
governance
Claremont
Graduate
University
Faculty-committee-based
governance
Harvey Mudd
College
Small/agile/
progressive
committee of
core faculty
Keck Graduate
Institute
Top-down
governance/
assessment
driven
Claremont
McKenna
College

55. Grassroots/
consensus
governance with
robust
committee
structure
Pitzer College
Consensus-based
governance
without much
committee
structure
Scripps College
Faculty-committee-based
with
strong
department
decision making
Pomona College
Top-down/
federated states
governance
Claremont
Graduate
University
Faculty-committee-based
governance
Harvey Mudd
College
Small/agile/
progressive
committee of
core faculty
Keck Graduate
Institute
Top-down
governance/
assessment
driven
Claremont
McKenna
College
SU 2012: Director of
Assessment meets
with librarians to
discuss IL
assessment options
SU 2012: Librarians
edit Carleton College
Rubric to create
Rubric v1.1
SU 2012: Librarians
score First Year
Seminar papers (FYS)
using Rubric v1.2
FA 2012: Faculty
incorporate Rubric
v1.4 into FYS
FA 2012: Librarians
score capstone
papers with Rubric
v1.4
SU 2014: Library
uses AiA Rubric to
evaluate student IL
skills
FA 2012: Writing 50
(first-year seminar)
faculty score papers
using Rubric
2012/2013
SU 2014: Library
uses 5-part Rubric to
evaluate student IL
skills
Future: Hopeful
integration of
2013-14 IL Rubric
into capstone
evaluation
SU 2011:
Environmental
Analysis (EA) Rubric
created based on
Drake Univ. Rubric
SU 2011: Discussions
with faculty improve
rubric & EA program
FA 2011/FA 2012:
EA Rubric used to
develop IL instruction
for EA senior thesis
students
SP 2013: Librarians/
faculty use Rubric
2012/2013 to
evaluate sample EA
theses from three
prior years, submits
to WASC
SU 2013: Library
uses AiA Rubric to
evaluate student IL
skills
SU/FA 2012: Rubric
v1.4 discussed at all
departmental
meetings
SP 2013: Dean
requests Rubric
2012/2013 as
foundation for an IL
instruction session in
methods course /
leads to development
of IL Labs pilot
SP 2013: 5-Part
Rubric provides
foundation for
developing five core
learning outcomes for
IL Labs pilot
Future: Planning for
potential integration
of Rubric into a
Canvas course pilot
as a sample
evaluation object, and
a Thesis/Dissertation
evaluation project
FA 2012: Librarians
and ALO attend
WASC Accreditation
Retreat on Core
Competencies:
Critical Thinking and
Information Literacy
FA 2012: Librarians
present Rubric
2012/13 to
Assessment
Committee
FA 2012: Committee
interested in training
upper class “peers” in
using rubric to
evaluate clinic work
SU 2014: Library
uses AiA Rubric to
evaluate student IL
skills
Future: Hopeful
integration of
2013-14 IL Rubric
into clinic evaluation
FA 2012: Librarians
and ALO attend
WASC Accreditation
Retreat on Core
Competencies:
Critical Thinking and
Information Literacy
FA 2012: Map and
integrate Rubric v1.?
into existing rubrics
for some programs
SP 2013: Begin using
updated rubrics as
part of an overall
program to increase
rubric use in more
classes
Future: IL Rubric data
needs to be gathered
and assessed.
Rubrics are being
adopted/developed
for the new
BioPharmacy
program
FA 2012:
Assessment
committee adopts
Rubric 2012/2013
FA 2012: Keck
Science Dept. adopts
Rubric 2012/2013
SP 2013: Library
scores senior theses
using Rubric
2012/2013
SP 2013: Keck
Science Dept. scores
senior theses using
Rubric 2012/2013
SU 2014: Library
uses AiA Rubric to
evaluate student IL
skills
Future: Hopeful
integration of
2013-14 IL Rubric
into capstone
evaluation

56. { D I S C U S S :
how would you characterize
y o u r o ? r g a n i z a t i o n a l
s t r u c t u r e / c u l t u r e ?
} ( h o w ) a r e d e c i s i o n s
a b o u t I L a s s e s s m e n t
m a d e & i m p l e m e n t e d ?

57. S P E C I F I C R U B R I C A P P L I C A T I O N S
• F i r s t - y e a r s e m i n a r p a p e r e v a l u a t i o n
• S e n i o r c a p s t o n e / t h e s i s e v a l u a t i o n
• C a m p u s e s a c c r e d i t a t i o n a s s e s s m e n t
• A s s e s s m e n t i n A c t i o n ( 2 0 1 3 - 1 4 )

58. S P E C I F I C R U B R I C A P P L I C A T I O N S
• F i r s t - y e a r s e m i n a r p a p e r e v a l u a t i o n
• S e n i o r c a p s t o n e / t h e s i s e v a l u a t i o n
• C a m p u s e s a c c r e d i t a t i o n a s s e s s m e n t
• A s s e s s m e n t i n A c t i o n ( 2 0 1 3 - 1 4 )

59. 5 C O L L E G E S = 5 F I R S T Y E A R
S E M I N A R P R O G R A M S

60. Research Question
“What impact (if any) does librarian intervention in first-year courses have on IL
performance in student work?”
Methodology
• First-Year Student Papers coded by Level of Librarian Collaboration in Course
• Rubric Evaluation (http://bit.ly/ccl-ilrubric) of papers
• 4 Liberal Arts College First-Year Seminar/ Experience programs > Claremont
McKenna College, Pitzer College, Pomona College, Scripps College (coded in
results for anonymity) ; Results from fifth college, Harvey Mudd, still being
coded
• 416 papers; 14 interrater pairs (Jan-May, 2014)
Collaboration Levels
1. None = no faculty collaboration with librarian
2. Low = Traditional One-Shot
3. Moderate = multiple sessions, moderate syllabus/assignment collaboration
4. High = multiple sessions, online tutorial & quiz, significant syllabus/
assignment collaboration

64. report and data - libguides.libraries.claremont.edu/AiA

65. { f a c u l t y / l i b r a r i a n c o l l a b o r a t i o n
M U T U A L U N D E R S T A N D I N G
i m m e d i a t e a s s e s s m e n t t o o l
} L O N G - T E R M F R A M E W O R K
R U B R I C S

66. m a p p i n g
R E S O U R C E S C A L A B I L I T Y
T A R G E T E D I N S T R U C T I O N
S T U D E N T C O M P E T E N C I E S
r u b r i c s

67. E V A L U A T I O N
I L i n f r a s t r u c t u r e

68. E V A L U A T I O N
C O L L A B O R A T I O N
I L i n f r a s t r u c t u r e

69. E V A L U A T I O N
C O L L A B O R A T I O N
A D V O C A C Y
I L i n f r a s t r u c t u r e

70. R E S O U R C E S
ea curriculum map: ea.pomona.edu/ea-5c-program-map/
ccl il program documents: libraries.claremont.edu/informationliteracy/
A i A p r o j e c t a n d d a t a : l i b g u i d e s . l i b r a r i e s . c l a r e m o n t . e d u / A i A
Degrees of Impact: Analyzing the Effects of Progressive Librarian Course
Co l l a b o r a t i o n s o n S t u d e n t P e r f o r m a n c e . W i t h M . S a r a L o w e , N a t a l i e
T a g g e , a n d S e a n M . S t o n e . C o l l e g e & R e s e a r c h L i b r a r i e s .
Accept e d : June 26, 2014; Ant i c i pat e d Pub l i c a t i on Dat e : Jul y 1 , 20 1 5 .
Slide 41 Adapted from Tagge, Natalie; Booth, Char; Chappell, Alexandra; Lowe,
M. Sara; and Stone, Sean M., "Choose Your Own Adventure: Integrating an
I n f o r m a t i o n L i t e r a c y R u b r i c i n t o S e v e n ( V e r y ) D i f f e r e n t
Col l e g e s " (2013) . L i b r a r y St a f f Pub l i c a t i o n s a n d Re s e a r c h . Pape r 1 7 .
h t t p : / / s c h o l a r s h i p . c l a r e m o n t . e d u / l i b r a r y _ s t a f f / 1 7
S l i d e s 4 6 a n d 4 8 a d a p t e d fr o m Lowe , M. S a r a ; Bo o t h , Ch a r ; S t o n e , S e a n
M . ; T a g g e , Nat a l i e ; C h a p p e l l , A l e x a n d r a ; a n d B u r r o w , Ga l e , " L i b r a r i a n s
M a t t e r ! I m p a c t o n F i r s t - Y e a r I n f o r m a t i o n L i t e r a c y S k i l l s a t 5
Col l e g e s " (20 1 4 ) . L i b r a r y S t a f f Pu b l i c a t i o n s a n d Re s e a r c h . P a p e r 22.
h t t p : / / s c h o l a r s h i p . c l a r e m o n t . e d u / l i b r a r y _ s t a f f / 2 2

71. C H A R B O O T H
D I R E C T O R
r e s e a r c h , t e a c h i n g
&
l e a r n i n g
S E R V I C E S
c l a r e m o n t c o l l e g e s
L I B R A R Y
c h a r b o o t h @ g m a i l
i n f o m a t i o n a l . c o m
@ c h a r b o o t h
s l i d e s h a r e . n e t / c h a r b o o t h