SlideShare a Scribd company logo
1 of 18
Closing the loop: using holistic rubrics for
effective assessment and feedback
Sarah Honeychurch
Teaching Fellow
Adam Smith Business School
University of Glasgow
Sarah.Honeychurch@Glasgow.ac.uk
@NomadWarMachine
1
Introduction
• What is a rubric?
• Why use a rubric?
• Adam Smith Business School: a case
study
2
Why use a rubric?
• Assurance of Learning
• NSS
• Student Experience: Post Pandemic Pedagogy
• Staff time: marking and feedback
“A good rubric allows me to provide individualized, constructive critique in
a manageable time frame.” (Andrade 2005)
3
What is a rubric?
• Evaluative criteria
• Definitions of quality at different levels
• Grading strategy (Dawson 2017)
A rubric is an assessment tool that lists the criteria for a
piece of work or what counts (for example, purpose,
organization, details, voice, and mechanics often are
what count in a written essay) and articulates
gradations of quality for each criterion, from excellent to
poor. (Andrade 2005)
4
What is a rubric?
• Different types of marking rubrics
– Analytic marking rubrics
– A marking grid determining a specific score, grade
or percentage
– Holistic marking rubrics
– A grid with criteria. These inform, but do not
determine, grading
– Make the students aware of the marking criteria in
advance
5
AoL Rubric
6
Management Pilot
• Semester 1 and 2, 2017/18
• All Honours courses: rubric for each piece of assessment
inserted into course handbook
• 1 hour staff sessions to introduce the use of rubrics
• Supplementing, not substituting or changing other
marking practices or policies
7
Management: Holistic rubric
8
• 2 rounds of EvaSys questionnaires
Survey results
9
Student comments
• “I have found marking rubrics to be extremely helpful for other classes though and I am sure
that they are part of the reason I secured excellent grades for these classes. I think the school
would benefit from using these as I felt the rubrics covered most of what I needed to know and
therefore minimised the need for me to contact the lecturer for help.”
• “Every single course in MGT should have required rubrics. My grades have clearly improved with
the introductions of rubrics because I better understand the assignment, expectations, and can
guide my work and editing with the aid of the rubric.”
• “I really appreciate that Management has started to use marking rubrics (I actually think other
subjects would benefit from this as well!) I believe it is an important part in conveying the
expectations of assignments for students and also help identifying areas for improvement for
the future.”
• “Extend them to cover every class. I felt they helped significantly to my understanding of each
assignment.”
• “Spread the use over the entire university.”
• “Assuring that rubrics are not generic and they include details for a specific assignment is very
important, otherwise they are not helpful at all.”
10
Taking the pilot forward
• Some students felt the rubrics were too generic
• Some students thought the rubrics lacked detail:
– What does “to expectations” mean?
– What does an X grade look like?
• Need to embed rubrics in School policies and
practices
• Need to reflect institution’s Code of Assessment
– 3 levels of AoL v 8 levels in CoA
11
UofG Code of Assessment
“Schedule A”
12
Rubric redesign
13
title
• Course ILOs
• Assessment ILO(s)
• Assessment Criteria
• Develop descriptors for “good” (use Blooms)
• Develop +/- descriptors
• Ask a colleague to sense check it
• Available for students at beginning of course
• Used for marking and feedback
14
Moving forward
• Coursework briefing template
– Must provide assessment criteria
– Opt in to develop rubric
• Rubrics toolkit:
– Template
– Worked example
– Rationale (staff and student feedback)
– Short “how to” (including Blooms)
– Practical workshops
– 1-1 support
• SoTL project
15
References
Heidi Goodrich Andrade (2005) Teaching With Rubrics: The Good, the Bad, and
the Ugly, College Teaching, 53:1, 27-31, DOI: 10.3200/CTCH.53.1.27-31
Phillip Dawson (2017) Assessment rubrics: towards clearer and more replicable
design, research and practice, Assessment & Evaluation in Higher Education, 4
2:3, 347-360, DOI: 10.1080/02602938.2015.1111294
Peter Grainger, Michael Christie, Glyn Thomas, Shelley Dole, Deborah Heck,
Margaret Marshman & Michael Carey (2017) Improving the quality of
assessment by using a community of practice to explore the optimal
construction of assessment rubrics, Reflective Practice, 18:3, 410-422, DOI:
10.1080/14623943.2017.1295931
Anastasiya A. Lipnevich, Leigh N. McCallen, Katharine Pace Miles and Jeffrey K.
Smith (2014) Mind the gap! Students' use of exemplars and detailed rubrics as
formative assessment. Instructional Science 42:4 539-559
https://www.jstor.org/stable/43575435
16
References
Y. Malini Reddy & Heidi Andrade (2010) A review of rubric use in higher
education, Assessment & Evaluation in Higher Education, 35:4, 435-448, DOI:
10.1080/02602930902862859
D. Royce Sadler, (1987) Specifying and promulgating achievement standards.
Oxford Review of Education, 13, 191–209.
D. Royce Sadler, D. R. (2009) Indeterminacy in the use of preset criteria for
assessment and grading in higher education. Assessment and Evaluation in
Higher Education, 34, 159–179.
17
Closing the loop: using holistic rubrics for
effective assessment and feedback
Sarah Honeychurch
Teaching Fellow
Adam Smith Business School
University of Glasgow
Sarah.Honeychurch@Glasgow.ac.uk
@NomadWarMachine
18

More Related Content

What's hot

Data and assessment powerpoint presentation 2015
Data and assessment powerpoint presentation 2015Data and assessment powerpoint presentation 2015
Data and assessment powerpoint presentation 2015Erica Zigelman
 
Oct 23 Using exemplars to develop student assessment literacy
Oct 23 Using exemplars to develop student assessment literacyOct 23 Using exemplars to develop student assessment literacy
Oct 23 Using exemplars to develop student assessment literacyDavid Carless
 
Summary of course curriculum evaluation
Summary of course curriculum evaluationSummary of course curriculum evaluation
Summary of course curriculum evaluationShafeeq Hussain
 
Assessment strategies for online learning
Assessment strategies for online learningAssessment strategies for online learning
Assessment strategies for online learningCaroline Conlon
 
2014.01.27 session 4 impact evaluation & evidence(1)
2014.01.27 session 4 impact evaluation & evidence(1)2014.01.27 session 4 impact evaluation & evidence(1)
2014.01.27 session 4 impact evaluation & evidence(1)robertdrummond
 
Implementing peer feedback
Implementing peer feedbackImplementing peer feedback
Implementing peer feedbackDavid Carless
 
Introduction to the evaluation of teaching and learning
Introduction to the evaluation of teaching and learningIntroduction to the evaluation of teaching and learning
Introduction to the evaluation of teaching and learningAnne-Mart Olsen
 
Effective feedback
Effective feedbackEffective feedback
Effective feedbackiBATEFL.COM
 
Action research: Basic Information on Action Research
Action research: Basic Information on Action ResearchAction research: Basic Information on Action Research
Action research: Basic Information on Action ResearchSameer Babu M
 
PASS @ Ulster
PASS @ UlsterPASS @ Ulster
PASS @ Ulstercampone
 
Evaluation of Student Learning Policy Feb. 2014
Evaluation of Student Learning Policy Feb. 2014Evaluation of Student Learning Policy Feb. 2014
Evaluation of Student Learning Policy Feb. 2014tymchatyn
 
NYSCOSS Conference Superintendents Training on Assessment 9 14
NYSCOSS Conference Superintendents Training on Assessment 9 14NYSCOSS Conference Superintendents Training on Assessment 9 14
NYSCOSS Conference Superintendents Training on Assessment 9 14NWEA
 
Harnessing the Potential of PeerMark to Enhance and Enrich the Student Exper...
Harnessing the Potential of PeerMark to Enhance and Enrich  the Student Exper...Harnessing the Potential of PeerMark to Enhance and Enrich  the Student Exper...
Harnessing the Potential of PeerMark to Enhance and Enrich the Student Exper...Kenji Lamb
 
Birmingham Assessment and Feedback Symposium
Birmingham Assessment and Feedback Symposium Birmingham Assessment and Feedback Symposium
Birmingham Assessment and Feedback Symposium Tansy Jessop
 
Harnessing the Potential of PeerMark to Enhance and Enrich the Student Exper...
Harnessing the Potential of PeerMark to Enhance and Enrich  the Student Exper...Harnessing the Potential of PeerMark to Enhance and Enrich  the Student Exper...
Harnessing the Potential of PeerMark to Enhance and Enrich the Student Exper...Neil G. McPherson
 
Qualitative and quantitative student assessment
Qualitative and quantitative student assessmentQualitative and quantitative student assessment
Qualitative and quantitative student assessmentGail Matthews-DeNatale
 
Action research In Research Methodology
Action research In Research MethodologyAction research In Research Methodology
Action research In Research MethodologyMuhammad Usman Awan
 

What's hot (20)

Data and assessment powerpoint presentation 2015
Data and assessment powerpoint presentation 2015Data and assessment powerpoint presentation 2015
Data and assessment powerpoint presentation 2015
 
Oct 23 Using exemplars to develop student assessment literacy
Oct 23 Using exemplars to develop student assessment literacyOct 23 Using exemplars to develop student assessment literacy
Oct 23 Using exemplars to develop student assessment literacy
 
TESTA Masterclass
TESTA MasterclassTESTA Masterclass
TESTA Masterclass
 
QIPP Presentation
QIPP PresentationQIPP Presentation
QIPP Presentation
 
Summary of course curriculum evaluation
Summary of course curriculum evaluationSummary of course curriculum evaluation
Summary of course curriculum evaluation
 
Assessment strategies for online learning
Assessment strategies for online learningAssessment strategies for online learning
Assessment strategies for online learning
 
2014.01.27 session 4 impact evaluation & evidence(1)
2014.01.27 session 4 impact evaluation & evidence(1)2014.01.27 session 4 impact evaluation & evidence(1)
2014.01.27 session 4 impact evaluation & evidence(1)
 
Implementing peer feedback
Implementing peer feedbackImplementing peer feedback
Implementing peer feedback
 
Introduction to the evaluation of teaching and learning
Introduction to the evaluation of teaching and learningIntroduction to the evaluation of teaching and learning
Introduction to the evaluation of teaching and learning
 
Effective feedback
Effective feedbackEffective feedback
Effective feedback
 
Action research: Basic Information on Action Research
Action research: Basic Information on Action ResearchAction research: Basic Information on Action Research
Action research: Basic Information on Action Research
 
PASS @ Ulster
PASS @ UlsterPASS @ Ulster
PASS @ Ulster
 
Evaluation of Student Learning Policy Feb. 2014
Evaluation of Student Learning Policy Feb. 2014Evaluation of Student Learning Policy Feb. 2014
Evaluation of Student Learning Policy Feb. 2014
 
NYSCOSS Conference Superintendents Training on Assessment 9 14
NYSCOSS Conference Superintendents Training on Assessment 9 14NYSCOSS Conference Superintendents Training on Assessment 9 14
NYSCOSS Conference Superintendents Training on Assessment 9 14
 
Harnessing the Potential of PeerMark to Enhance and Enrich the Student Exper...
Harnessing the Potential of PeerMark to Enhance and Enrich  the Student Exper...Harnessing the Potential of PeerMark to Enhance and Enrich  the Student Exper...
Harnessing the Potential of PeerMark to Enhance and Enrich the Student Exper...
 
Birmingham Assessment and Feedback Symposium
Birmingham Assessment and Feedback Symposium Birmingham Assessment and Feedback Symposium
Birmingham Assessment and Feedback Symposium
 
Harnessing the Potential of PeerMark to Enhance and Enrich the Student Exper...
Harnessing the Potential of PeerMark to Enhance and Enrich  the Student Exper...Harnessing the Potential of PeerMark to Enhance and Enrich  the Student Exper...
Harnessing the Potential of PeerMark to Enhance and Enrich the Student Exper...
 
Qualitative and quantitative student assessment
Qualitative and quantitative student assessmentQualitative and quantitative student assessment
Qualitative and quantitative student assessment
 
Action research In Research Methodology
Action research In Research MethodologyAction research In Research Methodology
Action research In Research Methodology
 
Role of a coach par onboarding
Role of a coach par onboardingRole of a coach par onboarding
Role of a coach par onboarding
 

Similar to Closing the loop: using holistic rubrics for effective assessment and feedback

TESTA, Kingston University Keynote
TESTA, Kingston University KeynoteTESTA, Kingston University Keynote
TESTA, Kingston University KeynoteTESTA winch
 
Feed-forward approaches for enhancing assessment and feedback
Feed-forward approaches for enhancing assessment and feedbackFeed-forward approaches for enhancing assessment and feedback
Feed-forward approaches for enhancing assessment and feedbackjisc-elearning
 
Assessment cpd
Assessment cpdAssessment cpd
Assessment cpdMrsMcGinty
 
TESTA to FASTECH Presentation
TESTA to FASTECH PresentationTESTA to FASTECH Presentation
TESTA to FASTECH PresentationTansy_Jessop
 
An evidence based model
An evidence based modelAn evidence based model
An evidence based modelJisc
 
Online assessment
Online assessmentOnline assessment
Online assessmentNisha Singh
 
Doctoral Education Online: What Should We Strive For? How Could It Be Better?
Doctoral Education Online: What Should We Strive For? How Could It Be Better?Doctoral Education Online: What Should We Strive For? How Could It Be Better?
Doctoral Education Online: What Should We Strive For? How Could It Be Better?Cynthia Agyeman
 
Competency Based Medical Education.pptx
Competency Based Medical Education.pptxCompetency Based Medical Education.pptx
Competency Based Medical Education.pptxRakeshKumarDixit3
 
TESTA to FASTECH (November 2011)
 TESTA to FASTECH (November 2011) TESTA to FASTECH (November 2011)
TESTA to FASTECH (November 2011)TESTA winch
 
Ash Samadi - Blueprint for curriculum instruction
Ash Samadi - Blueprint for curriculum instructionAsh Samadi - Blueprint for curriculum instruction
Ash Samadi - Blueprint for curriculum instructionSamadi Group Management
 
Proposing a model for the incremental development of peer assessment and feed...
Proposing a model for the incremental development of peer assessment and feed...Proposing a model for the incremental development of peer assessment and feed...
Proposing a model for the incremental development of peer assessment and feed...Laura Costelloe
 
Evaluation the many faces
Evaluation   the many facesEvaluation   the many faces
Evaluation the many facesleesha roberts
 
Governance Day 042718
Governance Day 042718Governance Day 042718
Governance Day 042718Deanna Romano
 
Designing effective assessment for students.ppt
Designing effective assessment for students.pptDesigning effective assessment for students.ppt
Designing effective assessment for students.pptRameshwariSinghal1
 
Chapter 10 (11 in my book)
Chapter 10 (11 in my book)Chapter 10 (11 in my book)
Chapter 10 (11 in my book)TerrellMcCall
 
Jace Hargis Designing Online Teaching
Jace Hargis Designing Online TeachingJace Hargis Designing Online Teaching
Jace Hargis Designing Online TeachingJace Hargis
 
7. assessment session slides
7. assessment session slides7. assessment session slides
7. assessment session slidesGrandnet
 
Step 1 Project Initiation and get organized Rev1_print.pptx
Step 1 Project Initiation and get organized Rev1_print.pptxStep 1 Project Initiation and get organized Rev1_print.pptx
Step 1 Project Initiation and get organized Rev1_print.pptxARNELUSMAN2
 

Similar to Closing the loop: using holistic rubrics for effective assessment and feedback (20)

TESTA, Kingston University Keynote
TESTA, Kingston University KeynoteTESTA, Kingston University Keynote
TESTA, Kingston University Keynote
 
Feed-forward approaches for enhancing assessment and feedback
Feed-forward approaches for enhancing assessment and feedbackFeed-forward approaches for enhancing assessment and feedback
Feed-forward approaches for enhancing assessment and feedback
 
Assessment cpd
Assessment cpdAssessment cpd
Assessment cpd
 
TESTA to FASTECH Presentation
TESTA to FASTECH PresentationTESTA to FASTECH Presentation
TESTA to FASTECH Presentation
 
An evidence based model
An evidence based modelAn evidence based model
An evidence based model
 
Online assessment
Online assessmentOnline assessment
Online assessment
 
Doctoral Education Online: What Should We Strive For? How Could It Be Better?
Doctoral Education Online: What Should We Strive For? How Could It Be Better?Doctoral Education Online: What Should We Strive For? How Could It Be Better?
Doctoral Education Online: What Should We Strive For? How Could It Be Better?
 
Competency Based Medical Education.pptx
Competency Based Medical Education.pptxCompetency Based Medical Education.pptx
Competency Based Medical Education.pptx
 
TESTA to FASTECH (November 2011)
 TESTA to FASTECH (November 2011) TESTA to FASTECH (November 2011)
TESTA to FASTECH (November 2011)
 
Ash Samadi - Blueprint for curriculum instruction
Ash Samadi - Blueprint for curriculum instructionAsh Samadi - Blueprint for curriculum instruction
Ash Samadi - Blueprint for curriculum instruction
 
Proposing a model for the incremental development of peer assessment and feed...
Proposing a model for the incremental development of peer assessment and feed...Proposing a model for the incremental development of peer assessment and feed...
Proposing a model for the incremental development of peer assessment and feed...
 
Evaluation the many faces
Evaluation   the many facesEvaluation   the many faces
Evaluation the many faces
 
Governance Day 042718
Governance Day 042718Governance Day 042718
Governance Day 042718
 
Designing effective assessment for students.ppt
Designing effective assessment for students.pptDesigning effective assessment for students.ppt
Designing effective assessment for students.ppt
 
Chapter 12
Chapter 12Chapter 12
Chapter 12
 
Assessment is More Than Data
Assessment is More Than DataAssessment is More Than Data
Assessment is More Than Data
 
Chapter 10 (11 in my book)
Chapter 10 (11 in my book)Chapter 10 (11 in my book)
Chapter 10 (11 in my book)
 
Jace Hargis Designing Online Teaching
Jace Hargis Designing Online TeachingJace Hargis Designing Online Teaching
Jace Hargis Designing Online Teaching
 
7. assessment session slides
7. assessment session slides7. assessment session slides
7. assessment session slides
 
Step 1 Project Initiation and get organized Rev1_print.pptx
Step 1 Project Initiation and get organized Rev1_print.pptxStep 1 Project Initiation and get organized Rev1_print.pptx
Step 1 Project Initiation and get organized Rev1_print.pptx
 

Recently uploaded

Graduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - EnglishGraduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - Englishneillewis46
 
SKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptx
SKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptxSKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptx
SKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptxAmanpreet Kaur
 
Salient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functionsSalient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functionsKarakKing
 
General Principles of Intellectual Property: Concepts of Intellectual Proper...
General Principles of Intellectual Property: Concepts of Intellectual  Proper...General Principles of Intellectual Property: Concepts of Intellectual  Proper...
General Principles of Intellectual Property: Concepts of Intellectual Proper...Poonam Aher Patil
 
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptxBasic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptxDenish Jangid
 
FSB Advising Checklist - Orientation 2024
FSB Advising Checklist - Orientation 2024FSB Advising Checklist - Orientation 2024
FSB Advising Checklist - Orientation 2024Elizabeth Walsh
 
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptx
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptxHMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptx
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptxmarlenawright1
 
ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.MaryamAhmad92
 
Google Gemini An AI Revolution in Education.pptx
Google Gemini An AI Revolution in Education.pptxGoogle Gemini An AI Revolution in Education.pptx
Google Gemini An AI Revolution in Education.pptxDr. Sarita Anand
 
How to Create and Manage Wizard in Odoo 17
How to Create and Manage Wizard in Odoo 17How to Create and Manage Wizard in Odoo 17
How to Create and Manage Wizard in Odoo 17Celine George
 
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdfUGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdfNirmal Dwivedi
 
Fostering Friendships - Enhancing Social Bonds in the Classroom
Fostering Friendships - Enhancing Social Bonds  in the ClassroomFostering Friendships - Enhancing Social Bonds  in the Classroom
Fostering Friendships - Enhancing Social Bonds in the ClassroomPooky Knightsmith
 
Towards a code of practice for AI in AT.pptx
Towards a code of practice for AI in AT.pptxTowards a code of practice for AI in AT.pptx
Towards a code of practice for AI in AT.pptxJisc
 
Jamworks pilot and AI at Jisc (20/03/2024)
Jamworks pilot and AI at Jisc (20/03/2024)Jamworks pilot and AI at Jisc (20/03/2024)
Jamworks pilot and AI at Jisc (20/03/2024)Jisc
 
Single or Multiple melodic lines structure
Single or Multiple melodic lines structureSingle or Multiple melodic lines structure
Single or Multiple melodic lines structuredhanjurrannsibayan2
 
Key note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfKey note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfAdmir Softic
 
How to setup Pycharm environment for Odoo 17.pptx
How to setup Pycharm environment for Odoo 17.pptxHow to setup Pycharm environment for Odoo 17.pptx
How to setup Pycharm environment for Odoo 17.pptxCeline George
 
REMIFENTANIL: An Ultra short acting opioid.pptx
REMIFENTANIL: An Ultra short acting opioid.pptxREMIFENTANIL: An Ultra short acting opioid.pptx
REMIFENTANIL: An Ultra short acting opioid.pptxDr. Ravikiran H M Gowda
 

Recently uploaded (20)

Graduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - EnglishGraduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - English
 
SKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptx
SKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptxSKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptx
SKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptx
 
Salient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functionsSalient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functions
 
General Principles of Intellectual Property: Concepts of Intellectual Proper...
General Principles of Intellectual Property: Concepts of Intellectual  Proper...General Principles of Intellectual Property: Concepts of Intellectual  Proper...
General Principles of Intellectual Property: Concepts of Intellectual Proper...
 
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptxBasic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
 
FSB Advising Checklist - Orientation 2024
FSB Advising Checklist - Orientation 2024FSB Advising Checklist - Orientation 2024
FSB Advising Checklist - Orientation 2024
 
Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024
 
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptx
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptxHMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptx
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptx
 
Spatium Project Simulation student brief
Spatium Project Simulation student briefSpatium Project Simulation student brief
Spatium Project Simulation student brief
 
ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.
 
Google Gemini An AI Revolution in Education.pptx
Google Gemini An AI Revolution in Education.pptxGoogle Gemini An AI Revolution in Education.pptx
Google Gemini An AI Revolution in Education.pptx
 
How to Create and Manage Wizard in Odoo 17
How to Create and Manage Wizard in Odoo 17How to Create and Manage Wizard in Odoo 17
How to Create and Manage Wizard in Odoo 17
 
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdfUGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
 
Fostering Friendships - Enhancing Social Bonds in the Classroom
Fostering Friendships - Enhancing Social Bonds  in the ClassroomFostering Friendships - Enhancing Social Bonds  in the Classroom
Fostering Friendships - Enhancing Social Bonds in the Classroom
 
Towards a code of practice for AI in AT.pptx
Towards a code of practice for AI in AT.pptxTowards a code of practice for AI in AT.pptx
Towards a code of practice for AI in AT.pptx
 
Jamworks pilot and AI at Jisc (20/03/2024)
Jamworks pilot and AI at Jisc (20/03/2024)Jamworks pilot and AI at Jisc (20/03/2024)
Jamworks pilot and AI at Jisc (20/03/2024)
 
Single or Multiple melodic lines structure
Single or Multiple melodic lines structureSingle or Multiple melodic lines structure
Single or Multiple melodic lines structure
 
Key note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfKey note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdf
 
How to setup Pycharm environment for Odoo 17.pptx
How to setup Pycharm environment for Odoo 17.pptxHow to setup Pycharm environment for Odoo 17.pptx
How to setup Pycharm environment for Odoo 17.pptx
 
REMIFENTANIL: An Ultra short acting opioid.pptx
REMIFENTANIL: An Ultra short acting opioid.pptxREMIFENTANIL: An Ultra short acting opioid.pptx
REMIFENTANIL: An Ultra short acting opioid.pptx
 

Closing the loop: using holistic rubrics for effective assessment and feedback

  • 1. Closing the loop: using holistic rubrics for effective assessment and feedback Sarah Honeychurch Teaching Fellow Adam Smith Business School University of Glasgow Sarah.Honeychurch@Glasgow.ac.uk @NomadWarMachine 1
  • 2. Introduction • What is a rubric? • Why use a rubric? • Adam Smith Business School: a case study 2
  • 3. Why use a rubric? • Assurance of Learning • NSS • Student Experience: Post Pandemic Pedagogy • Staff time: marking and feedback “A good rubric allows me to provide individualized, constructive critique in a manageable time frame.” (Andrade 2005) 3
  • 4. What is a rubric? • Evaluative criteria • Definitions of quality at different levels • Grading strategy (Dawson 2017) A rubric is an assessment tool that lists the criteria for a piece of work or what counts (for example, purpose, organization, details, voice, and mechanics often are what count in a written essay) and articulates gradations of quality for each criterion, from excellent to poor. (Andrade 2005) 4
  • 5. What is a rubric? • Different types of marking rubrics – Analytic marking rubrics – A marking grid determining a specific score, grade or percentage – Holistic marking rubrics – A grid with criteria. These inform, but do not determine, grading – Make the students aware of the marking criteria in advance 5
  • 7. Management Pilot • Semester 1 and 2, 2017/18 • All Honours courses: rubric for each piece of assessment inserted into course handbook • 1 hour staff sessions to introduce the use of rubrics • Supplementing, not substituting or changing other marking practices or policies 7
  • 9. • 2 rounds of EvaSys questionnaires Survey results 9
  • 10. Student comments • “I have found marking rubrics to be extremely helpful for other classes though and I am sure that they are part of the reason I secured excellent grades for these classes. I think the school would benefit from using these as I felt the rubrics covered most of what I needed to know and therefore minimised the need for me to contact the lecturer for help.” • “Every single course in MGT should have required rubrics. My grades have clearly improved with the introductions of rubrics because I better understand the assignment, expectations, and can guide my work and editing with the aid of the rubric.” • “I really appreciate that Management has started to use marking rubrics (I actually think other subjects would benefit from this as well!) I believe it is an important part in conveying the expectations of assignments for students and also help identifying areas for improvement for the future.” • “Extend them to cover every class. I felt they helped significantly to my understanding of each assignment.” • “Spread the use over the entire university.” • “Assuring that rubrics are not generic and they include details for a specific assignment is very important, otherwise they are not helpful at all.” 10
  • 11. Taking the pilot forward • Some students felt the rubrics were too generic • Some students thought the rubrics lacked detail: – What does “to expectations” mean? – What does an X grade look like? • Need to embed rubrics in School policies and practices • Need to reflect institution’s Code of Assessment – 3 levels of AoL v 8 levels in CoA 11
  • 12. UofG Code of Assessment “Schedule A” 12
  • 14. title • Course ILOs • Assessment ILO(s) • Assessment Criteria • Develop descriptors for “good” (use Blooms) • Develop +/- descriptors • Ask a colleague to sense check it • Available for students at beginning of course • Used for marking and feedback 14
  • 15. Moving forward • Coursework briefing template – Must provide assessment criteria – Opt in to develop rubric • Rubrics toolkit: – Template – Worked example – Rationale (staff and student feedback) – Short “how to” (including Blooms) – Practical workshops – 1-1 support • SoTL project 15
  • 16. References Heidi Goodrich Andrade (2005) Teaching With Rubrics: The Good, the Bad, and the Ugly, College Teaching, 53:1, 27-31, DOI: 10.3200/CTCH.53.1.27-31 Phillip Dawson (2017) Assessment rubrics: towards clearer and more replicable design, research and practice, Assessment & Evaluation in Higher Education, 4 2:3, 347-360, DOI: 10.1080/02602938.2015.1111294 Peter Grainger, Michael Christie, Glyn Thomas, Shelley Dole, Deborah Heck, Margaret Marshman & Michael Carey (2017) Improving the quality of assessment by using a community of practice to explore the optimal construction of assessment rubrics, Reflective Practice, 18:3, 410-422, DOI: 10.1080/14623943.2017.1295931 Anastasiya A. Lipnevich, Leigh N. McCallen, Katharine Pace Miles and Jeffrey K. Smith (2014) Mind the gap! Students' use of exemplars and detailed rubrics as formative assessment. Instructional Science 42:4 539-559 https://www.jstor.org/stable/43575435 16
  • 17. References Y. Malini Reddy & Heidi Andrade (2010) A review of rubric use in higher education, Assessment & Evaluation in Higher Education, 35:4, 435-448, DOI: 10.1080/02602930902862859 D. Royce Sadler, (1987) Specifying and promulgating achievement standards. Oxford Review of Education, 13, 191–209. D. Royce Sadler, D. R. (2009) Indeterminacy in the use of preset criteria for assessment and grading in higher education. Assessment and Evaluation in Higher Education, 34, 159–179. 17
  • 18. Closing the loop: using holistic rubrics for effective assessment and feedback Sarah Honeychurch Teaching Fellow Adam Smith Business School University of Glasgow Sarah.Honeychurch@Glasgow.ac.uk @NomadWarMachine 18