SlideShare una empresa de Scribd logo
1 de 10
Being the middle (wo)man
Designing assessment workflows that make
          everyone happy… ish

     Durham Blackboard User Group, January 2013

                    Adel Gordon
              University of Northampton
Disclaimer




I’m not a Workflows expert
Background
•   2 x projects running in parallel
    – QNIG (QL & NILE Integration Group)
    – SaGE (Submitting and Grading Electronically)

•   New sites for 12/13 based on QA templates
    – As well as:
        • SaGE across whole Institution
        • New Blackboard theme
        • Change of tools (Bb blogs & wikis, Kaltura, EduBlogs…)
Where are we now…

•   First phase of SaGE up and running
•   Piloting rubrics (to build grades and give clear criteria)


Next phase
•   Integrate




                                              Image source: http://channelnomics.com/wp-content/uploads/2011/04/Integrate.jpg
Successes


 •   Student submission
 •   Basic level of online marking
 •   Provisional grades & feedback
     delivered to students online
 •   Initial procedures for second marking
     and external moderation (but…)
Challenges

  •   Timescales
  •   Training
  •   Grading challenges
       – Letter Grades/Grading Schemas
       – Turnitin
  •   Integration (naming conventions of
      submission areas)
  •   Getting all the information we need!
Who is involved?

             Admins             Academics




Externals                                      Quality
                       LT




   Execs                                    Students


                      Systems
Lessons Learned

•   Too flexible?
     – Limit to one tool
•   Student experience
     – Limit to first year students
•   Letter grading – a step too far?
•   Paper processes
•   Second marking and external moderation
Questions?


Adel Gordon
adel.gordon@northampton.ac.uk
@adelgordon

Más contenido relacionado

La actualidad más candente

Successfully Delivering Secure Online Exams at Scale
Successfully Delivering Secure Online Exams at ScaleSuccessfully Delivering Secure Online Exams at Scale
Successfully Delivering Secure Online Exams at Scale
Ashley Wright
 
Roger Williams University: Using Sakai to meet accreditation standards
Roger Williams University: Using Sakai to meet accreditation standardsRoger Williams University: Using Sakai to meet accreditation standards
Roger Williams University: Using Sakai to meet accreditation standards
rSmart
 
PDD 2019 Developing an in-house self directed CV support e-learning resourc...
PDD 2019   Developing an in-house self directed CV support e-learning resourc...PDD 2019   Developing an in-house self directed CV support e-learning resourc...
PDD 2019 Developing an in-house self directed CV support e-learning resourc...
uopces
 
Introduce It, Model It, Apply It
Introduce It, Model It, Apply ItIntroduce It, Model It, Apply It
Introduce It, Model It, Apply It
LaWanda Thomas
 
Staffs Uni Snapshot
Staffs Uni SnapshotStaffs Uni Snapshot
Staffs Uni Snapshot
Gary Clay
 
Vision: The Teaching and Learning Center
Vision: The Teaching and Learning CenterVision: The Teaching and Learning Center
Vision: The Teaching and Learning Center
dborcoman
 

La actualidad más candente (20)

Successfully Delivering Secure Online Exams at Scale
Successfully Delivering Secure Online Exams at ScaleSuccessfully Delivering Secure Online Exams at Scale
Successfully Delivering Secure Online Exams at Scale
 
Introduction to Online Course Peer Review
Introduction to Online Course Peer ReviewIntroduction to Online Course Peer Review
Introduction to Online Course Peer Review
 
Roger Williams University: Using Sakai to meet accreditation standards
Roger Williams University: Using Sakai to meet accreditation standardsRoger Williams University: Using Sakai to meet accreditation standards
Roger Williams University: Using Sakai to meet accreditation standards
 
EMOOCS 2016 - Measuring COMPLETION and DROPOUT in MOOCs : a learner-centered ...
EMOOCS 2016 - Measuring COMPLETION and DROPOUT in MOOCs : a learner-centered ...EMOOCS 2016 - Measuring COMPLETION and DROPOUT in MOOCs : a learner-centered ...
EMOOCS 2016 - Measuring COMPLETION and DROPOUT in MOOCs : a learner-centered ...
 
SLTCC2017 What makes a Virtual Learning Environment good? (Shane McMordie)
SLTCC2017 What makes a Virtual Learning Environment good? (Shane McMordie)SLTCC2017 What makes a Virtual Learning Environment good? (Shane McMordie)
SLTCC2017 What makes a Virtual Learning Environment good? (Shane McMordie)
 
Evaluating teaching and learning in MOOCs
Evaluating teaching and learning in MOOCsEvaluating teaching and learning in MOOCs
Evaluating teaching and learning in MOOCs
 
PDD 2019 Developing an in-house self directed CV support e-learning resourc...
PDD 2019   Developing an in-house self directed CV support e-learning resourc...PDD 2019   Developing an in-house self directed CV support e-learning resourc...
PDD 2019 Developing an in-house self directed CV support e-learning resourc...
 
Evaluation of Online learning
Evaluation of Online learning Evaluation of Online learning
Evaluation of Online learning
 
Providing a Cohesive Advising Experience to Increase Student Success and Rete...
Providing a Cohesive Advising Experience to Increase Student Success and Rete...Providing a Cohesive Advising Experience to Increase Student Success and Rete...
Providing a Cohesive Advising Experience to Increase Student Success and Rete...
 
Black board elearn
Black board elearnBlack board elearn
Black board elearn
 
Brightspace Assessments - Tying the Tools Together
Brightspace Assessments - Tying the Tools TogetherBrightspace Assessments - Tying the Tools Together
Brightspace Assessments - Tying the Tools Together
 
Introduce It, Model It, Apply It
Introduce It, Model It, Apply ItIntroduce It, Model It, Apply It
Introduce It, Model It, Apply It
 
Can Digital Badges Increase Capacity for Teaching Online?
Can Digital Badges Increase Capacity for Teaching Online?Can Digital Badges Increase Capacity for Teaching Online?
Can Digital Badges Increase Capacity for Teaching Online?
 
Staffs Uni Snapshot
Staffs Uni SnapshotStaffs Uni Snapshot
Staffs Uni Snapshot
 
Utilizing Multiple Grader Rubrics for Practical Assessment of Student Perform...
Utilizing Multiple Grader Rubrics for Practical Assessment of Student Perform...Utilizing Multiple Grader Rubrics for Practical Assessment of Student Perform...
Utilizing Multiple Grader Rubrics for Practical Assessment of Student Perform...
 
Migrating to Moodle: Faculty, Student and Technology Perspectives
Migrating to Moodle: Faculty, Student and Technology PerspectivesMigrating to Moodle: Faculty, Student and Technology Perspectives
Migrating to Moodle: Faculty, Student and Technology Perspectives
 
Online assessment june 2013 - v3
Online assessment   june 2013 - v3Online assessment   june 2013 - v3
Online assessment june 2013 - v3
 
Student services regional introduction to redesign
Student services regional introduction to redesignStudent services regional introduction to redesign
Student services regional introduction to redesign
 
E-Marking & E-Feedback with iPads and Apps
E-Marking & E-Feedback with iPads and AppsE-Marking & E-Feedback with iPads and Apps
E-Marking & E-Feedback with iPads and Apps
 
Vision: The Teaching and Learning Center
Vision: The Teaching and Learning CenterVision: The Teaching and Learning Center
Vision: The Teaching and Learning Center
 

Destacado

Destacado (7)

Rubrics - Research and Enterprise Committee presentation (UoN)
Rubrics - Research and Enterprise Committee presentation (UoN)Rubrics - Research and Enterprise Committee presentation (UoN)
Rubrics - Research and Enterprise Committee presentation (UoN)
 
Academic writing and wikipedia
Academic writing and wikipediaAcademic writing and wikipedia
Academic writing and wikipedia
 
User Engagement and Learning Outcomes: How NUI Galway is Changing the way Stu...
User Engagement and Learning Outcomes: How NUI Galway is Changing the way Stu...User Engagement and Learning Outcomes: How NUI Galway is Changing the way Stu...
User Engagement and Learning Outcomes: How NUI Galway is Changing the way Stu...
 
The Flipped Classroom
The Flipped ClassroomThe Flipped Classroom
The Flipped Classroom
 
Learning across contexts - Mobile for field and studio work
Learning across contexts - Mobile for field and studio workLearning across contexts - Mobile for field and studio work
Learning across contexts - Mobile for field and studio work
 
Supporting the use of video for teaching and learning
Supporting the use of video for teaching and learning Supporting the use of video for teaching and learning
Supporting the use of video for teaching and learning
 
Overview of Assessment Tools on Blackboard at NUIG
Overview of Assessment Tools on Blackboard at NUIGOverview of Assessment Tools on Blackboard at NUIG
Overview of Assessment Tools on Blackboard at NUIG
 

Similar a Being the middle (wo)man - Designing assessment workflows that make everyone happy... ish

Texas Rangers to the rescue: turning your VLE into an exam centre
Texas Rangers to the rescue: turning your VLE into an exam centreTexas Rangers to the rescue: turning your VLE into an exam centre
Texas Rangers to the rescue: turning your VLE into an exam centre
BlackboardEMEA
 
Building Bridges to Better Online Education
Building Bridges to Better Online EducationBuilding Bridges to Better Online Education
Building Bridges to Better Online Education
Terry Patterson
 
BAETE_workshop_for_PEV_October_2017.pdf
BAETE_workshop_for_PEV_October_2017.pdfBAETE_workshop_for_PEV_October_2017.pdf
BAETE_workshop_for_PEV_October_2017.pdf
ASMZahidKausar
 

Similar a Being the middle (wo)man - Designing assessment workflows that make everyone happy... ish (20)

Introduction to e-submission
Introduction to e-submission Introduction to e-submission
Introduction to e-submission
 
Introduction to EMA highlights
Introduction to EMA highlightsIntroduction to EMA highlights
Introduction to EMA highlights
 
Introduction to e-submission July 2016
Introduction to e-submission July 2016Introduction to e-submission July 2016
Introduction to e-submission July 2016
 
Leveraging Blackboard Solutions for Program Assessment: Four Perspectives
Leveraging Blackboard Solutions for Program Assessment: Four PerspectivesLeveraging Blackboard Solutions for Program Assessment: Four Perspectives
Leveraging Blackboard Solutions for Program Assessment: Four Perspectives
 
Quality Does Matter at Minnesota D2Lignite
Quality Does Matter at Minnesota D2LigniteQuality Does Matter at Minnesota D2Lignite
Quality Does Matter at Minnesota D2Lignite
 
ITC12 Five Effective Practices for eLearning Professional Development
ITC12 Five Effective Practices for eLearning Professional DevelopmentITC12 Five Effective Practices for eLearning Professional Development
ITC12 Five Effective Practices for eLearning Professional Development
 
Schoolnet ii ppt updated sept 19
Schoolnet ii ppt updated sept 19Schoolnet ii ppt updated sept 19
Schoolnet ii ppt updated sept 19
 
CIT-eA Project Presentation January 2015
CIT-eA Project Presentation January 2015CIT-eA Project Presentation January 2015
CIT-eA Project Presentation January 2015
 
Texas Rangers to the rescue: turning your VLE into an exam centre
Texas Rangers to the rescue: turning your VLE into an exam centreTexas Rangers to the rescue: turning your VLE into an exam centre
Texas Rangers to the rescue: turning your VLE into an exam centre
 
No person is an island in TEL, even if you live on an island
No  person is an island in TEL, even if you live on an island No  person is an island in TEL, even if you live on an island
No person is an island in TEL, even if you live on an island
 
Ed techprogram deck
Ed techprogram deckEd techprogram deck
Ed techprogram deck
 
Virginia tech's transition to sakai
Virginia tech's transition to sakaiVirginia tech's transition to sakai
Virginia tech's transition to sakai
 
blueprintassessment management system & Blueprinting & item analysis ing.pptx
blueprintassessment management system & Blueprinting & item analysis ing.pptxblueprintassessment management system & Blueprinting & item analysis ing.pptx
blueprintassessment management system & Blueprinting & item analysis ing.pptx
 
Building Bridges to Better Online Education
Building Bridges to Better Online EducationBuilding Bridges to Better Online Education
Building Bridges to Better Online Education
 
BAETE_workshop_for_PEV_October_2017.pdf
BAETE_workshop_for_PEV_October_2017.pdfBAETE_workshop_for_PEV_October_2017.pdf
BAETE_workshop_for_PEV_October_2017.pdf
 
How Bergen Catholic High School Got Its CBT On in Just Three Months
How Bergen Catholic High School Got Its CBT On in Just Three MonthsHow Bergen Catholic High School Got Its CBT On in Just Three Months
How Bergen Catholic High School Got Its CBT On in Just Three Months
 
Using Sakai to meet accreditation standards
Using Sakai to meet accreditation standardsUsing Sakai to meet accreditation standards
Using Sakai to meet accreditation standards
 
Presentation from eAssessment & Originality hands-on session for PGRs (PTT co...
Presentation from eAssessment & Originality hands-on session for PGRs (PTT co...Presentation from eAssessment & Originality hands-on session for PGRs (PTT co...
Presentation from eAssessment & Originality hands-on session for PGRs (PTT co...
 
Rutgers University CHAMP Evaluation presentation 8 24.14
Rutgers University CHAMP Evaluation presentation 8 24.14Rutgers University CHAMP Evaluation presentation 8 24.14
Rutgers University CHAMP Evaluation presentation 8 24.14
 
E-assessment & feedback at DMU
E-assessment & feedback at DMUE-assessment & feedback at DMU
E-assessment & feedback at DMU
 

Último

Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
ZurliaSoop
 
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in DelhiRussian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
kauryashika82
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
ciinovamais
 
Spellings Wk 3 English CAPS CARES Please Practise
Spellings Wk 3 English CAPS CARES Please PractiseSpellings Wk 3 English CAPS CARES Please Practise
Spellings Wk 3 English CAPS CARES Please Practise
AnaAcapella
 

Último (20)

Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
 
SKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptx
SKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptxSKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptx
SKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptx
 
Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024
 
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in DelhiRussian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
 
Asian American Pacific Islander Month DDSD 2024.pptx
Asian American Pacific Islander Month DDSD 2024.pptxAsian American Pacific Islander Month DDSD 2024.pptx
Asian American Pacific Islander Month DDSD 2024.pptx
 
Unit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptxUnit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptx
 
Key note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfKey note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdf
 
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdfUGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
 
This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.
 
microwave assisted reaction. General introduction
microwave assisted reaction. General introductionmicrowave assisted reaction. General introduction
microwave assisted reaction. General introduction
 
General Principles of Intellectual Property: Concepts of Intellectual Proper...
General Principles of Intellectual Property: Concepts of Intellectual  Proper...General Principles of Intellectual Property: Concepts of Intellectual  Proper...
General Principles of Intellectual Property: Concepts of Intellectual Proper...
 
Grant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingGrant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy Consulting
 
Dyslexia AI Workshop for Slideshare.pptx
Dyslexia AI Workshop for Slideshare.pptxDyslexia AI Workshop for Slideshare.pptx
Dyslexia AI Workshop for Slideshare.pptx
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
 
Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)
 
On National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan FellowsOn National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan Fellows
 
Spellings Wk 3 English CAPS CARES Please Practise
Spellings Wk 3 English CAPS CARES Please PractiseSpellings Wk 3 English CAPS CARES Please Practise
Spellings Wk 3 English CAPS CARES Please Practise
 
SOC 101 Demonstration of Learning Presentation
SOC 101 Demonstration of Learning PresentationSOC 101 Demonstration of Learning Presentation
SOC 101 Demonstration of Learning Presentation
 
Micro-Scholarship, What it is, How can it help me.pdf
Micro-Scholarship, What it is, How can it help me.pdfMicro-Scholarship, What it is, How can it help me.pdf
Micro-Scholarship, What it is, How can it help me.pdf
 
Unit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxUnit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptx
 

Being the middle (wo)man - Designing assessment workflows that make everyone happy... ish

  • 1. Being the middle (wo)man Designing assessment workflows that make everyone happy… ish Durham Blackboard User Group, January 2013 Adel Gordon University of Northampton
  • 2. Disclaimer I’m not a Workflows expert
  • 3. Background • 2 x projects running in parallel – QNIG (QL & NILE Integration Group) – SaGE (Submitting and Grading Electronically) • New sites for 12/13 based on QA templates – As well as: • SaGE across whole Institution • New Blackboard theme • Change of tools (Bb blogs & wikis, Kaltura, EduBlogs…)
  • 4.
  • 5. Where are we now… • First phase of SaGE up and running • Piloting rubrics (to build grades and give clear criteria) Next phase • Integrate Image source: http://channelnomics.com/wp-content/uploads/2011/04/Integrate.jpg
  • 6. Successes • Student submission • Basic level of online marking • Provisional grades & feedback delivered to students online • Initial procedures for second marking and external moderation (but…)
  • 7. Challenges • Timescales • Training • Grading challenges – Letter Grades/Grading Schemas – Turnitin • Integration (naming conventions of submission areas) • Getting all the information we need!
  • 8. Who is involved? Admins Academics Externals Quality LT Execs Students Systems
  • 9. Lessons Learned • Too flexible? – Limit to one tool • Student experience – Limit to first year students • Letter grading – a step too far? • Paper processes • Second marking and external moderation

Notas del editor

  1. QNIG Phase 1, 2 summers ago Phase 2, last summer New sites for 12/13 based on QA templates (data matching, more later) SaGE - Across institution from Sept 12
  2. Student Point – Turnitin, Assignment Tool, Blogs Wikis.. First marker Second marker
  3. Integrate – not systems, but processes Making best use of the processes we ’ ve put into place for their L&T benefits and pulling out data to satisfy admin. Minimising and sometimes eliminating duplication. Not an institution that goes down the customisation route. We don ’ t have the support in house to sustain and support customisations and therefore it could drastically affect our upgrade schedules.
  4. Timescales – pushed forward from top, resisted from tutors Letter grading – primary display can ’ t default to customised schemas Turnitin doesn ’ t accept letter grades Naming conventions – NILE admin… API for Turnitin to use flat files to create submission points? Training – get to everyone? Partner colleges, part time tutors, tutors that don ’ t want to Getting all the information we need – Admins, second marking (varying practice), external moderations (give examples of the forms – 6 different forms that I know of). Determining the processes and the varying practice and rationalising them to develop a central process.
  5. Grading Notes area in the Grade Centre Training – get to everyone? Partner colleges, part time tutors, tutors that don ’ t want to Timescales – pushed forward from top, resisted from tutors Letter grading – primary display can ’ t default to customised schemas Turnitin doesn ’ t accept letter grades Naming conventions – NILE admin… API for Turnitin to use flat files to create submission points? Getting all the information we need – Admins, second marking (varying practice), external moderations (give examples of the forms – 6 different forms that I know of). Determining the processes and the varying practice and rationalising them to develop a central process.
  6. LTs tended organically move into the middle position – where officially a project team.
  7. Too flexible – limit to Turnitin Student experience - first years only Paper processes – need a very clear overview of all the paper processes Lobbying HeLF Heads of eLearning Forum – blackboard for UK specific processes, Make sure that everyone can see the benefits that they will get – SAO, not sure they were open and honest as they saw it as a threat.