SlideShare a Scribd company logo
1 of 35
Using evaluation to inform the evaluation of a user-focused assessment engine Gráinne Conole 1  and Niall Sclater 2 1 University of Southampton 2 University of Strathclyde CAA Conference, Loughborough 5 th  July 2005
Outline ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
 
 
Experiential Practicing Mimicking Experiencing Productive Creating Producing Writing Drawing Composing Synthesising Communicative Discussing Presenting Debating Adaptive Modelling Simulation Info Handling Gathering Ordering Classifying Selecting  Analysing Manipulating Not assessed Diagnostic Formative Summative Adaptive Simulation Modelling Virtual worlds Communicative Chat Chat Email  Discussion boards Mailing lists Weblogs Productive Spreadsheets Databases Narrative Audio  Image Text Video Web page Interactive Libraries Portals Search engines Indiv learner Group leader Coach Participant Mentor Supervisor Rapporteur Facilitator Deliverer Pair person Presenter Peer assessor  Moderator 1 – many Group based Class based 1-1 S to S 1-1 S to T Individual Artefact Assignment Brainstorming Buzz words Defending Dissertation Drill & practice Essay Exercise Fishbowl Ice breaker MCQ Mindmaps Negotiating Pair dialogues Performance Portfolio Product Question & answer Resource-based Role play Rounds Short answer Snowball Debate Test Voting Assimilative Reading Viewing  Listening Assessment Tools & Resources Roles Interaction Technique Type Types of learning activities
 
CAA barriers and enablers ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Modelling online assessment ,[object Object],[object Object],[object Object],[object Object],[object Object]
items Anatomy of an online assessment system
Items items item validator item viewer item author Anatomy of an online assessment system
Items assessments items item validator item viewer item author Anatomy of an online assessment system
Items Assessments assessments items item validator item viewer item author test viewer test validator test author Anatomy of an online assessment system
Items Assessments Test instance System, user & group admin invigilator groups test instance assessments items learner timetabler group administrator system administrator item validator item viewer item author test viewer test validator test author user access administrator users Anatomy of an online assessment system responses and  results
Items Assessments Responses and results Test instance System, user & group admin invigilator responses and  results groups test instance assessments items marks modifier statistics monitor marks monitor marker answer monitor learner feedback administrator learner timetabler group administrator system administrator item validator item viewer item author test viewer test validator test author user access administrator users Anatomy of an online assessment system
 
TOIA  ,[object Object],[object Object],[object Object],[object Object],[object Object]
Evaluation aims ,[object Object],[object Object],[object Object],[object Object],[object Object]
Evaluation methodology ,[object Object],[object Object],[object Object],[object Object],[object Object]
Emergent themes ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Training ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Uses ,[object Object],[object Object],[object Object],[object Object],[object Object]
Barriers ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Enablers ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Issues ,[object Object],[object Object],[object Object],[object Object]
Teaching strategies ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Strategies for designing questions ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Student experience ,[object Object],[object Object],[object Object],[object Object]
Question types ,[object Object],[object Object],[object Object],[object Object],[object Object]
Interoperability ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Questionbanks ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
TOIA specific issues ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
TOIA benefits ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
TOIA disadvantages ,[object Object],[object Object]
Emergent questions ,[object Object],[object Object],[object Object],[object Object]
Using evaluation to inform the evaluation of a user-focused assessment engine Gráinne Conole 1  and Niall Sclater 2 1 University of Southampton 2 University of Strathclyde www.toia.ac.uk [email_address] Sclater.com

More Related Content

What's hot

Bridging the gap: e-learning research
Bridging the gap: e-learning researchBridging the gap: e-learning research
Bridging the gap: e-learning researchgrainne
 
Feedback as dialogue and learning technologies: can e-assessment be formative?
Feedback as dialogue and learning technologies: can e-assessment be formative?Feedback as dialogue and learning technologies: can e-assessment be formative?
Feedback as dialogue and learning technologies: can e-assessment be formative?Centre for Distance Education
 
Pedagogy of online teaching
Pedagogy of online teachingPedagogy of online teaching
Pedagogy of online teachingLorna Kearns
 
RALF (Redesigning Assessment and Learning with feedback in the VLEs) Project
RALF (Redesigning Assessment and Learning with feedback in the VLEs) ProjectRALF (Redesigning Assessment and Learning with feedback in the VLEs) Project
RALF (Redesigning Assessment and Learning with feedback in the VLEs) ProjectDiogo Casanova
 
Culture and learning organisations
Culture and learning organisationsCulture and learning organisations
Culture and learning organisationsRamanpreet saini
 
The Future Looks Digital - TCCTA
The Future Looks Digital - TCCTAThe Future Looks Digital - TCCTA
The Future Looks Digital - TCCTAdrpmcgee
 
Conole connected june_2010
Conole connected june_2010Conole connected june_2010
Conole connected june_2010grainne
 
An ontologyforopenrubricexchangeontheweb
An ontologyforopenrubricexchangeonthewebAn ontologyforopenrubricexchangeontheweb
An ontologyforopenrubricexchangeonthewebbpanulla
 
Toward an automated student feedback system for text based assignments - Pete...
Toward an automated student feedback system for text based assignments - Pete...Toward an automated student feedback system for text based assignments - Pete...
Toward an automated student feedback system for text based assignments - Pete...Blackboard APAC
 
The integrative learning design framework
The integrative learning design frameworkThe integrative learning design framework
The integrative learning design frameworkandreaarcos2015
 
Semantic Techniques for Enabling Knowledge Reuse in Conceptual Modelling
Semantic Techniques for Enabling Knowledge Reuse in Conceptual ModellingSemantic Techniques for Enabling Knowledge Reuse in Conceptual Modelling
Semantic Techniques for Enabling Knowledge Reuse in Conceptual ModellingOscar Corcho
 
Learning Analytics in Education: Using Student’s Big Data to Improve Teaching
Learning Analytics in Education:  Using Student’s Big Data to Improve TeachingLearning Analytics in Education:  Using Student’s Big Data to Improve Teaching
Learning Analytics in Education: Using Student’s Big Data to Improve TeachingRafael Scapin, Ph.D.
 
The future of assessment: five principles, five targets for 2025
The future of assessment: five principles, five targets for 2025The future of assessment: five principles, five targets for 2025
The future of assessment: five principles, five targets for 2025Jisc
 
ABLE - the NTU Student Dashboard - University of Derby
ABLE - the NTU Student Dashboard - University of DerbyABLE - the NTU Student Dashboard - University of Derby
ABLE - the NTU Student Dashboard - University of DerbyEd Foster
 
Comparative and Non-Comparative Evaluation Studies
Comparative and Non-Comparative Evaluation StudiesComparative and Non-Comparative Evaluation Studies
Comparative and Non-Comparative Evaluation Studiesu068717
 
Project-based Collaborative Learning Environment with Context-aware Education...
Project-based Collaborative Learning Environment with Context-aware Education...Project-based Collaborative Learning Environment with Context-aware Education...
Project-based Collaborative Learning Environment with Context-aware Education...Zoran Jeremic
 
RIDE 2010 presentation - Formative assessment practices in distance learning:...
RIDE 2010 presentation - Formative assessment practices in distance learning:...RIDE 2010 presentation - Formative assessment practices in distance learning:...
RIDE 2010 presentation - Formative assessment practices in distance learning:...Centre for Distance Education
 
Exploring learning analytics
Exploring learning analyticsExploring learning analytics
Exploring learning analyticsJisc
 

What's hot (20)

Bridging the gap: e-learning research
Bridging the gap: e-learning researchBridging the gap: e-learning research
Bridging the gap: e-learning research
 
Feedback as dialogue and learning technologies: can e-assessment be formative?
Feedback as dialogue and learning technologies: can e-assessment be formative?Feedback as dialogue and learning technologies: can e-assessment be formative?
Feedback as dialogue and learning technologies: can e-assessment be formative?
 
Pedagogy of online teaching
Pedagogy of online teachingPedagogy of online teaching
Pedagogy of online teaching
 
RALF (Redesigning Assessment and Learning with feedback in the VLEs) Project
RALF (Redesigning Assessment and Learning with feedback in the VLEs) ProjectRALF (Redesigning Assessment and Learning with feedback in the VLEs) Project
RALF (Redesigning Assessment and Learning with feedback in the VLEs) Project
 
Culture and learning organisations
Culture and learning organisationsCulture and learning organisations
Culture and learning organisations
 
The Future Looks Digital - TCCTA
The Future Looks Digital - TCCTAThe Future Looks Digital - TCCTA
The Future Looks Digital - TCCTA
 
Florida Virtual School Research
Florida Virtual School ResearchFlorida Virtual School Research
Florida Virtual School Research
 
Conole connected june_2010
Conole connected june_2010Conole connected june_2010
Conole connected june_2010
 
An ontologyforopenrubricexchangeontheweb
An ontologyforopenrubricexchangeonthewebAn ontologyforopenrubricexchangeontheweb
An ontologyforopenrubricexchangeontheweb
 
Toward an automated student feedback system for text based assignments - Pete...
Toward an automated student feedback system for text based assignments - Pete...Toward an automated student feedback system for text based assignments - Pete...
Toward an automated student feedback system for text based assignments - Pete...
 
The integrative learning design framework
The integrative learning design frameworkThe integrative learning design framework
The integrative learning design framework
 
Semantic Techniques for Enabling Knowledge Reuse in Conceptual Modelling
Semantic Techniques for Enabling Knowledge Reuse in Conceptual ModellingSemantic Techniques for Enabling Knowledge Reuse in Conceptual Modelling
Semantic Techniques for Enabling Knowledge Reuse in Conceptual Modelling
 
Learning Analytics in Education: Using Student’s Big Data to Improve Teaching
Learning Analytics in Education:  Using Student’s Big Data to Improve TeachingLearning Analytics in Education:  Using Student’s Big Data to Improve Teaching
Learning Analytics in Education: Using Student’s Big Data to Improve Teaching
 
The future of assessment: five principles, five targets for 2025
The future of assessment: five principles, five targets for 2025The future of assessment: five principles, five targets for 2025
The future of assessment: five principles, five targets for 2025
 
ABLE - the NTU Student Dashboard - University of Derby
ABLE - the NTU Student Dashboard - University of DerbyABLE - the NTU Student Dashboard - University of Derby
ABLE - the NTU Student Dashboard - University of Derby
 
E assessment
E assessmentE assessment
E assessment
 
Comparative and Non-Comparative Evaluation Studies
Comparative and Non-Comparative Evaluation StudiesComparative and Non-Comparative Evaluation Studies
Comparative and Non-Comparative Evaluation Studies
 
Project-based Collaborative Learning Environment with Context-aware Education...
Project-based Collaborative Learning Environment with Context-aware Education...Project-based Collaborative Learning Environment with Context-aware Education...
Project-based Collaborative Learning Environment with Context-aware Education...
 
RIDE 2010 presentation - Formative assessment practices in distance learning:...
RIDE 2010 presentation - Formative assessment practices in distance learning:...RIDE 2010 presentation - Formative assessment practices in distance learning:...
RIDE 2010 presentation - Formative assessment practices in distance learning:...
 
Exploring learning analytics
Exploring learning analyticsExploring learning analytics
Exploring learning analytics
 

Similar to Evaluation of the TOIA project

Blended Learning For Faculty
Blended Learning For FacultyBlended Learning For Faculty
Blended Learning For FacultyEDUCAUSE
 
Online Course Assessment Part 1
Online Course Assessment  Part 1Online Course Assessment  Part 1
Online Course Assessment Part 1drpmcgee
 
Creating Assessments
Creating AssessmentsCreating Assessments
Creating AssessmentsChristina Sax
 
Blended by Design: Day 3
Blended by Design: Day 3Blended by Design: Day 3
Blended by Design: Day 3EDUCAUSE
 
Assessment of Holistic Student Learning in Open Universities
Assessment of Holistic Student Learning in Open UniversitiesAssessment of Holistic Student Learning in Open Universities
Assessment of Holistic Student Learning in Open UniversitiesWawasan Open University
 
MCC Blended Learning
MCC Blended LearningMCC Blended Learning
MCC Blended Learningdrvdiazbus
 
EDUCAUSE 08
EDUCAUSE 08EDUCAUSE 08
EDUCAUSE 08EDUCAUSE
 
Online Course Assessment Part 2
Online Course Assessment Part 2Online Course Assessment Part 2
Online Course Assessment Part 2drpmcgee
 
Fed Stimulus & Oer Workshop
Fed Stimulus & Oer WorkshopFed Stimulus & Oer Workshop
Fed Stimulus & Oer WorkshopRuth Romi
 
Technology Integration for Meaning Classroom Use: Chapter 7 - Assessment and ...
Technology Integration for Meaning Classroom Use: Chapter 7 - Assessment and ...Technology Integration for Meaning Classroom Use: Chapter 7 - Assessment and ...
Technology Integration for Meaning Classroom Use: Chapter 7 - Assessment and ...Shawndra Bowers
 
Forward thinking feedback at UEA
Forward thinking feedback at UEAForward thinking feedback at UEA
Forward thinking feedback at UEABlackboardEMEA
 
Helping teachers understand their learners and their needs better in WebCT
Helping teachers understand their learners and their needs better in WebCTHelping teachers understand their learners and their needs better in WebCT
Helping teachers understand their learners and their needs better in WebCTcies
 
Overview and Preliminary Results of Using PolyCAFe for Collaboration Analysis...
Overview and Preliminary Results of Using PolyCAFe for Collaboration Analysis...Overview and Preliminary Results of Using PolyCAFe for Collaboration Analysis...
Overview and Preliminary Results of Using PolyCAFe for Collaboration Analysis...Traian Rebedea
 
What Makes a Quality Online Course: The Student Perspective
What Makes a Quality Online Course: The Student PerspectiveWhat Makes a Quality Online Course: The Student Perspective
What Makes a Quality Online Course: The Student PerspectivePenny Ralston-Berg
 
2010 Edu tools
2010 Edu tools2010 Edu tools
2010 Edu toolsWCET
 
Market Opportunity Profile
Market Opportunity Profile Market Opportunity Profile
Market Opportunity Profile Wendy Colby
 
Market Opportunity Profile
Market Opportunity ProfileMarket Opportunity Profile
Market Opportunity ProfileWendy Colby
 
Bringing Blackboard to Bath
Bringing Blackboard to BathBringing Blackboard to Bath
Bringing Blackboard to Bathkateboardman
 

Similar to Evaluation of the TOIA project (20)

Blended Learning For Faculty
Blended Learning For FacultyBlended Learning For Faculty
Blended Learning For Faculty
 
Online Course Assessment Part 1
Online Course Assessment  Part 1Online Course Assessment  Part 1
Online Course Assessment Part 1
 
Creating Assessments
Creating AssessmentsCreating Assessments
Creating Assessments
 
Blended by Design: Day 3
Blended by Design: Day 3Blended by Design: Day 3
Blended by Design: Day 3
 
Assessment of Holistic Student Learning in Open Universities
Assessment of Holistic Student Learning in Open UniversitiesAssessment of Holistic Student Learning in Open Universities
Assessment of Holistic Student Learning in Open Universities
 
Facets of Educational Technology
Facets of Educational TechnologyFacets of Educational Technology
Facets of Educational Technology
 
MCC Blended Learning
MCC Blended LearningMCC Blended Learning
MCC Blended Learning
 
EDUCAUSE 08
EDUCAUSE 08EDUCAUSE 08
EDUCAUSE 08
 
Online Course Assessment Part 2
Online Course Assessment Part 2Online Course Assessment Part 2
Online Course Assessment Part 2
 
Fed Stimulus & Oer Workshop
Fed Stimulus & Oer WorkshopFed Stimulus & Oer Workshop
Fed Stimulus & Oer Workshop
 
Technology Integration for Meaning Classroom Use: Chapter 7 - Assessment and ...
Technology Integration for Meaning Classroom Use: Chapter 7 - Assessment and ...Technology Integration for Meaning Classroom Use: Chapter 7 - Assessment and ...
Technology Integration for Meaning Classroom Use: Chapter 7 - Assessment and ...
 
Forward thinking feedback at UEA
Forward thinking feedback at UEAForward thinking feedback at UEA
Forward thinking feedback at UEA
 
Helping teachers understand their learners and their needs better in WebCT
Helping teachers understand their learners and their needs better in WebCTHelping teachers understand their learners and their needs better in WebCT
Helping teachers understand their learners and their needs better in WebCT
 
Overview and Preliminary Results of Using PolyCAFe for Collaboration Analysis...
Overview and Preliminary Results of Using PolyCAFe for Collaboration Analysis...Overview and Preliminary Results of Using PolyCAFe for Collaboration Analysis...
Overview and Preliminary Results of Using PolyCAFe for Collaboration Analysis...
 
Educause 08 Part 1
Educause 08 Part 1Educause 08 Part 1
Educause 08 Part 1
 
What Makes a Quality Online Course: The Student Perspective
What Makes a Quality Online Course: The Student PerspectiveWhat Makes a Quality Online Course: The Student Perspective
What Makes a Quality Online Course: The Student Perspective
 
2010 Edu tools
2010 Edu tools2010 Edu tools
2010 Edu tools
 
Market Opportunity Profile
Market Opportunity Profile Market Opportunity Profile
Market Opportunity Profile
 
Market Opportunity Profile
Market Opportunity ProfileMarket Opportunity Profile
Market Opportunity Profile
 
Bringing Blackboard to Bath
Bringing Blackboard to BathBringing Blackboard to Bath
Bringing Blackboard to Bath
 

More from grainne

Conole sydney
Conole sydneyConole sydney
Conole sydneygrainne
 
Conole ld overview
Conole ld overviewConole ld overview
Conole ld overviewgrainne
 
Conole compendium ld
Conole compendium ldConole compendium ld
Conole compendium ldgrainne
 
Conole poe
Conole poeConole poe
Conole poegrainne
 
Conole svea
Conole sveaConole svea
Conole sveagrainne
 
Conole vilnius 3_nov
Conole vilnius 3_novConole vilnius 3_nov
Conole vilnius 3_novgrainne
 
Conole vilnius 3_nov
Conole vilnius 3_novConole vilnius 3_nov
Conole vilnius 3_novgrainne
 
Conole vilnius 3_nov
Conole vilnius 3_novConole vilnius 3_nov
Conole vilnius 3_novgrainne
 
Theory methodology
Theory methodologyTheory methodology
Theory methodologygrainne
 
Conole ld
Conole ldConole ld
Conole ldgrainne
 
Oer panel
Oer panelOer panel
Oer panelgrainne
 
Conole creativity
Conole creativityConole creativity
Conole creativitygrainne
 
Conole keynote icde_sept_28
Conole keynote icde_sept_28Conole keynote icde_sept_28
Conole keynote icde_sept_28grainne
 
Conole keynote bali
Conole keynote baliConole keynote bali
Conole keynote baligrainne
 
Conole iaidis 22_july
Conole iaidis 22_julyConole iaidis 22_july
Conole iaidis 22_julygrainne
 
2 09 groinne conole_july_final_2011
2 09 groinne conole_july_final_20112 09 groinne conole_july_final_2011
2 09 groinne conole_july_final_2011grainne
 
Conole opal
Conole opalConole opal
Conole opalgrainne
 
Conole finland workshop
Conole finland workshopConole finland workshop
Conole finland workshopgrainne
 
Conole finland 5_june
Conole finland 5_juneConole finland 5_june
Conole finland 5_junegrainne
 

More from grainne (20)

Conole sydney
Conole sydneyConole sydney
Conole sydney
 
Conole ld overview
Conole ld overviewConole ld overview
Conole ld overview
 
Conole compendium ld
Conole compendium ldConole compendium ld
Conole compendium ld
 
Conole poe
Conole poeConole poe
Conole poe
 
Conole svea
Conole sveaConole svea
Conole svea
 
Conole
ConoleConole
Conole
 
Conole vilnius 3_nov
Conole vilnius 3_novConole vilnius 3_nov
Conole vilnius 3_nov
 
Conole vilnius 3_nov
Conole vilnius 3_novConole vilnius 3_nov
Conole vilnius 3_nov
 
Conole vilnius 3_nov
Conole vilnius 3_novConole vilnius 3_nov
Conole vilnius 3_nov
 
Theory methodology
Theory methodologyTheory methodology
Theory methodology
 
Conole ld
Conole ldConole ld
Conole ld
 
Oer panel
Oer panelOer panel
Oer panel
 
Conole creativity
Conole creativityConole creativity
Conole creativity
 
Conole keynote icde_sept_28
Conole keynote icde_sept_28Conole keynote icde_sept_28
Conole keynote icde_sept_28
 
Conole keynote bali
Conole keynote baliConole keynote bali
Conole keynote bali
 
Conole iaidis 22_july
Conole iaidis 22_julyConole iaidis 22_july
Conole iaidis 22_july
 
2 09 groinne conole_july_final_2011
2 09 groinne conole_july_final_20112 09 groinne conole_july_final_2011
2 09 groinne conole_july_final_2011
 
Conole opal
Conole opalConole opal
Conole opal
 
Conole finland workshop
Conole finland workshopConole finland workshop
Conole finland workshop
 
Conole finland 5_june
Conole finland 5_juneConole finland 5_june
Conole finland 5_june
 

Recently uploaded

SBP-Market-Operations and market managment
SBP-Market-Operations and market managmentSBP-Market-Operations and market managment
SBP-Market-Operations and market managmentfactical
 
Managing Finances in a Small Business (yes).pdf
Managing Finances  in a Small Business (yes).pdfManaging Finances  in a Small Business (yes).pdf
Managing Finances in a Small Business (yes).pdfmar yame
 
Governor Olli Rehn: Dialling back monetary restraint
Governor Olli Rehn: Dialling back monetary restraintGovernor Olli Rehn: Dialling back monetary restraint
Governor Olli Rehn: Dialling back monetary restraintSuomen Pankki
 
NO1 Certified Amil Baba In Lahore Kala Jadu In Lahore Best Amil In Lahore Ami...
NO1 Certified Amil Baba In Lahore Kala Jadu In Lahore Best Amil In Lahore Ami...NO1 Certified Amil Baba In Lahore Kala Jadu In Lahore Best Amil In Lahore Ami...
NO1 Certified Amil Baba In Lahore Kala Jadu In Lahore Best Amil In Lahore Ami...Amil baba
 
NO1 WorldWide online istikhara for love marriage vashikaran specialist love p...
NO1 WorldWide online istikhara for love marriage vashikaran specialist love p...NO1 WorldWide online istikhara for love marriage vashikaran specialist love p...
NO1 WorldWide online istikhara for love marriage vashikaran specialist love p...Amil Baba Dawood bangali
 
Vp Girls near me Delhi Call Now or WhatsApp
Vp Girls near me Delhi Call Now or WhatsAppVp Girls near me Delhi Call Now or WhatsApp
Vp Girls near me Delhi Call Now or WhatsAppmiss dipika
 
NO1 WorldWide Genuine vashikaran specialist Vashikaran baba near Lahore Vashi...
NO1 WorldWide Genuine vashikaran specialist Vashikaran baba near Lahore Vashi...NO1 WorldWide Genuine vashikaran specialist Vashikaran baba near Lahore Vashi...
NO1 WorldWide Genuine vashikaran specialist Vashikaran baba near Lahore Vashi...Amil baba
 
Financial Leverage Definition, Advantages, and Disadvantages
Financial Leverage Definition, Advantages, and DisadvantagesFinancial Leverage Definition, Advantages, and Disadvantages
Financial Leverage Definition, Advantages, and Disadvantagesjayjaymabutot13
 
Stock Market Brief Deck FOR 4/17 video.pdf
Stock Market Brief Deck FOR 4/17 video.pdfStock Market Brief Deck FOR 4/17 video.pdf
Stock Market Brief Deck FOR 4/17 video.pdfMichael Silva
 
Call Girls Near Golden Tulip Essential Hotel, New Delhi 9873777170
Call Girls Near Golden Tulip Essential Hotel, New Delhi 9873777170Call Girls Near Golden Tulip Essential Hotel, New Delhi 9873777170
Call Girls Near Golden Tulip Essential Hotel, New Delhi 9873777170Sonam Pathan
 
letter-from-the-chair-to-the-fca-relating-to-british-steel-pensions-scheme-15...
letter-from-the-chair-to-the-fca-relating-to-british-steel-pensions-scheme-15...letter-from-the-chair-to-the-fca-relating-to-british-steel-pensions-scheme-15...
letter-from-the-chair-to-the-fca-relating-to-british-steel-pensions-scheme-15...Henry Tapper
 
Economics, Commerce and Trade Management: An International Journal (ECTIJ)
Economics, Commerce and Trade Management: An International Journal (ECTIJ)Economics, Commerce and Trade Management: An International Journal (ECTIJ)
Economics, Commerce and Trade Management: An International Journal (ECTIJ)ECTIJ
 
GOODSANDSERVICETAX IN INDIAN ECONOMY IMPACT
GOODSANDSERVICETAX IN INDIAN ECONOMY IMPACTGOODSANDSERVICETAX IN INDIAN ECONOMY IMPACT
GOODSANDSERVICETAX IN INDIAN ECONOMY IMPACTharshitverma1762
 
Current Economic situation of Pakistan .pptx
Current Economic situation of Pakistan .pptxCurrent Economic situation of Pakistan .pptx
Current Economic situation of Pakistan .pptxuzma244191
 
BPPG response - Options for Defined Benefit schemes - 19Apr24.pdf
BPPG response - Options for Defined Benefit schemes - 19Apr24.pdfBPPG response - Options for Defined Benefit schemes - 19Apr24.pdf
BPPG response - Options for Defined Benefit schemes - 19Apr24.pdfHenry Tapper
 
(中央兰开夏大学毕业证学位证成绩单-案例)
(中央兰开夏大学毕业证学位证成绩单-案例)(中央兰开夏大学毕业证学位证成绩单-案例)
(中央兰开夏大学毕业证学位证成绩单-案例)twfkn8xj
 
Amil Baba In Pakistan amil baba in Lahore amil baba in Islamabad amil baba in...
Amil Baba In Pakistan amil baba in Lahore amil baba in Islamabad amil baba in...Amil Baba In Pakistan amil baba in Lahore amil baba in Islamabad amil baba in...
Amil Baba In Pakistan amil baba in Lahore amil baba in Islamabad amil baba in...amilabibi1
 
PMFBY , Pradhan Mantri Fasal bima yojna
PMFBY , Pradhan Mantri  Fasal bima yojnaPMFBY , Pradhan Mantri  Fasal bima yojna
PMFBY , Pradhan Mantri Fasal bima yojnaDharmendra Kumar
 

Recently uploaded (20)

SBP-Market-Operations and market managment
SBP-Market-Operations and market managmentSBP-Market-Operations and market managment
SBP-Market-Operations and market managment
 
Managing Finances in a Small Business (yes).pdf
Managing Finances  in a Small Business (yes).pdfManaging Finances  in a Small Business (yes).pdf
Managing Finances in a Small Business (yes).pdf
 
Governor Olli Rehn: Dialling back monetary restraint
Governor Olli Rehn: Dialling back monetary restraintGovernor Olli Rehn: Dialling back monetary restraint
Governor Olli Rehn: Dialling back monetary restraint
 
NO1 Certified Amil Baba In Lahore Kala Jadu In Lahore Best Amil In Lahore Ami...
NO1 Certified Amil Baba In Lahore Kala Jadu In Lahore Best Amil In Lahore Ami...NO1 Certified Amil Baba In Lahore Kala Jadu In Lahore Best Amil In Lahore Ami...
NO1 Certified Amil Baba In Lahore Kala Jadu In Lahore Best Amil In Lahore Ami...
 
NO1 WorldWide online istikhara for love marriage vashikaran specialist love p...
NO1 WorldWide online istikhara for love marriage vashikaran specialist love p...NO1 WorldWide online istikhara for love marriage vashikaran specialist love p...
NO1 WorldWide online istikhara for love marriage vashikaran specialist love p...
 
Vp Girls near me Delhi Call Now or WhatsApp
Vp Girls near me Delhi Call Now or WhatsAppVp Girls near me Delhi Call Now or WhatsApp
Vp Girls near me Delhi Call Now or WhatsApp
 
NO1 WorldWide Genuine vashikaran specialist Vashikaran baba near Lahore Vashi...
NO1 WorldWide Genuine vashikaran specialist Vashikaran baba near Lahore Vashi...NO1 WorldWide Genuine vashikaran specialist Vashikaran baba near Lahore Vashi...
NO1 WorldWide Genuine vashikaran specialist Vashikaran baba near Lahore Vashi...
 
Financial Leverage Definition, Advantages, and Disadvantages
Financial Leverage Definition, Advantages, and DisadvantagesFinancial Leverage Definition, Advantages, and Disadvantages
Financial Leverage Definition, Advantages, and Disadvantages
 
Stock Market Brief Deck FOR 4/17 video.pdf
Stock Market Brief Deck FOR 4/17 video.pdfStock Market Brief Deck FOR 4/17 video.pdf
Stock Market Brief Deck FOR 4/17 video.pdf
 
🔝+919953056974 🔝young Delhi Escort service Pusa Road
🔝+919953056974 🔝young Delhi Escort service Pusa Road🔝+919953056974 🔝young Delhi Escort service Pusa Road
🔝+919953056974 🔝young Delhi Escort service Pusa Road
 
Call Girls Near Golden Tulip Essential Hotel, New Delhi 9873777170
Call Girls Near Golden Tulip Essential Hotel, New Delhi 9873777170Call Girls Near Golden Tulip Essential Hotel, New Delhi 9873777170
Call Girls Near Golden Tulip Essential Hotel, New Delhi 9873777170
 
letter-from-the-chair-to-the-fca-relating-to-british-steel-pensions-scheme-15...
letter-from-the-chair-to-the-fca-relating-to-british-steel-pensions-scheme-15...letter-from-the-chair-to-the-fca-relating-to-british-steel-pensions-scheme-15...
letter-from-the-chair-to-the-fca-relating-to-british-steel-pensions-scheme-15...
 
Monthly Economic Monitoring of Ukraine No 231, April 2024
Monthly Economic Monitoring of Ukraine No 231, April 2024Monthly Economic Monitoring of Ukraine No 231, April 2024
Monthly Economic Monitoring of Ukraine No 231, April 2024
 
Economics, Commerce and Trade Management: An International Journal (ECTIJ)
Economics, Commerce and Trade Management: An International Journal (ECTIJ)Economics, Commerce and Trade Management: An International Journal (ECTIJ)
Economics, Commerce and Trade Management: An International Journal (ECTIJ)
 
GOODSANDSERVICETAX IN INDIAN ECONOMY IMPACT
GOODSANDSERVICETAX IN INDIAN ECONOMY IMPACTGOODSANDSERVICETAX IN INDIAN ECONOMY IMPACT
GOODSANDSERVICETAX IN INDIAN ECONOMY IMPACT
 
Current Economic situation of Pakistan .pptx
Current Economic situation of Pakistan .pptxCurrent Economic situation of Pakistan .pptx
Current Economic situation of Pakistan .pptx
 
BPPG response - Options for Defined Benefit schemes - 19Apr24.pdf
BPPG response - Options for Defined Benefit schemes - 19Apr24.pdfBPPG response - Options for Defined Benefit schemes - 19Apr24.pdf
BPPG response - Options for Defined Benefit schemes - 19Apr24.pdf
 
(中央兰开夏大学毕业证学位证成绩单-案例)
(中央兰开夏大学毕业证学位证成绩单-案例)(中央兰开夏大学毕业证学位证成绩单-案例)
(中央兰开夏大学毕业证学位证成绩单-案例)
 
Amil Baba In Pakistan amil baba in Lahore amil baba in Islamabad amil baba in...
Amil Baba In Pakistan amil baba in Lahore amil baba in Islamabad amil baba in...Amil Baba In Pakistan amil baba in Lahore amil baba in Islamabad amil baba in...
Amil Baba In Pakistan amil baba in Lahore amil baba in Islamabad amil baba in...
 
PMFBY , Pradhan Mantri Fasal bima yojna
PMFBY , Pradhan Mantri  Fasal bima yojnaPMFBY , Pradhan Mantri  Fasal bima yojna
PMFBY , Pradhan Mantri Fasal bima yojna
 

Evaluation of the TOIA project

  • 1. Using evaluation to inform the evaluation of a user-focused assessment engine Gráinne Conole 1 and Niall Sclater 2 1 University of Southampton 2 University of Strathclyde CAA Conference, Loughborough 5 th July 2005
  • 2.
  • 3.  
  • 4.  
  • 5. Experiential Practicing Mimicking Experiencing Productive Creating Producing Writing Drawing Composing Synthesising Communicative Discussing Presenting Debating Adaptive Modelling Simulation Info Handling Gathering Ordering Classifying Selecting Analysing Manipulating Not assessed Diagnostic Formative Summative Adaptive Simulation Modelling Virtual worlds Communicative Chat Chat Email Discussion boards Mailing lists Weblogs Productive Spreadsheets Databases Narrative Audio Image Text Video Web page Interactive Libraries Portals Search engines Indiv learner Group leader Coach Participant Mentor Supervisor Rapporteur Facilitator Deliverer Pair person Presenter Peer assessor Moderator 1 – many Group based Class based 1-1 S to S 1-1 S to T Individual Artefact Assignment Brainstorming Buzz words Defending Dissertation Drill & practice Essay Exercise Fishbowl Ice breaker MCQ Mindmaps Negotiating Pair dialogues Performance Portfolio Product Question & answer Resource-based Role play Rounds Short answer Snowball Debate Test Voting Assimilative Reading Viewing Listening Assessment Tools & Resources Roles Interaction Technique Type Types of learning activities
  • 6.  
  • 7.
  • 8.
  • 9. items Anatomy of an online assessment system
  • 10. Items items item validator item viewer item author Anatomy of an online assessment system
  • 11. Items assessments items item validator item viewer item author Anatomy of an online assessment system
  • 12. Items Assessments assessments items item validator item viewer item author test viewer test validator test author Anatomy of an online assessment system
  • 13. Items Assessments Test instance System, user & group admin invigilator groups test instance assessments items learner timetabler group administrator system administrator item validator item viewer item author test viewer test validator test author user access administrator users Anatomy of an online assessment system responses and results
  • 14. Items Assessments Responses and results Test instance System, user & group admin invigilator responses and results groups test instance assessments items marks modifier statistics monitor marks monitor marker answer monitor learner feedback administrator learner timetabler group administrator system administrator item validator item viewer item author test viewer test validator test author user access administrator users Anatomy of an online assessment system
  • 15.  
  • 16.
  • 17.
  • 18.
  • 19.
  • 20.
  • 21.
  • 22.
  • 23.
  • 24.
  • 25.
  • 26.
  • 27.
  • 28.
  • 29.
  • 30.
  • 31.
  • 32.
  • 33.
  • 34.
  • 35. Using evaluation to inform the evaluation of a user-focused assessment engine Gráinne Conole 1 and Niall Sclater 2 1 University of Southampton 2 University of Strathclyde www.toia.ac.uk [email_address] Sclater.com