See: http://scienceoftheinvisible.blogspot.co.uk/2012/05/fun-on-friday.html

1. Asynchronous testing
- question banks
BS1010/1011 n = 257 (+) BS2060 n = 145 (+)
Need:
• Efficient use of staff time
• Rapid feedback / formative
• Maintain integrity of assessment?
alan.cann@le.ac.uk

2. How?
• MCQs with extended matching
(Cann, A.J. (2005) Extended matching sets questions for online numeracy assessments: a
case study. Assessment & Evaluation in Higher Education 30(6): 633-640)
• Question pools (3-5 per pool)
• Test randomization: 12 questions x pools of 4
= 12! * 412 = 8x1015 combinations (sort of ;-)
• Feedback with answer (graduated)
alan.cann@le.ac.uk

3. alan.cann@le.ac.uk

4. Example 1 (BS1010)
alan.cann@le.ac.uk

5. Example 2 (BS1011)
alan.cann@le.ac.uk

6. Example 3 (BS2060)
alan.cann@le.ac.uk

7. Downsides
• Bb randomisation
• No stats on question performance from pools
• Generating large numbers of high quality questions!
• And ?
alan.cann@le.ac.uk

8. Student-generated questions?
alan.cann@le.ac.uk

9. Feedback
• Bb quizzes generally have high student acceptability
alan.cann@le.ac.uk

10. What I’d like to change
• Get students to attend face to face help sessions!
alan.cann@le.ac.uk