Summary of Manchester Metropolitan University's TRansforming Assessment & Feedback For Institutional Change JISC-funded project

1. TRansforming Assessment &
Feedback For Institutional Change:
our journey so far…
Birmingham | May 2013
Professor Mark Stubbs
Head of Learning & Research Technologies
m.stubbs@mmu.ac.uk http://twitter.com/thestubbs
http://slideshare.net/markstubbs

2. Strand A : Goal = institution-wide impact
• Hitched TRAFFIC to the EQAL delivery wagon
• Took our baseline report to committees that matter
• Influenced ICP on Assessment of Students
• Analysed assessment data & appeals

3. EQAL: new rules for summative assessment
• Aim to address over-assessment in FT UG provision
– Max 2 summative elements per 30 credit module
– Rolling out year-by-year to all UGs from Sep 2011
2011/12 (n=8,708) 2012/13 (n=8,646)
FB SATISFCN HAND-INS BUNCHING FB SATISFCN HAND-INS BUNCHING
L4 3.75 5.61 1.29 3.79 (+1%) 5.59 (0%) 1.25 (-3%)
L5 3.70 10.47 1.38 3.77 (+2%) 5.76 (-45%) 1.25 (-10%)
L6 3.72 7.81 1.30 3.8 (+2%) 7.86 (+1%) 1.26 (-3%)
FB SATISFCN = response (5=Agree Strongly...1=Disagree Strongly) to
Feedback on my work helped me to clarify things I did not understand
BUNCHING = HAND-INS / WEEKS_WITH_HAND_INS

4. A&F Analytics
• Statistical analysis of ~17,000 cases of
student satisfaction, attainment &
assignment submission patterns
– Satisfaction with course organisation predicts
overall satisfaction
– Satisfaction with feedback NOT a predictor of
overall satisfaction
– Satisfaction with feedback NOT a predictor of
average marks
– Assignment bunching NOT a predictor of
average marks but partial dependence plot is
interesting
BUNCHING = HAND-INS
WEEKS_WITH_HAND-INS

5. Deadlines & marks web-service weekly hits
0
50000
100000
150000
200000
250000
1 4 7 10 13 16 19 22 25 28 31 34 37 40 43 46 49 52 2 5 8 11 14 17
2012 2013
+ = 8.3M hits
(since Jan 1, 2012)

6. Where TRAFFIC goes next …
Open
source
EAM
A&F
Analytics
A&F
Lifecycle
Webinar
May 15
Find out
more from
our blog
Moodle 2.4
pilot planned
for Sep
Linking
Moodle &
SRS
Notify
SRS of
Moodle
submits
Notify
SRS of
Moodle
marks
EAM