Active learning environments require sustained student engagement in learning scenarios. Can we use data to provide feedback in real time about this participation?

1. Imran Khan, Abelardo Pardo (@abelardopardo)
Faculty of Engineering and IT
slideshare.net/abelardo_pardo
KannanBflickr.com
International Conference on Learning Analytics and Knowledge
University of Edinburgh
29 April 2016
Data2U: Scalable Real time Student
Feedback in Active Learning
Environments

2. Data2U: Scalable Real time Student Feedback in Active Learning EnvironmentsKhan, I. & Pardo, A. 2
PostmodernSleazeflickr.com
Provide real-time meaningful
feedback to students about their
engagement
The problem

3. Data2U: Scalable Real time Student Feedback in Active Learning EnvironmentsKhan, I. & Pardo, A. 3
Hattie, J., & Timperley, H. (2007). The Power of Feedback. Review of Educational Research, 77(1), 81-112. doi:
10.3102/003465430298487
FarukAteşflickr.com
"information provided by an agent (teacher, peer,
book, parent, self, experience) regarding aspects
of one’s performance or understanding”

4. Data2U: Scalable Real time Student Feedback in Active Learning EnvironmentsKhan, I. & Pardo, A. 4
Black, P., & Wiliam, D. (1998). Assessment and Classroom Learning. Assessment in Education: Principles, Policy & Practice, 5(1),
7-74. doi:10.1080/0969595980050102
GarethChristopherflickr.com
Innovations designed to strengthen the frequent
feedback that students receive about their
learning yield substantial learning gains

5. Data2U: Scalable Real time Student Feedback in Active Learning EnvironmentsKhan, I. & Pardo, A. 5
Feedback is inherent in and a
prime determiner of processes that
constitute self regulated learning
Galflickr.com
Butler, D. L., & Winne, P. H. (1995). Feedback and Self-Regulated Learning: A Theoretical Synthesis. Review of Educational
Research, 65(3), 245-281

6. Data2U: Scalable Real time Student Feedback in Active Learning EnvironmentsKhan, I. & Pardo, A. 6
MichaelLevine-Clarkflickr.com
Krumm, A. E., Waddington, R. J., Teasley, S. D., & Lonn, S. (2014). A Learning Management System-Based Early Warning System for Academic
Advising in Undergraduate Engineering. In J. A. Larusson & B. White (Eds.), Learning Analytics: From Research to Practice (pp. 103-119). New
York, USA: Springer Science+Business Media
Information provided to an
intermediary for further
processing
Information provided directly
to the students for
interpretation

7. Data2U: Scalable Real time Student Feedback in Active Learning EnvironmentsKhan, I. & Pardo, A. 7
Active Learning Works

8. Data2U: Scalable Real time Student Feedback in Active Learning EnvironmentsKhan, I. & Pardo, A.
The intermediary
Instructor may be the
bottleneck for
basic real-time feedback
8
RoelWijnantsflickr.com

9. Data2U: Scalable Real time Student Feedback in Active Learning EnvironmentsKhan, I. & Pardo, A. 9
Corrin, L., & de Barba, P. (2014). Exploring students' interpretation of feedback delivered through learning analytics dashboards. Paper presented at
the ASCILITE conference, Dunedin, New Zealand.
Dashboard provided directly to
students
Students able to interpret the data
Increase motivation after seeing
the data

10. Data2U: Scalable Real time Student Feedback in Active Learning EnvironmentsKhan, I. & Pardo, A. 10
Peteflickr.com
Objective: Feedback
• Active learning scenarios
• Automatic
• Real time
• Meaningful indicators
• How do students use the dashboard?

11. Data2U: Scalable Real time Student Feedback in Active Learning EnvironmentsKhan, I. & Pardo, A. 11
• First year engineering
course
• Computer Systems
• Flipped Blended
Learning
• ~300 students
Preparation activities
with formative and
summative assessment
Johnflickr.com

12. Data2U: Scalable Real time Student Feedback in Active Learning EnvironmentsKhan, I. & Pardo, A. 12
2 Hours
2 Hours
3 Hours
Pardo, A. & Mirriahi N. (in press). Design, Deployment and Evaluation of a Flipped Learning First Year Engineering Course. In C.
Reidsema, L. Kavanagh, R. Hadgraft & N. Smith (Eds.), Flipping the Classroom: Practice and Practices. Singapore: Springer.

13. Data2U: Scalable Real time Student Feedback in Active Learning EnvironmentsKhan, I. & Pardo, A. 13

14. Data2U: Scalable Real time Student Feedback in Active Learning EnvironmentsKhan, I. & Pardo, A. 13
Tracking

15. Abelardo Pardo Using technology to provide feedback on learning strategies 14
Weekly real time feedback

16. Data2U: Scalable Real time Student Feedback in Active Learning EnvironmentsKhan, I. & Pardo, A. 15
QuinnDombrowskiflickr.com
How many times is the dashboard accessed?
Most students access it once every six sessions

17. Data2U: Scalable Real time Student Feedback in Active Learning EnvironmentsKhan, I. & Pardo, A. 16
QuinnDombrowskiflickr.com
What type of interaction?
WindellOskayflickr.com
Counted events before and after
first access to dashboard

18. Data2U: Scalable Real time Student Feedback in Active Learning EnvironmentsKhan, I. & Pardo, A.
Previous model used to predict type of interaction
17
How does interaction change over the semester?
Dashboard views do not correlate with academic
performance

19. Data2U: Scalable Real time Student Feedback in Active Learning EnvironmentsKhan, I. & Pardo, A. 18
Conclusions and Future Work
• How students use a dashboard
with real time feedback.
• Suitable for active learning
scenarios
• Combine with qualitative analysis
• Explore dashboard variations

20. Imran Khan, Abelardo Pardo (@abelardopardo)
Faculty of Engineering and IT
slideshare.net/abelardo_pardo
KannanBflickr.com
International Conference on Learning Analytics and Knowledge
University of Edinburgh
29 April 2016
Data2U: Scalable Real time Student
Feedback in Active Learning
Environments