SlideShare una empresa de Scribd logo
1 de 28
Descargar para leer sin conexión
Using learning analytics to boost personal tutoring
ABLE Project 2015-1-BE-EPPKA3-PI-FORWARD
STELA Project: 562167-EPP-1-2015-1-BE-EPPKA3-PI-FORWARD
Session aims
• Introduce learning analytics
• Describe the development of the NTU Student Dashboard
• Discuss potential benefits of learning analytics for personal tutors
• Raise some challenges of converting student information to actionable
intelligence
Introduction to learning analytics
"Analytics is a term used
in business and science
to refer to computational
support for capturing
digital data to help
inform decision-making
… Learning Analytics
appropriates this concept
for education.”
(Buckingham Shum,
2012, p.1)
(Clow, 2012)
Learning Analytics
Why NTU is interested in learning analytics?
• Reduce barriers to being known by a tutor
• Space for tutors to make notes & plan
• Students as agents
• Can see own grades, and compare self to
peers
• Feedback
• Tool for academic use
• Potentially promotes virtuous behaviour
• Alerts tutors if students are high risk for
leaving early
• Students can compare their engagement
with their peers
Attainment
Progression
Belonging
Strategic
information
• Insights into groups at risk
• Potentially design and delivery of
courses
Development of the NTU Student Dashboard
Developmental Cycle
Sept
2013
Sept
2014
Sept
2015
Pilot Phase Phase One Phase
Two
Phase Three
 Personalisation
 Embedding into University
systems
 4 courses
 40 staff
 500 1st years
Willing participants:
very positive staff
feedback, limited
student awareness
 8 of 9 Schools
 Governance
 Problem solving
 Ethics
Near to whole
University roll out:
increased awareness
 All Schools
 New data
sources
 Assessment
view
Whole
University roll
out: increased
awareness
Feb
2016
Increasing resources (e.g.
how to guides),
communication, guidance
Staff and student consultation ongoing throughout developments
Further details of projects at http://www.ableproject.eu/project-outputs/ and
https://eng.kuleuven.be/english/projects/STELAproject/stela
The NTU Student Dashboard
• Can be viewed as two products:
Physical
Dashboard
Algorithm
• Staff and students interact with physical dashboard
• Algorithm is the behind the scenes, learning analytics element
Raises
alerts!!
What does the Dashboard do?
NTU
Student
Dashboard
Student biographical
info, e.g. enrolment
status
Evidence of student
engagement
• Door swipes
(where appropriate)
• Library books
• NOW use
• Dropbox
submissions
• Attendance data
• Access to e-
books and
journals through
Shibboleth
authentication
Staff
view
Student
view
Compares student
engagement across
the cohort & gives
rating
Can make
comments in
free text box
Potential benefits of learning analytics for personal
tutors
Data accuracy for algorithm spotting students
at risk
• Two big questions:
1. Can the algorithm correctly identify at risk students?
2. Can it do so on a timescale that allows intervention?
Relationship between yearly average engagement &
progression
• Low average (mode) engagement for the year is an indicator of risk
Relationship between term one average engagement &
progression
• Low average (mode) engagement for the 1st term is an indicator of risk
No engagement alerts
• Any one alert is an indicator of risk
• Students with multiple alerts had lower incidence of progression
Tutorial Landing Screen
• Access to tutees in addition to search facilities for other students the
staff member interacts with
Links to student’s dashboard Able to sort on headings
Class view
• Designed so staff have easy access to student data.
• Allows staff to quickly identify potentially at risk students
Individual student view
Not Fully
Enrolled
Staff and students can
benchmark engagement –
springboard for conversation
Notes and referrals
• Notes inputted by
staff only
• Time and date stamp
• Referral to:
 Library Academic
Skills
 Student Support
Services
 Employability
(planned)
Personal tutors can track interactions with students
Personal tutors can make referral whilst in room with student
Student profile
• Basic information (ability to
report if this is wrong)
• Engagement summary
• Entry qualification details
• Engagement history (for
previous years)
• Details to help early tutorials
• Data drawn
automatically from
the attendance app
• The wheel shows
overall attendance
• The table below
provides more
detailed information
for recent weeks
Attendance
• Springboard for
conversation
(potential context of
School attendance
policy)
Assessment & Feedback View
• Only show
assessments and
feedback
submitted
through NOW
(the University’s
VLE)
• Shows
assessments and
feedback for
multiple modules
• Better sight of student performance than only seeing own module results so
tutor can make more informed recommendations
Challenges of converting student information to
actionable intelligence
How are we using the Dashboard to address
disparities in attainment?
• Two change agents
• Developing learning analytics is challenging
• Institutional change based on learning analytics may be a different
order of magnitude
– We already have data on students at risk, attendance, non-submission of
coursework
– Yet it is often extremely difficult to change student outcomes
Students Staff
Staff as Change Agents
• Personal tutor
– Induction activity
– Primary contact for alerts
– Ongoing support
– iPad trial
• Referrals to support services
– Notes and referrals function
• Staff communication
– Briefings and drop-in sessions
– Newsletter term 1 – low engagement
– Newsletter term 2 – alerts
Students as change agents
• Dashboard as resource to inform students about their engagement
• Dashboard focuses positively on engagement rather than risk
• Challenges around Success for All
• Focus on communication and development of tool in-line with
student views
Feedback from the Student Transition Survey
• The transition survey was conducted with first year students (Feb/March 2016)
• 91% reported using the Dashboard at least once (90% in 2015)
Have you logged into the NTU student Dashboard?
When using the Dashboard, how often have you explored the following?
Base: 515 (2016), 469 (2015)
4%
5%
14%
15%
13%
24%
5%
6%
26%
24%
35%
36%
12%
13%
33%
34%
34%
36%
79%
77%
28%
28%
19%
5%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Spoke to someone providing specialist help (for
example student support services/ library) as a result
of looking at information on the Dashboard
Spoke to your tutor as a result of looking at
information on the Dashboard
Changed your behaviour to raise or maintain your
engagement score (for example made sure that you
swiped to go into a building)
Compared your engagement score with other students
on your course
Increased the amount of time you spend studying
Checked your own engagement score
Very Often Often Sometimes Never
Relationship between number of Dashboard
log-ins and engagement classification
Thank you for listening.
Any questions?

Más contenido relacionado

La actualidad más candente

Unleashing Analytics in the Classroom
Unleashing Analytics in the ClassroomUnleashing Analytics in the Classroom
Unleashing Analytics in the ClassroomGustavo Roque
 
ABLE - Learner Analytics Symposium - Rebecca Edwards
ABLE - Learner Analytics Symposium - Rebecca EdwardsABLE - Learner Analytics Symposium - Rebecca Edwards
ABLE - Learner Analytics Symposium - Rebecca EdwardsEd Foster
 
Delivering Student Retention & Success with Predictive Analytics | Nicole Wal...
Delivering Student Retention & Success with Predictive Analytics | Nicole Wal...Delivering Student Retention & Success with Predictive Analytics | Nicole Wal...
Delivering Student Retention & Success with Predictive Analytics | Nicole Wal...Blackboard APAC
 
Hugh Mannerings & Jonathan Neves
Hugh Mannerings & Jonathan NevesHugh Mannerings & Jonathan Neves
Hugh Mannerings & Jonathan NevesLucia Garcia
 
National university assessment process
National university assessment processNational university assessment process
National university assessment processAshley Kovacs
 
2016-2017 Mentorship Program details
2016-2017 Mentorship Program details2016-2017 Mentorship Program details
2016-2017 Mentorship Program detailsStaci Trekles
 
Amy Driscoll: Signature Assignments
Amy Driscoll: Signature AssignmentsAmy Driscoll: Signature Assignments
Amy Driscoll: Signature AssignmentsWASC Senior
 
Learning analytics and the learning and teaching journey | Prof Deborah West ...
Learning analytics and the learning and teaching journey | Prof Deborah West ...Learning analytics and the learning and teaching journey | Prof Deborah West ...
Learning analytics and the learning and teaching journey | Prof Deborah West ...Blackboard APAC
 
SCOF: A Standardised, Customisable Online Feedback Tool
SCOF: A Standardised, Customisable Online Feedback ToolSCOF: A Standardised, Customisable Online Feedback Tool
SCOF: A Standardised, Customisable Online Feedback ToolIan Glover
 
Learning Analytics - Sweden
Learning Analytics - SwedenLearning Analytics - Sweden
Learning Analytics - SwedenEduSkills OECD
 
Analytics in Action - Education
Analytics in Action - EducationAnalytics in Action - Education
Analytics in Action - EducationLee Schlenker
 
RecSys 2015 posters
RecSys 2015 postersRecSys 2015 posters
RecSys 2015 postersJMoralesBSU
 

La actualidad más candente (20)

Unleashing Analytics in the Classroom
Unleashing Analytics in the ClassroomUnleashing Analytics in the Classroom
Unleashing Analytics in the Classroom
 
Bob Gilworth
Bob GilworthBob Gilworth
Bob Gilworth
 
ABLE - Learner Analytics Symposium - Rebecca Edwards
ABLE - Learner Analytics Symposium - Rebecca EdwardsABLE - Learner Analytics Symposium - Rebecca Edwards
ABLE - Learner Analytics Symposium - Rebecca Edwards
 
Delivering Student Retention & Success with Predictive Analytics | Nicole Wal...
Delivering Student Retention & Success with Predictive Analytics | Nicole Wal...Delivering Student Retention & Success with Predictive Analytics | Nicole Wal...
Delivering Student Retention & Success with Predictive Analytics | Nicole Wal...
 
Hugh Mannerings & Jonathan Neves
Hugh Mannerings & Jonathan NevesHugh Mannerings & Jonathan Neves
Hugh Mannerings & Jonathan Neves
 
Ian Scott and Roger Grew - Module Evaluation at Oxford Brookes
Ian Scott and Roger Grew - Module Evaluation at Oxford BrookesIan Scott and Roger Grew - Module Evaluation at Oxford Brookes
Ian Scott and Roger Grew - Module Evaluation at Oxford Brookes
 
Challenges of Quality in Teaching and Learning - Gwen van der velden
Challenges of Quality in Teaching and Learning - Gwen van der veldenChallenges of Quality in Teaching and Learning - Gwen van der velden
Challenges of Quality in Teaching and Learning - Gwen van der velden
 
National university assessment process
National university assessment processNational university assessment process
National university assessment process
 
2016-2017 Mentorship Program details
2016-2017 Mentorship Program details2016-2017 Mentorship Program details
2016-2017 Mentorship Program details
 
Amy Driscoll: Signature Assignments
Amy Driscoll: Signature AssignmentsAmy Driscoll: Signature Assignments
Amy Driscoll: Signature Assignments
 
Learning analytics and the learning and teaching journey | Prof Deborah West ...
Learning analytics and the learning and teaching journey | Prof Deborah West ...Learning analytics and the learning and teaching journey | Prof Deborah West ...
Learning analytics and the learning and teaching journey | Prof Deborah West ...
 
HE Course and Module Evaluation Conference - Shaun mcgall & Marie salter
HE Course and Module Evaluation Conference - Shaun mcgall & Marie salterHE Course and Module Evaluation Conference - Shaun mcgall & Marie salter
HE Course and Module Evaluation Conference - Shaun mcgall & Marie salter
 
SCOF: A Standardised, Customisable Online Feedback Tool
SCOF: A Standardised, Customisable Online Feedback ToolSCOF: A Standardised, Customisable Online Feedback Tool
SCOF: A Standardised, Customisable Online Feedback Tool
 
HE Course and Module Evaluation Conference - Paul bennet
HE Course and Module Evaluation Conference - Paul bennet HE Course and Module Evaluation Conference - Paul bennet
HE Course and Module Evaluation Conference - Paul bennet
 
NISO Apr 29 Virtual Conference: Assessing Game-Based Library Initiatives Kyle...
NISO Apr 29 Virtual Conference: Assessing Game-Based Library Initiatives Kyle...NISO Apr 29 Virtual Conference: Assessing Game-Based Library Initiatives Kyle...
NISO Apr 29 Virtual Conference: Assessing Game-Based Library Initiatives Kyle...
 
Learning Analytics - Sweden
Learning Analytics - SwedenLearning Analytics - Sweden
Learning Analytics - Sweden
 
Iain Mansfield
Iain MansfieldIain Mansfield
Iain Mansfield
 
NISO Apr 29 Virtual Conference: ‘Good Enough’: Applying a Holistic Approach f...
NISO Apr 29 Virtual Conference: ‘Good Enough’: Applying a Holistic Approach f...NISO Apr 29 Virtual Conference: ‘Good Enough’: Applying a Holistic Approach f...
NISO Apr 29 Virtual Conference: ‘Good Enough’: Applying a Holistic Approach f...
 
Analytics in Action - Education
Analytics in Action - EducationAnalytics in Action - Education
Analytics in Action - Education
 
RecSys 2015 posters
RecSys 2015 postersRecSys 2015 posters
RecSys 2015 posters
 

Similar a ABLE - UKAT - Using Learning Analytics to Boost Personal Tutoring

ABLE - Ready for Retention
ABLE - Ready for RetentionABLE - Ready for Retention
ABLE - Ready for RetentionEd Foster
 
ABLE - Inside Government E Foster 26th November 2015
ABLE - Inside Government E Foster 26th November 2015ABLE - Inside Government E Foster 26th November 2015
ABLE - Inside Government E Foster 26th November 2015Ed Foster
 
Able mc neil foster ucisa sero
Able mc neil foster ucisa seroAble mc neil foster ucisa sero
Able mc neil foster ucisa seroEd Foster
 
Future Online Learning Environment Project Update February 2015
Future Online Learning Environment Project Update February 2015Future Online Learning Environment Project Update February 2015
Future Online Learning Environment Project Update February 2015Greg Bowie
 
ABLE - LAK conference 2016
ABLE - LAK conference 2016ABLE - LAK conference 2016
ABLE - LAK conference 2016Ed Foster
 
ABLE - EMFD presentation - NTU student dashboard stream
ABLE - EMFD presentation - NTU student dashboard streamABLE - EMFD presentation - NTU student dashboard stream
ABLE - EMFD presentation - NTU student dashboard streamEd Foster
 
Using learning analytics to improve student transition into and support throu...
Using learning analytics to improve student transition into and support throu...Using learning analytics to improve student transition into and support throu...
Using learning analytics to improve student transition into and support throu...Tinne De Laet
 
Online assessment
Online assessmentOnline assessment
Online assessmentNisha Singh
 
Analysing analytics, what is learning analytics?
Analysing analytics, what is learning analytics?Analysing analytics, what is learning analytics?
Analysing analytics, what is learning analytics?Moodlerooms
 
Using data from educational technologies to improve the student experience of...
Using data from educational technologies to improve the student experience of...Using data from educational technologies to improve the student experience of...
Using data from educational technologies to improve the student experience of...Nina Williams
 
Boosting student success: The role of data analytics
Boosting student success: The role of data analyticsBoosting student success: The role of data analytics
Boosting student success: The role of data analyticsPeter Alston
 
Framing Blended learning, teaching, and education
Framing Blended learning, teaching, and educationFraming Blended learning, teaching, and education
Framing Blended learning, teaching, and educationEADTU
 
Assessing OER impact across varied organisations and learners: experiences fr...
Assessing OER impact across varied organisations and learners: experiences fr...Assessing OER impact across varied organisations and learners: experiences fr...
Assessing OER impact across varied organisations and learners: experiences fr...Beck Pitt
 
Assessing OER impact across varied organisations and learners: experiences fr...
Assessing OER impact across varied organisations and learners: experiences fr...Assessing OER impact across varied organisations and learners: experiences fr...
Assessing OER impact across varied organisations and learners: experiences fr...OER Hub
 
ABLE - NTU Danish visit February 2018
ABLE - NTU Danish visit February 2018ABLE - NTU Danish visit February 2018
ABLE - NTU Danish visit February 2018Ed Foster
 

Similar a ABLE - UKAT - Using Learning Analytics to Boost Personal Tutoring (20)

ABLE - Ready for Retention
ABLE - Ready for RetentionABLE - Ready for Retention
ABLE - Ready for Retention
 
ABLE - Inside Government E Foster 26th November 2015
ABLE - Inside Government E Foster 26th November 2015ABLE - Inside Government E Foster 26th November 2015
ABLE - Inside Government E Foster 26th November 2015
 
Able mc neil foster ucisa sero
Able mc neil foster ucisa seroAble mc neil foster ucisa sero
Able mc neil foster ucisa sero
 
Future Online Learning Environment Project Update February 2015
Future Online Learning Environment Project Update February 2015Future Online Learning Environment Project Update February 2015
Future Online Learning Environment Project Update February 2015
 
ABLE - LAK conference 2016
ABLE - LAK conference 2016ABLE - LAK conference 2016
ABLE - LAK conference 2016
 
ABLE - EMFD presentation - NTU student dashboard stream
ABLE - EMFD presentation - NTU student dashboard streamABLE - EMFD presentation - NTU student dashboard stream
ABLE - EMFD presentation - NTU student dashboard stream
 
Using learning analytics to improve student transition into and support throu...
Using learning analytics to improve student transition into and support throu...Using learning analytics to improve student transition into and support throu...
Using learning analytics to improve student transition into and support throu...
 
Online assessment
Online assessmentOnline assessment
Online assessment
 
Analysing analytics, what is learning analytics?
Analysing analytics, what is learning analytics?Analysing analytics, what is learning analytics?
Analysing analytics, what is learning analytics?
 
Using data from educational technologies to improve the student experience of...
Using data from educational technologies to improve the student experience of...Using data from educational technologies to improve the student experience of...
Using data from educational technologies to improve the student experience of...
 
Boosting student success: The role of data analytics
Boosting student success: The role of data analyticsBoosting student success: The role of data analytics
Boosting student success: The role of data analytics
 
Learning Analytics
Learning AnalyticsLearning Analytics
Learning Analytics
 
ADOVH Validity and Reliability of Online Assessments.pdf
ADOVH Validity and Reliability of Online Assessments.pdfADOVH Validity and Reliability of Online Assessments.pdf
ADOVH Validity and Reliability of Online Assessments.pdf
 
Framing Blended learning, teaching, and education
Framing Blended learning, teaching, and educationFraming Blended learning, teaching, and education
Framing Blended learning, teaching, and education
 
Assessing OER impact across varied organisations and learners: experiences fr...
Assessing OER impact across varied organisations and learners: experiences fr...Assessing OER impact across varied organisations and learners: experiences fr...
Assessing OER impact across varied organisations and learners: experiences fr...
 
Assessing OER impact across varied organisations and learners: experiences fr...
Assessing OER impact across varied organisations and learners: experiences fr...Assessing OER impact across varied organisations and learners: experiences fr...
Assessing OER impact across varied organisations and learners: experiences fr...
 
ABLE - NTU Danish visit February 2018
ABLE - NTU Danish visit February 2018ABLE - NTU Danish visit February 2018
ABLE - NTU Danish visit February 2018
 
Stela project
Stela projectStela project
Stela project
 
Learning Analytics for MOOCs: EMMA case
Learning Analytics for MOOCs: EMMA caseLearning Analytics for MOOCs: EMMA case
Learning Analytics for MOOCs: EMMA case
 
Interview presentation.pptx
Interview presentation.pptxInterview presentation.pptx
Interview presentation.pptx
 

Más de Ed Foster

Able - AUA NTU Learning Analytics External Presentation - Feb 2017
Able - AUA NTU Learning Analytics External Presentation - Feb 2017Able - AUA NTU Learning Analytics External Presentation - Feb 2017
Able - AUA NTU Learning Analytics External Presentation - Feb 2017Ed Foster
 
ABLE - Success for All Poster 2017
ABLE - Success for All Poster 2017ABLE - Success for All Poster 2017
ABLE - Success for All Poster 2017Ed Foster
 
ABLE - TILT conference poster - the NTU Student Dashboard
ABLE - TILT conference poster - the NTU Student DashboardABLE - TILT conference poster - the NTU Student Dashboard
ABLE - TILT conference poster - the NTU Student DashboardEd Foster
 
ABLE - E-Learning Symposium December 2016
ABLE - E-Learning Symposium December 2016ABLE - E-Learning Symposium December 2016
ABLE - E-Learning Symposium December 2016Ed Foster
 
ABLE - NTU Solar Flare presentation 2015
ABLE - NTU Solar Flare presentation 2015ABLE - NTU Solar Flare presentation 2015
ABLE - NTU Solar Flare presentation 2015Ed Foster
 
ABLE - Learning Metrics, Learning Analytics - Plenary Session
ABLE - Learning Metrics, Learning Analytics - Plenary SessionABLE - Learning Metrics, Learning Analytics - Plenary Session
ABLE - Learning Metrics, Learning Analytics - Plenary SessionEd Foster
 
ABLE - LAK 2018
ABLE - LAK 2018ABLE - LAK 2018
ABLE - LAK 2018Ed Foster
 
ABLE - EFYE 2018 induction paper
ABLE - EFYE 2018 induction paperABLE - EFYE 2018 induction paper
ABLE - EFYE 2018 induction paperEd Foster
 
ABLE - EFYE 2016 - The First Year Experience: how up to date are you?
ABLE - EFYE 2016 - The First Year Experience: how up to date are you?ABLE - EFYE 2016 - The First Year Experience: how up to date are you?
ABLE - EFYE 2016 - The First Year Experience: how up to date are you?Ed Foster
 
ABLE - E Foster - Learning Analytics keynote - Dublin December 2016
ABLE - E Foster - Learning Analytics keynote - Dublin December 2016ABLE - E Foster - Learning Analytics keynote - Dublin December 2016
ABLE - E Foster - Learning Analytics keynote - Dublin December 2016Ed Foster
 
ABLE - course leaders conference 2017 - Taking the next steps to support low ...
ABLE - course leaders conference 2017 - Taking the next steps to support low ...ABLE - course leaders conference 2017 - Taking the next steps to support low ...
ABLE - course leaders conference 2017 - Taking the next steps to support low ...Ed Foster
 
Here project toolkit
Here project toolkitHere project toolkit
Here project toolkitEd Foster
 
Here project mindmap
Here project mindmapHere project mindmap
Here project mindmapEd Foster
 
Students in transition
Students in transitionStudents in transition
Students in transitionEd Foster
 
Here poster june 2011
Here poster june 2011Here poster june 2011
Here poster june 2011Ed Foster
 
Here doubters survey 2009
Here doubters survey 2009Here doubters survey 2009
Here doubters survey 2009Ed Foster
 
HERE poster january 2010
HERE poster january 2010HERE poster january 2010
HERE poster january 2010Ed Foster
 
HERE project sept 2011
HERE project sept 2011HERE project sept 2011
HERE project sept 2011Ed Foster
 
HERE Project Final Report Appendices
HERE Project Final Report AppendicesHERE Project Final Report Appendices
HERE Project Final Report AppendicesEd Foster
 

Más de Ed Foster (19)

Able - AUA NTU Learning Analytics External Presentation - Feb 2017
Able - AUA NTU Learning Analytics External Presentation - Feb 2017Able - AUA NTU Learning Analytics External Presentation - Feb 2017
Able - AUA NTU Learning Analytics External Presentation - Feb 2017
 
ABLE - Success for All Poster 2017
ABLE - Success for All Poster 2017ABLE - Success for All Poster 2017
ABLE - Success for All Poster 2017
 
ABLE - TILT conference poster - the NTU Student Dashboard
ABLE - TILT conference poster - the NTU Student DashboardABLE - TILT conference poster - the NTU Student Dashboard
ABLE - TILT conference poster - the NTU Student Dashboard
 
ABLE - E-Learning Symposium December 2016
ABLE - E-Learning Symposium December 2016ABLE - E-Learning Symposium December 2016
ABLE - E-Learning Symposium December 2016
 
ABLE - NTU Solar Flare presentation 2015
ABLE - NTU Solar Flare presentation 2015ABLE - NTU Solar Flare presentation 2015
ABLE - NTU Solar Flare presentation 2015
 
ABLE - Learning Metrics, Learning Analytics - Plenary Session
ABLE - Learning Metrics, Learning Analytics - Plenary SessionABLE - Learning Metrics, Learning Analytics - Plenary Session
ABLE - Learning Metrics, Learning Analytics - Plenary Session
 
ABLE - LAK 2018
ABLE - LAK 2018ABLE - LAK 2018
ABLE - LAK 2018
 
ABLE - EFYE 2018 induction paper
ABLE - EFYE 2018 induction paperABLE - EFYE 2018 induction paper
ABLE - EFYE 2018 induction paper
 
ABLE - EFYE 2016 - The First Year Experience: how up to date are you?
ABLE - EFYE 2016 - The First Year Experience: how up to date are you?ABLE - EFYE 2016 - The First Year Experience: how up to date are you?
ABLE - EFYE 2016 - The First Year Experience: how up to date are you?
 
ABLE - E Foster - Learning Analytics keynote - Dublin December 2016
ABLE - E Foster - Learning Analytics keynote - Dublin December 2016ABLE - E Foster - Learning Analytics keynote - Dublin December 2016
ABLE - E Foster - Learning Analytics keynote - Dublin December 2016
 
ABLE - course leaders conference 2017 - Taking the next steps to support low ...
ABLE - course leaders conference 2017 - Taking the next steps to support low ...ABLE - course leaders conference 2017 - Taking the next steps to support low ...
ABLE - course leaders conference 2017 - Taking the next steps to support low ...
 
Here project toolkit
Here project toolkitHere project toolkit
Here project toolkit
 
Here project mindmap
Here project mindmapHere project mindmap
Here project mindmap
 
Students in transition
Students in transitionStudents in transition
Students in transition
 
Here poster june 2011
Here poster june 2011Here poster june 2011
Here poster june 2011
 
Here doubters survey 2009
Here doubters survey 2009Here doubters survey 2009
Here doubters survey 2009
 
HERE poster january 2010
HERE poster january 2010HERE poster january 2010
HERE poster january 2010
 
HERE project sept 2011
HERE project sept 2011HERE project sept 2011
HERE project sept 2011
 
HERE Project Final Report Appendices
HERE Project Final Report AppendicesHERE Project Final Report Appendices
HERE Project Final Report Appendices
 

Último

Grant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingGrant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingTechSoup
 
fourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writingfourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writingTeacherCyreneCayanan
 
BAG TECHNIQUE Bag technique-a tool making use of public health bag through wh...
BAG TECHNIQUE Bag technique-a tool making use of public health bag through wh...BAG TECHNIQUE Bag technique-a tool making use of public health bag through wh...
BAG TECHNIQUE Bag technique-a tool making use of public health bag through wh...Sapna Thakur
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfciinovamais
 
9548086042 for call girls in Indira Nagar with room service
9548086042  for call girls in Indira Nagar  with room service9548086042  for call girls in Indira Nagar  with room service
9548086042 for call girls in Indira Nagar with room servicediscovermytutordmt
 
Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..Disha Kariya
 
A Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy ReformA Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy ReformChameera Dedduwage
 
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in DelhiRussian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhikauryashika82
 
Unit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxUnit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxVishalSingh1417
 
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...fonyou31
 
Arihant handbook biology for class 11 .pdf
Arihant handbook biology for class 11 .pdfArihant handbook biology for class 11 .pdf
Arihant handbook biology for class 11 .pdfchloefrazer622
 
Sanyam Choudhary Chemistry practical.pdf
Sanyam Choudhary Chemistry practical.pdfSanyam Choudhary Chemistry practical.pdf
Sanyam Choudhary Chemistry practical.pdfsanyamsingh5019
 
Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)eniolaolutunde
 
1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdfQucHHunhnh
 
Disha NEET Physics Guide for classes 11 and 12.pdf
Disha NEET Physics Guide for classes 11 and 12.pdfDisha NEET Physics Guide for classes 11 and 12.pdf
Disha NEET Physics Guide for classes 11 and 12.pdfchloefrazer622
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxheathfieldcps1
 

Último (20)

Grant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingGrant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy Consulting
 
fourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writingfourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writing
 
Mattingly "AI & Prompt Design: The Basics of Prompt Design"
Mattingly "AI & Prompt Design: The Basics of Prompt Design"Mattingly "AI & Prompt Design: The Basics of Prompt Design"
Mattingly "AI & Prompt Design: The Basics of Prompt Design"
 
BAG TECHNIQUE Bag technique-a tool making use of public health bag through wh...
BAG TECHNIQUE Bag technique-a tool making use of public health bag through wh...BAG TECHNIQUE Bag technique-a tool making use of public health bag through wh...
BAG TECHNIQUE Bag technique-a tool making use of public health bag through wh...
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
 
Advance Mobile Application Development class 07
Advance Mobile Application Development class 07Advance Mobile Application Development class 07
Advance Mobile Application Development class 07
 
Código Creativo y Arte de Software | Unidad 1
Código Creativo y Arte de Software | Unidad 1Código Creativo y Arte de Software | Unidad 1
Código Creativo y Arte de Software | Unidad 1
 
9548086042 for call girls in Indira Nagar with room service
9548086042  for call girls in Indira Nagar  with room service9548086042  for call girls in Indira Nagar  with room service
9548086042 for call girls in Indira Nagar with room service
 
Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..
 
A Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy ReformA Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy Reform
 
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in DelhiRussian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
 
Unit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxUnit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptx
 
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
 
Arihant handbook biology for class 11 .pdf
Arihant handbook biology for class 11 .pdfArihant handbook biology for class 11 .pdf
Arihant handbook biology for class 11 .pdf
 
Sanyam Choudhary Chemistry practical.pdf
Sanyam Choudhary Chemistry practical.pdfSanyam Choudhary Chemistry practical.pdf
Sanyam Choudhary Chemistry practical.pdf
 
Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)
 
1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdf
 
Disha NEET Physics Guide for classes 11 and 12.pdf
Disha NEET Physics Guide for classes 11 and 12.pdfDisha NEET Physics Guide for classes 11 and 12.pdf
Disha NEET Physics Guide for classes 11 and 12.pdf
 
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptxINDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptx
 

ABLE - UKAT - Using Learning Analytics to Boost Personal Tutoring

  • 1. Using learning analytics to boost personal tutoring ABLE Project 2015-1-BE-EPPKA3-PI-FORWARD STELA Project: 562167-EPP-1-2015-1-BE-EPPKA3-PI-FORWARD
  • 2. Session aims • Introduce learning analytics • Describe the development of the NTU Student Dashboard • Discuss potential benefits of learning analytics for personal tutors • Raise some challenges of converting student information to actionable intelligence
  • 4. "Analytics is a term used in business and science to refer to computational support for capturing digital data to help inform decision-making … Learning Analytics appropriates this concept for education.” (Buckingham Shum, 2012, p.1) (Clow, 2012) Learning Analytics
  • 5. Why NTU is interested in learning analytics? • Reduce barriers to being known by a tutor • Space for tutors to make notes & plan • Students as agents • Can see own grades, and compare self to peers • Feedback • Tool for academic use • Potentially promotes virtuous behaviour • Alerts tutors if students are high risk for leaving early • Students can compare their engagement with their peers Attainment Progression Belonging Strategic information • Insights into groups at risk • Potentially design and delivery of courses
  • 6. Development of the NTU Student Dashboard
  • 7. Developmental Cycle Sept 2013 Sept 2014 Sept 2015 Pilot Phase Phase One Phase Two Phase Three  Personalisation  Embedding into University systems  4 courses  40 staff  500 1st years Willing participants: very positive staff feedback, limited student awareness  8 of 9 Schools  Governance  Problem solving  Ethics Near to whole University roll out: increased awareness  All Schools  New data sources  Assessment view Whole University roll out: increased awareness Feb 2016 Increasing resources (e.g. how to guides), communication, guidance Staff and student consultation ongoing throughout developments Further details of projects at http://www.ableproject.eu/project-outputs/ and https://eng.kuleuven.be/english/projects/STELAproject/stela
  • 8. The NTU Student Dashboard • Can be viewed as two products: Physical Dashboard Algorithm • Staff and students interact with physical dashboard • Algorithm is the behind the scenes, learning analytics element
  • 9. Raises alerts!! What does the Dashboard do? NTU Student Dashboard Student biographical info, e.g. enrolment status Evidence of student engagement • Door swipes (where appropriate) • Library books • NOW use • Dropbox submissions • Attendance data • Access to e- books and journals through Shibboleth authentication Staff view Student view Compares student engagement across the cohort & gives rating Can make comments in free text box
  • 10. Potential benefits of learning analytics for personal tutors
  • 11. Data accuracy for algorithm spotting students at risk • Two big questions: 1. Can the algorithm correctly identify at risk students? 2. Can it do so on a timescale that allows intervention?
  • 12. Relationship between yearly average engagement & progression • Low average (mode) engagement for the year is an indicator of risk
  • 13. Relationship between term one average engagement & progression • Low average (mode) engagement for the 1st term is an indicator of risk
  • 14. No engagement alerts • Any one alert is an indicator of risk • Students with multiple alerts had lower incidence of progression
  • 15. Tutorial Landing Screen • Access to tutees in addition to search facilities for other students the staff member interacts with
  • 16. Links to student’s dashboard Able to sort on headings Class view • Designed so staff have easy access to student data. • Allows staff to quickly identify potentially at risk students
  • 17. Individual student view Not Fully Enrolled Staff and students can benchmark engagement – springboard for conversation
  • 18. Notes and referrals • Notes inputted by staff only • Time and date stamp • Referral to:  Library Academic Skills  Student Support Services  Employability (planned) Personal tutors can track interactions with students Personal tutors can make referral whilst in room with student
  • 19. Student profile • Basic information (ability to report if this is wrong) • Engagement summary • Entry qualification details • Engagement history (for previous years) • Details to help early tutorials
  • 20. • Data drawn automatically from the attendance app • The wheel shows overall attendance • The table below provides more detailed information for recent weeks Attendance • Springboard for conversation (potential context of School attendance policy)
  • 21. Assessment & Feedback View • Only show assessments and feedback submitted through NOW (the University’s VLE) • Shows assessments and feedback for multiple modules • Better sight of student performance than only seeing own module results so tutor can make more informed recommendations
  • 22. Challenges of converting student information to actionable intelligence
  • 23. How are we using the Dashboard to address disparities in attainment? • Two change agents • Developing learning analytics is challenging • Institutional change based on learning analytics may be a different order of magnitude – We already have data on students at risk, attendance, non-submission of coursework – Yet it is often extremely difficult to change student outcomes Students Staff
  • 24. Staff as Change Agents • Personal tutor – Induction activity – Primary contact for alerts – Ongoing support – iPad trial • Referrals to support services – Notes and referrals function • Staff communication – Briefings and drop-in sessions – Newsletter term 1 – low engagement – Newsletter term 2 – alerts
  • 25. Students as change agents • Dashboard as resource to inform students about their engagement • Dashboard focuses positively on engagement rather than risk • Challenges around Success for All • Focus on communication and development of tool in-line with student views
  • 26. Feedback from the Student Transition Survey • The transition survey was conducted with first year students (Feb/March 2016) • 91% reported using the Dashboard at least once (90% in 2015) Have you logged into the NTU student Dashboard? When using the Dashboard, how often have you explored the following? Base: 515 (2016), 469 (2015) 4% 5% 14% 15% 13% 24% 5% 6% 26% 24% 35% 36% 12% 13% 33% 34% 34% 36% 79% 77% 28% 28% 19% 5% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Spoke to someone providing specialist help (for example student support services/ library) as a result of looking at information on the Dashboard Spoke to your tutor as a result of looking at information on the Dashboard Changed your behaviour to raise or maintain your engagement score (for example made sure that you swiped to go into a building) Compared your engagement score with other students on your course Increased the amount of time you spend studying Checked your own engagement score Very Often Often Sometimes Never
  • 27. Relationship between number of Dashboard log-ins and engagement classification
  • 28. Thank you for listening. Any questions?