SlideShare una empresa de Scribd logo
1 de 37
Alex Thorp
Academic Support Specialist
Trinity College London
AULC Conference – Cardiff 7th – 8th January 2016
Accountability and Assessment -
What can tests tell you?
Alex Thorp AULC 7th – 8th January 2016
Overview
• How accountable are we?
• What do students need for success?
• Feedback and research – pre-sessional
• Trinity – a response to contemporary
assessment
• Q&A
Alex Thorp AULC 7th – 8th January 2016
4
Accountability and Assessment
As a University Language Department / University, in what
ways are you accountable for your students’ achievement?
5
Accountability and Assessment
What are we accountable for?
• Poor achievement levels
• Dropouts
• Failing the course / year
• High levels of absenteeism
• Student stress levels / anxiety
• The ‘International Student Experience’
• Student identity
•
•
Do these issues stem from language skills or something more?
Dissatisfied fee-paying
students have avenues for
recourse:
• Legal action
• Igrad (feedback)
• Reputation
• PR
• Social media
• International agreements
Language
Skills
Transferable
Skills
Study
Strategies
6
What do students need to succeed?
Academically, socially, culturally…
Language
Skills
Transferable
Skills
Study
Strategies
7
What do students need to succeed?
Language Skills
8
What do students need to succeed?
Language Skills
Bachman & Palmer (2010): communicative competence model
Communicative
Competence
Linguistic
competence
Socio-linguistic
competence
Discourse
competence
Strategic
competence
Language
Skills
Transferable
Skills
Study
Strategies
What do students need to succeed?
Transferable Skills
10
What do students need to succeed?
Transferable Skills
1. Critical thinking & problem solving
2. Collaboration and leading by influence
3. Agility and adaptability
4. Initiative and entrepreneurship
5. Effective oral and written communication
6. Accessing and analyzing information
7. Curiosity and imagination
Tony Wagner - Expert In Residence - Innovation Lab of Harvard
11
Language
Skills
Transferable
Skills
Study
Strategies
What do students need to succeed?
Study Strategies
12
• Note taking
• Summarising
• Synthesising
• Sourcing relevant data across texts
• Planning
• Self-checking and self-evaluation
• Deducing and inferring
•
What do students need to succeed?
Study Strategies
2500+ published
academic papers
Language
Skills
Transferable
Skills
Study
Strategies
13
What do students need to succeed?
Academically, socially, culturally…
14
Pre-sessional Trainers - Feedback
Sample interviews with Pre-sessional trainers
• Accuracy – 4 skills competences
• Academic writing - discourse
• Language for seminars and
presentations
• Ability to discuss / communicate
• Academic vocabulary
Language
Skills
(what is needed to
succeed)
15
Pre-sessional Trainers - Feedback
Sample interviews with Pre-sessional trainers
• Socialisation skills
• Self motivation
• Leadership
• Critical thinking
• Debating
• Creative thinking
Transferable
Skills
(what is needed to
succeed)
16
Pre-sessional Trainers - Feedback
Sample interviews with Pre-sessional trainers
• Note-taking
• Listening and note-taking
• Self correction and reflection
• Deduce meaning of unknown item
• Speed reading – selection
• Research skills
• Planning
Study
strategies
(what is needed to
succeed)
17
Pre-sessional Trainers - Feedback
Sample interviews with Pre-sessional trainers
Ring any bells….?
Pre-sessional Trainers - Feedback
Sample interviews with Pre-sessional trainers
What negative
expectations (skills?)
do new students
bring?
Over-reliance on
dictionaries and
mobile media
M.O. University of the Arts London
Wanting to
translate every
word
(productive and
receptive).
J.B. University of Bristol Not willing to
participate in
pair work /
communication
S.H. University of Sussex
Want to be
spoon-fed /
expectation of
teacher-centred
input
S.I. University of
Birmingham
Memorisation /
working from
scripts
J.P-S. University of Edinburgh
19
What should a test tell you?
In an ideal world….
Language
Skills
Transferable
Skills
Study
Strategies
Trinity ISE – revised 2015
An Integrated Skills exam
Trinity ISE – revised 2015
An Integrated Skills exam
The ISE formatISE Foundation ISE I ISE II ISE III
CEFR level A2 B1 B2 C1
Topic task 4 minutes 4 minutes 4 minutes 8 minutes
Collaborative task - - 4 minutes 4 minutes
Conversation task 2 minutes 2 minutes 2 minutes 3 minutes
Independent
listening task
6 minutes 7 minutes 8 minutes 8 minutes
Trinity ISE?
Overview – Speaking & Listening
Is this anything new?
23
When do you speak without listening?
When do you write without reading?
Communicative competence requires assessment
that tests skill integration.
Trinity ISE?
An integrated approach
MACRO - Receptive
Listening Objectively
tested
MACRO - Receptive
Reading Objectively
tested
MACRO - Receptive
Speaking Subjectively
tested
MACRO - Receptive
Writing Subjectively
tested
Interactive Listening
(Subjectively tested)
Reading into Writing
(Subjectively tested)
What do students need to succeed?
Language Skills
25
Topic task
Collaborative task (at higher grades)
Conversation
The test
taker
prepares
ANY topic of
their choice
for
discussion
with the
examiner
The examiner
selects topic
from a list
relevant to the
level and asks
the test taker
questions to
start a
conversation
The examiner
reads a prompt
which creates
an information
gap.
This sets the
scene for a
test-taker led
discussion
NEW rating
scale
&
Assessment
of
Interactive
listening
Trinity ISE?
Overview – Speaking & Listening
26
What do students need to succeed?
Transferable Skills
planning/organisation
practising English presentation skills
creativity
self-evaluation
self-management
critical thinking
problem-solving
Preparing for
Trinity ISE:
impact
The ISE formatISE Foundation ISE I ISE II ISE III
CEFR level A2 B1 B2 C1
Time 2 hours
Task 1 Long reading
300 words
15 questions
Long reading
400 words
15 questions
Long reading
500 words
15 questions
Long reading
700 words
15 questions
Task 2 Multi-text reading
3 texts
300 words
15 questions
Multi-text reading
4 texts
400 words
15 questions
Multi-text reading
4 texts
500 words
15 questions
Multi-text reading
4 texts
700 words
15 questions
Task 3 Reading into writing
70-100 words
Reading into writing
100-130 words
Reading into writing
150-180 words
Reading into writing
200-230 words
Task 4 Extended writing
70-100 words
Extended writing
100-130 words
Extended writing
150-180 words
Extended writing
200-230 words
Trinity ISE?
Overview – Reading and Writing
Q6-10 Selecting
true statements
Understand specific
information at
sentence level
Multiple genres:
Factual texts familiar in an educational or everyday context
Q1-5 Multiple
matching
Understand the main
idea and purpose of
each text
Graphic Organiser
representing
complex information
Contemporary digital
reading strategies
ISE Reading & Writing
Example – Task 2, Multi-text reading
ISE Reading & Writing
Example – Task 2, Multi-text reading
Q11-15 Completing
summary notes
Understand factual
information at word or
phrase level across texts.
Use the information in a
simple summary
ISE Reading & Writing
Example – Task 3, Reading into Writing
• Use same texts from
the reading task
• Refer back to the
summary notes as a
spring board for
planning
• Identify relevant
information from all
texts
• Paraphrase and
summarise key
words, phrases,
sentences
• Incorporate the
information in a
response to a prompt
Language
Skills
Transferable
Skills
Study
Strategies
31
What do students need to succeed?
Academically, socially, culturally…
32
Trinity ISE and the CEFR
Implications for standardisation and predictive validity.
Trinity ISE mapped from the CEFR
… not mapped to the CEFR
Accountability and Assessment
Summary
We are accountable for our
students’ achievement
Need to know what
applicant students
can do
Need to know what to
teach pre-sessional
students (and how)
Language Skills Study Strategies Transferable Skills
To what degree do the tests you use equip you to do this?
Accountability and Assessment
Summary
Trinity Integrated Skills in English Exam (ISE)
Pre-
admission
Predictive
Validity
Relevant
Skills
Part of
Pre-sessional
study
Positive
Washback
Relevant
skills
Any Questions?
Accountability and Assessment
Q & A
36
Factsheet leaflets for
teachers & students
Brochure for
colleges and
universities
ISE Guides for teachers*
Introductory overview &
sample exam videos
Online guidance &
ISE Best practise
guide for administrators
Sample papers and
classroom activities
including Portfolio toolkit
ISE Guides for students
Resources
Available online at www.trinitycollege.com
Alex Thorp
Academic Support Specialist
Trinity College London
AULC Conference – Cardiff 7th – 8th January 2016
Thank you.
alex.thorp@trinitycollege.com

Más contenido relacionado

La actualidad más candente

Paper Presented at Tehran University
Paper Presented at Tehran UniversityPaper Presented at Tehran University
Paper Presented at Tehran Universityfatemehphd
 
Nectfl 2016
Nectfl 2016Nectfl 2016
Nectfl 2016hhs
 
Writing Goals for English Learners
Writing Goals for English LearnersWriting Goals for English Learners
Writing Goals for English LearnersEllevation Education
 
Recalibrating language assessment in the new normal
Recalibrating language assessment in the new normalRecalibrating language assessment in the new normal
Recalibrating language assessment in the new normalRachel Luna Peralta
 
M. Bacon, D.K. Hakam, M. Patterson: Continuous Innovation: Making K–12 Mandar...
M. Bacon, D.K. Hakam, M. Patterson: Continuous Innovation: Making K–12 Mandar...M. Bacon, D.K. Hakam, M. Patterson: Continuous Innovation: Making K–12 Mandar...
M. Bacon, D.K. Hakam, M. Patterson: Continuous Innovation: Making K–12 Mandar...Center for Global Education at Asia Society
 
Rubric presentation
Rubric presentationRubric presentation
Rubric presentationPato_Ch
 
EdTPA Online Module 2. Orientation to the Handbook and Rubrics
EdTPA Online Module 2. Orientation to the Handbook and RubricsEdTPA Online Module 2. Orientation to the Handbook and Rubrics
EdTPA Online Module 2. Orientation to the Handbook and Rubricslhbaecher
 
Oral Presentation Tasks: Making use of the Trojan horse
Oral Presentation Tasks: Making use of the Trojan horseOral Presentation Tasks: Making use of the Trojan horse
Oral Presentation Tasks: Making use of the Trojan horsePeter Levrai
 
Elementary education task 1 2
Elementary education task 1 2Elementary education task 1 2
Elementary education task 1 2Amy Lachuk
 
Wrigley_Workforce ESL for LESLLA
Wrigley_Workforce ESL for LESLLAWrigley_Workforce ESL for LESLLA
Wrigley_Workforce ESL for LESLLAPatsy Vinogradov
 
Mixed Panel Oral Presentation Assessment: Preparing Electrical & Electronic E...
Mixed Panel Oral Presentation Assessment: Preparing Electrical & Electronic E...Mixed Panel Oral Presentation Assessment: Preparing Electrical & Electronic E...
Mixed Panel Oral Presentation Assessment: Preparing Electrical & Electronic E...Peter Levrai
 

La actualidad más candente (20)

Paper Presented at Tehran University
Paper Presented at Tehran UniversityPaper Presented at Tehran University
Paper Presented at Tehran University
 
Nectfl 2016
Nectfl 2016Nectfl 2016
Nectfl 2016
 
Material design
Material designMaterial design
Material design
 
Writing Goals for English Learners
Writing Goals for English LearnersWriting Goals for English Learners
Writing Goals for English Learners
 
Recalibrating language assessment in the new normal
Recalibrating language assessment in the new normalRecalibrating language assessment in the new normal
Recalibrating language assessment in the new normal
 
M. Bacon, D.K. Hakam, M. Patterson: Continuous Innovation: Making K–12 Mandar...
M. Bacon, D.K. Hakam, M. Patterson: Continuous Innovation: Making K–12 Mandar...M. Bacon, D.K. Hakam, M. Patterson: Continuous Innovation: Making K–12 Mandar...
M. Bacon, D.K. Hakam, M. Patterson: Continuous Innovation: Making K–12 Mandar...
 
ESP Materiasl Evaluation
ESP Materiasl EvaluationESP Materiasl Evaluation
ESP Materiasl Evaluation
 
Rubric presentation
Rubric presentationRubric presentation
Rubric presentation
 
TKT exam presentation Olga Connolly BKC-IH Moscow
TKT exam presentation Olga Connolly BKC-IH MoscowTKT exam presentation Olga Connolly BKC-IH Moscow
TKT exam presentation Olga Connolly BKC-IH Moscow
 
Formative_assessment_and_ELs
Formative_assessment_and_ELsFormative_assessment_and_ELs
Formative_assessment_and_ELs
 
Lecture 6
Lecture 6Lecture 6
Lecture 6
 
Lg 546 week 4 esp & eap
Lg 546 week 4 esp & eapLg 546 week 4 esp & eap
Lg 546 week 4 esp & eap
 
Bc phase one_session2
Bc phase one_session2Bc phase one_session2
Bc phase one_session2
 
EdTPA Online Module 2. Orientation to the Handbook and Rubrics
EdTPA Online Module 2. Orientation to the Handbook and RubricsEdTPA Online Module 2. Orientation to the Handbook and Rubrics
EdTPA Online Module 2. Orientation to the Handbook and Rubrics
 
Oral Presentation Tasks: Making use of the Trojan horse
Oral Presentation Tasks: Making use of the Trojan horseOral Presentation Tasks: Making use of the Trojan horse
Oral Presentation Tasks: Making use of the Trojan horse
 
El instruction clil
El instruction clilEl instruction clil
El instruction clil
 
Elementary education task 1 2
Elementary education task 1 2Elementary education task 1 2
Elementary education task 1 2
 
Wrigley_Workforce ESL for LESLLA
Wrigley_Workforce ESL for LESLLAWrigley_Workforce ESL for LESLLA
Wrigley_Workforce ESL for LESLLA
 
Approaches to course design
Approaches to course designApproaches to course design
Approaches to course design
 
Mixed Panel Oral Presentation Assessment: Preparing Electrical & Electronic E...
Mixed Panel Oral Presentation Assessment: Preparing Electrical & Electronic E...Mixed Panel Oral Presentation Assessment: Preparing Electrical & Electronic E...
Mixed Panel Oral Presentation Assessment: Preparing Electrical & Electronic E...
 

Similar a Accountability and Assessment - What can Tests tell you? by Alex Thorp

Alex Thorp - Tensions in teaching - reconciling teaching and testing
Alex Thorp - Tensions in teaching - reconciling teaching and testing Alex Thorp - Tensions in teaching - reconciling teaching and testing
Alex Thorp - Tensions in teaching - reconciling teaching and testing eaquals
 
Rica lk 11.2015
Rica lk 11.2015Rica lk 11.2015
Rica lk 11.2015lkeisler
 
Rica lk 11.2015students
Rica lk 11.2015studentsRica lk 11.2015students
Rica lk 11.2015studentslkeisler
 
Week 3 class 2 assess 2 - ruth
 Week 3    class 2 assess 2 - ruth Week 3    class 2 assess 2 - ruth
Week 3 class 2 assess 2 - ruthrmcquirter
 
Teacher Participant Created Presentation.Supporting Academic Language (AVID)....
Teacher Participant Created Presentation.Supporting Academic Language (AVID)....Teacher Participant Created Presentation.Supporting Academic Language (AVID)....
Teacher Participant Created Presentation.Supporting Academic Language (AVID)....Rachel Amescua
 
Rica prep presentationCSULB10.25.14
Rica prep presentationCSULB10.25.14Rica prep presentationCSULB10.25.14
Rica prep presentationCSULB10.25.14ebowers44
 
Academic fastrack...
Academic fastrack...Academic fastrack...
Academic fastrack...Iffat Subhani
 
Assessment in Moroccan high school
Assessment in Moroccan high schoolAssessment in Moroccan high school
Assessment in Moroccan high schoolLAHOUCINE JAAFARI
 
Using data to drive guided reading instruction @ CKEC 2015
Using data to drive guided reading instruction @ CKEC 2015Using data to drive guided reading instruction @ CKEC 2015
Using data to drive guided reading instruction @ CKEC 2015Lisa Shaw
 
Assessment in Writing.pptx
Assessment in Writing.pptxAssessment in Writing.pptx
Assessment in Writing.pptxRifkaFaidah
 
Sheltered Instruction: Intro to EDU 380
Sheltered Instruction: Intro to EDU 380Sheltered Instruction: Intro to EDU 380
Sheltered Instruction: Intro to EDU 380Jayme Linton
 
Class 5 assessment ii
Class 5   assessment iiClass 5   assessment ii
Class 5 assessment iirmcquirter
 
Rica prep presentation lk.5.15
Rica prep presentation lk.5.15Rica prep presentation lk.5.15
Rica prep presentation lk.5.15Laura Keisler
 
Ell part 2 module 2of4 assignment mccarthy
Ell part 2   module 2of4 assignment mccarthyEll part 2   module 2of4 assignment mccarthy
Ell part 2 module 2of4 assignment mccarthyRyanMcCarthy98
 

Similar a Accountability and Assessment - What can Tests tell you? by Alex Thorp (20)

Alex Thorp - Tensions in teaching - reconciling teaching and testing
Alex Thorp - Tensions in teaching - reconciling teaching and testing Alex Thorp - Tensions in teaching - reconciling teaching and testing
Alex Thorp - Tensions in teaching - reconciling teaching and testing
 
Caryl miller1
Caryl miller1Caryl miller1
Caryl miller1
 
Shuhrat.pptx
Shuhrat.pptxShuhrat.pptx
Shuhrat.pptx
 
Rica lk 11.2015
Rica lk 11.2015Rica lk 11.2015
Rica lk 11.2015
 
Rica lk 11.2015students
Rica lk 11.2015studentsRica lk 11.2015students
Rica lk 11.2015students
 
Week 3 class 2 assess 2 - ruth
 Week 3    class 2 assess 2 - ruth Week 3    class 2 assess 2 - ruth
Week 3 class 2 assess 2 - ruth
 
Teacher Participant Created Presentation.Supporting Academic Language (AVID)....
Teacher Participant Created Presentation.Supporting Academic Language (AVID)....Teacher Participant Created Presentation.Supporting Academic Language (AVID)....
Teacher Participant Created Presentation.Supporting Academic Language (AVID)....
 
Rica prep presentationCSULB10.25.14
Rica prep presentationCSULB10.25.14Rica prep presentationCSULB10.25.14
Rica prep presentationCSULB10.25.14
 
2014_Ramirez_5ConnectionsRW.pptx
2014_Ramirez_5ConnectionsRW.pptx2014_Ramirez_5ConnectionsRW.pptx
2014_Ramirez_5ConnectionsRW.pptx
 
Fri in mcsd
Fri in mcsdFri in mcsd
Fri in mcsd
 
Academic fastrack...
Academic fastrack...Academic fastrack...
Academic fastrack...
 
Assessment in Moroccan high school
Assessment in Moroccan high schoolAssessment in Moroccan high school
Assessment in Moroccan high school
 
Using data to drive guided reading instruction @ CKEC 2015
Using data to drive guided reading instruction @ CKEC 2015Using data to drive guided reading instruction @ CKEC 2015
Using data to drive guided reading instruction @ CKEC 2015
 
Assessment in Writing.pptx
Assessment in Writing.pptxAssessment in Writing.pptx
Assessment in Writing.pptx
 
The Learning Hub at Teesside University: an innovative approach to supporting...
The Learning Hub at Teesside University: an innovative approach to supporting...The Learning Hub at Teesside University: an innovative approach to supporting...
The Learning Hub at Teesside University: an innovative approach to supporting...
 
Bc phase one_session2
Bc phase one_session2Bc phase one_session2
Bc phase one_session2
 
Sheltered Instruction: Intro to EDU 380
Sheltered Instruction: Intro to EDU 380Sheltered Instruction: Intro to EDU 380
Sheltered Instruction: Intro to EDU 380
 
Class 5 assessment ii
Class 5   assessment iiClass 5   assessment ii
Class 5 assessment ii
 
Rica prep presentation lk.5.15
Rica prep presentation lk.5.15Rica prep presentation lk.5.15
Rica prep presentation lk.5.15
 
Ell part 2 module 2of4 assignment mccarthy
Ell part 2   module 2of4 assignment mccarthyEll part 2   module 2of4 assignment mccarthy
Ell part 2 module 2of4 assignment mccarthy
 

Más de mlang-events

Use of Tablets/Smart Phones to Support Accessibility by Antonio Barriga Rubio
Use of Tablets/Smart Phones to Support Accessibility by Antonio Barriga RubioUse of Tablets/Smart Phones to Support Accessibility by Antonio Barriga Rubio
Use of Tablets/Smart Phones to Support Accessibility by Antonio Barriga Rubiomlang-events
 
Beyond Accepted Standards: Past, Present and Future of the German UniCert Lan...
Beyond Accepted Standards: Past, Present and Future of the German UniCert Lan...Beyond Accepted Standards: Past, Present and Future of the German UniCert Lan...
Beyond Accepted Standards: Past, Present and Future of the German UniCert Lan...mlang-events
 
European Benchmarks for the Chinese Languages - the Application of CEFR to th...
European Benchmarks for the Chinese Languages - the Application of CEFR to th...European Benchmarks for the Chinese Languages - the Application of CEFR to th...
European Benchmarks for the Chinese Languages - the Application of CEFR to th...mlang-events
 
Welsh Language Policy and Multicultural Wales by Professor Diarmait Mac Gioll...
Welsh Language Policy and Multicultural Wales by Professor Diarmait Mac Gioll...Welsh Language Policy and Multicultural Wales by Professor Diarmait Mac Gioll...
Welsh Language Policy and Multicultural Wales by Professor Diarmait Mac Gioll...mlang-events
 
The UK Strategy for Outward Mobility and the Go International Programme: Incr...
The UK Strategy for Outward Mobility and the Go International Programme: Incr...The UK Strategy for Outward Mobility and the Go International Programme: Incr...
The UK Strategy for Outward Mobility and the Go International Programme: Incr...mlang-events
 
Developing Digital Literacies Through Observation and Reflection by Ulrike Ba...
Developing Digital Literacies Through Observation and Reflection by Ulrike Ba...Developing Digital Literacies Through Observation and Reflection by Ulrike Ba...
Developing Digital Literacies Through Observation and Reflection by Ulrike Ba...mlang-events
 
Opportunities and Challenges in the Multilingual and Multicultural Learning S...
Opportunities and Challenges in the Multilingual and Multicultural Learning S...Opportunities and Challenges in the Multilingual and Multicultural Learning S...
Opportunities and Challenges in the Multilingual and Multicultural Learning S...mlang-events
 
CEFR-Related Tests in Irish: Punching about their Weight by Anne Gallagher
CEFR-Related Tests in Irish: Punching about their Weight by Anne GallagherCEFR-Related Tests in Irish: Punching about their Weight by Anne Gallagher
CEFR-Related Tests in Irish: Punching about their Weight by Anne Gallaghermlang-events
 
CercleS Focus Group on Management and Leadership: Preliminary findings of a 2...
CercleS Focus Group on Management and Leadership: Preliminary findings of a 2...CercleS Focus Group on Management and Leadership: Preliminary findings of a 2...
CercleS Focus Group on Management and Leadership: Preliminary findings of a 2...mlang-events
 
Exploring Ways on e-Marketing and e-Feedback by Dr Catherine Xiang & Ms Lourd...
Exploring Ways on e-Marketing and e-Feedback by Dr Catherine Xiang & Ms Lourd...Exploring Ways on e-Marketing and e-Feedback by Dr Catherine Xiang & Ms Lourd...
Exploring Ways on e-Marketing and e-Feedback by Dr Catherine Xiang & Ms Lourd...mlang-events
 
Multiculturalism & LfA: Addressing the Challenges by LeeAnn Stone Ed.D.
Multiculturalism & LfA: Addressing the Challenges by LeeAnn Stone Ed.D.Multiculturalism & LfA: Addressing the Challenges by LeeAnn Stone Ed.D.
Multiculturalism & LfA: Addressing the Challenges by LeeAnn Stone Ed.D.mlang-events
 
Supporting Quality Teaching: a Profile of IWLP Teachers and the Role of Langu...
Supporting Quality Teaching: a Profile of IWLP Teachers and the Role of Langu...Supporting Quality Teaching: a Profile of IWLP Teachers and the Role of Langu...
Supporting Quality Teaching: a Profile of IWLP Teachers and the Role of Langu...mlang-events
 
Accessibility of Professional Development by Language Practioners Investigati...
Accessibility of Professional Development by Language Practioners Investigati...Accessibility of Professional Development by Language Practioners Investigati...
Accessibility of Professional Development by Language Practioners Investigati...mlang-events
 
The Common European Framework of Reference for Arabic Language Teaching & Lea...
The Common European Framework of Reference for Arabic Language Teaching & Lea...The Common European Framework of Reference for Arabic Language Teaching & Lea...
The Common European Framework of Reference for Arabic Language Teaching & Lea...mlang-events
 
Global Futures by John Pugsley
Global Futures by John PugsleyGlobal Futures by John Pugsley
Global Futures by John Pugsleymlang-events
 

Más de mlang-events (15)

Use of Tablets/Smart Phones to Support Accessibility by Antonio Barriga Rubio
Use of Tablets/Smart Phones to Support Accessibility by Antonio Barriga RubioUse of Tablets/Smart Phones to Support Accessibility by Antonio Barriga Rubio
Use of Tablets/Smart Phones to Support Accessibility by Antonio Barriga Rubio
 
Beyond Accepted Standards: Past, Present and Future of the German UniCert Lan...
Beyond Accepted Standards: Past, Present and Future of the German UniCert Lan...Beyond Accepted Standards: Past, Present and Future of the German UniCert Lan...
Beyond Accepted Standards: Past, Present and Future of the German UniCert Lan...
 
European Benchmarks for the Chinese Languages - the Application of CEFR to th...
European Benchmarks for the Chinese Languages - the Application of CEFR to th...European Benchmarks for the Chinese Languages - the Application of CEFR to th...
European Benchmarks for the Chinese Languages - the Application of CEFR to th...
 
Welsh Language Policy and Multicultural Wales by Professor Diarmait Mac Gioll...
Welsh Language Policy and Multicultural Wales by Professor Diarmait Mac Gioll...Welsh Language Policy and Multicultural Wales by Professor Diarmait Mac Gioll...
Welsh Language Policy and Multicultural Wales by Professor Diarmait Mac Gioll...
 
The UK Strategy for Outward Mobility and the Go International Programme: Incr...
The UK Strategy for Outward Mobility and the Go International Programme: Incr...The UK Strategy for Outward Mobility and the Go International Programme: Incr...
The UK Strategy for Outward Mobility and the Go International Programme: Incr...
 
Developing Digital Literacies Through Observation and Reflection by Ulrike Ba...
Developing Digital Literacies Through Observation and Reflection by Ulrike Ba...Developing Digital Literacies Through Observation and Reflection by Ulrike Ba...
Developing Digital Literacies Through Observation and Reflection by Ulrike Ba...
 
Opportunities and Challenges in the Multilingual and Multicultural Learning S...
Opportunities and Challenges in the Multilingual and Multicultural Learning S...Opportunities and Challenges in the Multilingual and Multicultural Learning S...
Opportunities and Challenges in the Multilingual and Multicultural Learning S...
 
CEFR-Related Tests in Irish: Punching about their Weight by Anne Gallagher
CEFR-Related Tests in Irish: Punching about their Weight by Anne GallagherCEFR-Related Tests in Irish: Punching about their Weight by Anne Gallagher
CEFR-Related Tests in Irish: Punching about their Weight by Anne Gallagher
 
CercleS Focus Group on Management and Leadership: Preliminary findings of a 2...
CercleS Focus Group on Management and Leadership: Preliminary findings of a 2...CercleS Focus Group on Management and Leadership: Preliminary findings of a 2...
CercleS Focus Group on Management and Leadership: Preliminary findings of a 2...
 
Exploring Ways on e-Marketing and e-Feedback by Dr Catherine Xiang & Ms Lourd...
Exploring Ways on e-Marketing and e-Feedback by Dr Catherine Xiang & Ms Lourd...Exploring Ways on e-Marketing and e-Feedback by Dr Catherine Xiang & Ms Lourd...
Exploring Ways on e-Marketing and e-Feedback by Dr Catherine Xiang & Ms Lourd...
 
Multiculturalism & LfA: Addressing the Challenges by LeeAnn Stone Ed.D.
Multiculturalism & LfA: Addressing the Challenges by LeeAnn Stone Ed.D.Multiculturalism & LfA: Addressing the Challenges by LeeAnn Stone Ed.D.
Multiculturalism & LfA: Addressing the Challenges by LeeAnn Stone Ed.D.
 
Supporting Quality Teaching: a Profile of IWLP Teachers and the Role of Langu...
Supporting Quality Teaching: a Profile of IWLP Teachers and the Role of Langu...Supporting Quality Teaching: a Profile of IWLP Teachers and the Role of Langu...
Supporting Quality Teaching: a Profile of IWLP Teachers and the Role of Langu...
 
Accessibility of Professional Development by Language Practioners Investigati...
Accessibility of Professional Development by Language Practioners Investigati...Accessibility of Professional Development by Language Practioners Investigati...
Accessibility of Professional Development by Language Practioners Investigati...
 
The Common European Framework of Reference for Arabic Language Teaching & Lea...
The Common European Framework of Reference for Arabic Language Teaching & Lea...The Common European Framework of Reference for Arabic Language Teaching & Lea...
The Common European Framework of Reference for Arabic Language Teaching & Lea...
 
Global Futures by John Pugsley
Global Futures by John PugsleyGlobal Futures by John Pugsley
Global Futures by John Pugsley
 

Último

What is the Future of QuickBooks DeskTop?
What is the Future of QuickBooks DeskTop?What is the Future of QuickBooks DeskTop?
What is the Future of QuickBooks DeskTop?TechSoup
 
How to Add Existing Field in One2Many Tree View in Odoo 17
How to Add Existing Field in One2Many Tree View in Odoo 17How to Add Existing Field in One2Many Tree View in Odoo 17
How to Add Existing Field in One2Many Tree View in Odoo 17Celine George
 
How to Make a Field read-only in Odoo 17
How to Make a Field read-only in Odoo 17How to Make a Field read-only in Odoo 17
How to Make a Field read-only in Odoo 17Celine George
 
The Singapore Teaching Practice document
The Singapore Teaching Practice documentThe Singapore Teaching Practice document
The Singapore Teaching Practice documentXsasf Sfdfasd
 
CAULIFLOWER BREEDING 1 Parmar pptx
CAULIFLOWER BREEDING 1 Parmar pptxCAULIFLOWER BREEDING 1 Parmar pptx
CAULIFLOWER BREEDING 1 Parmar pptxSaurabhParmar42
 
Maximizing Impact_ Nonprofit Website Planning, Budgeting, and Design.pdf
Maximizing Impact_ Nonprofit Website Planning, Budgeting, and Design.pdfMaximizing Impact_ Nonprofit Website Planning, Budgeting, and Design.pdf
Maximizing Impact_ Nonprofit Website Planning, Budgeting, and Design.pdfTechSoup
 
CHUYÊN ĐỀ DẠY THÊM TIẾNG ANH LỚP 11 - GLOBAL SUCCESS - NĂM HỌC 2023-2024 - HK...
CHUYÊN ĐỀ DẠY THÊM TIẾNG ANH LỚP 11 - GLOBAL SUCCESS - NĂM HỌC 2023-2024 - HK...CHUYÊN ĐỀ DẠY THÊM TIẾNG ANH LỚP 11 - GLOBAL SUCCESS - NĂM HỌC 2023-2024 - HK...
CHUYÊN ĐỀ DẠY THÊM TIẾNG ANH LỚP 11 - GLOBAL SUCCESS - NĂM HỌC 2023-2024 - HK...Nguyen Thanh Tu Collection
 
Prescribed medication order and communication skills.pptx
Prescribed medication order and communication skills.pptxPrescribed medication order and communication skills.pptx
Prescribed medication order and communication skills.pptxraviapr7
 
Practical Research 1: Lesson 8 Writing the Thesis Statement.pptx
Practical Research 1: Lesson 8 Writing the Thesis Statement.pptxPractical Research 1: Lesson 8 Writing the Thesis Statement.pptx
Practical Research 1: Lesson 8 Writing the Thesis Statement.pptxKatherine Villaluna
 
Human-AI Co-Creation of Worked Examples for Programming Classes
Human-AI Co-Creation of Worked Examples for Programming ClassesHuman-AI Co-Creation of Worked Examples for Programming Classes
Human-AI Co-Creation of Worked Examples for Programming ClassesMohammad Hassany
 
Easter in the USA presentation by Chloe.
Easter in the USA presentation by Chloe.Easter in the USA presentation by Chloe.
Easter in the USA presentation by Chloe.EnglishCEIPdeSigeiro
 
Diploma in Nursing Admission Test Question Solution 2023.pdf
Diploma in Nursing Admission Test Question Solution 2023.pdfDiploma in Nursing Admission Test Question Solution 2023.pdf
Diploma in Nursing Admission Test Question Solution 2023.pdfMohonDas
 
Clinical Pharmacy Introduction to Clinical Pharmacy, Concept of clinical pptx
Clinical Pharmacy  Introduction to Clinical Pharmacy, Concept of clinical pptxClinical Pharmacy  Introduction to Clinical Pharmacy, Concept of clinical pptx
Clinical Pharmacy Introduction to Clinical Pharmacy, Concept of clinical pptxraviapr7
 
How to Manage Cross-Selling in Odoo 17 Sales
How to Manage Cross-Selling in Odoo 17 SalesHow to Manage Cross-Selling in Odoo 17 Sales
How to Manage Cross-Selling in Odoo 17 SalesCeline George
 
UKCGE Parental Leave Discussion March 2024
UKCGE Parental Leave Discussion March 2024UKCGE Parental Leave Discussion March 2024
UKCGE Parental Leave Discussion March 2024UKCGE
 
Presentation on the Basics of Writing. Writing a Paragraph
Presentation on the Basics of Writing. Writing a ParagraphPresentation on the Basics of Writing. Writing a Paragraph
Presentation on the Basics of Writing. Writing a ParagraphNetziValdelomar1
 
How to Add a New Field in Existing Kanban View in Odoo 17
How to Add a New Field in Existing Kanban View in Odoo 17How to Add a New Field in Existing Kanban View in Odoo 17
How to Add a New Field in Existing Kanban View in Odoo 17Celine George
 
M-2- General Reactions of amino acids.pptx
M-2- General Reactions of amino acids.pptxM-2- General Reactions of amino acids.pptx
M-2- General Reactions of amino acids.pptxDr. Santhosh Kumar. N
 
3.21.24 The Origins of Black Power.pptx
3.21.24  The Origins of Black Power.pptx3.21.24  The Origins of Black Power.pptx
3.21.24 The Origins of Black Power.pptxmary850239
 
Quality Assurance_GOOD LABORATORY PRACTICE
Quality Assurance_GOOD LABORATORY PRACTICEQuality Assurance_GOOD LABORATORY PRACTICE
Quality Assurance_GOOD LABORATORY PRACTICESayali Powar
 

Último (20)

What is the Future of QuickBooks DeskTop?
What is the Future of QuickBooks DeskTop?What is the Future of QuickBooks DeskTop?
What is the Future of QuickBooks DeskTop?
 
How to Add Existing Field in One2Many Tree View in Odoo 17
How to Add Existing Field in One2Many Tree View in Odoo 17How to Add Existing Field in One2Many Tree View in Odoo 17
How to Add Existing Field in One2Many Tree View in Odoo 17
 
How to Make a Field read-only in Odoo 17
How to Make a Field read-only in Odoo 17How to Make a Field read-only in Odoo 17
How to Make a Field read-only in Odoo 17
 
The Singapore Teaching Practice document
The Singapore Teaching Practice documentThe Singapore Teaching Practice document
The Singapore Teaching Practice document
 
CAULIFLOWER BREEDING 1 Parmar pptx
CAULIFLOWER BREEDING 1 Parmar pptxCAULIFLOWER BREEDING 1 Parmar pptx
CAULIFLOWER BREEDING 1 Parmar pptx
 
Maximizing Impact_ Nonprofit Website Planning, Budgeting, and Design.pdf
Maximizing Impact_ Nonprofit Website Planning, Budgeting, and Design.pdfMaximizing Impact_ Nonprofit Website Planning, Budgeting, and Design.pdf
Maximizing Impact_ Nonprofit Website Planning, Budgeting, and Design.pdf
 
CHUYÊN ĐỀ DẠY THÊM TIẾNG ANH LỚP 11 - GLOBAL SUCCESS - NĂM HỌC 2023-2024 - HK...
CHUYÊN ĐỀ DẠY THÊM TIẾNG ANH LỚP 11 - GLOBAL SUCCESS - NĂM HỌC 2023-2024 - HK...CHUYÊN ĐỀ DẠY THÊM TIẾNG ANH LỚP 11 - GLOBAL SUCCESS - NĂM HỌC 2023-2024 - HK...
CHUYÊN ĐỀ DẠY THÊM TIẾNG ANH LỚP 11 - GLOBAL SUCCESS - NĂM HỌC 2023-2024 - HK...
 
Prescribed medication order and communication skills.pptx
Prescribed medication order and communication skills.pptxPrescribed medication order and communication skills.pptx
Prescribed medication order and communication skills.pptx
 
Practical Research 1: Lesson 8 Writing the Thesis Statement.pptx
Practical Research 1: Lesson 8 Writing the Thesis Statement.pptxPractical Research 1: Lesson 8 Writing the Thesis Statement.pptx
Practical Research 1: Lesson 8 Writing the Thesis Statement.pptx
 
Human-AI Co-Creation of Worked Examples for Programming Classes
Human-AI Co-Creation of Worked Examples for Programming ClassesHuman-AI Co-Creation of Worked Examples for Programming Classes
Human-AI Co-Creation of Worked Examples for Programming Classes
 
Easter in the USA presentation by Chloe.
Easter in the USA presentation by Chloe.Easter in the USA presentation by Chloe.
Easter in the USA presentation by Chloe.
 
Diploma in Nursing Admission Test Question Solution 2023.pdf
Diploma in Nursing Admission Test Question Solution 2023.pdfDiploma in Nursing Admission Test Question Solution 2023.pdf
Diploma in Nursing Admission Test Question Solution 2023.pdf
 
Clinical Pharmacy Introduction to Clinical Pharmacy, Concept of clinical pptx
Clinical Pharmacy  Introduction to Clinical Pharmacy, Concept of clinical pptxClinical Pharmacy  Introduction to Clinical Pharmacy, Concept of clinical pptx
Clinical Pharmacy Introduction to Clinical Pharmacy, Concept of clinical pptx
 
How to Manage Cross-Selling in Odoo 17 Sales
How to Manage Cross-Selling in Odoo 17 SalesHow to Manage Cross-Selling in Odoo 17 Sales
How to Manage Cross-Selling in Odoo 17 Sales
 
UKCGE Parental Leave Discussion March 2024
UKCGE Parental Leave Discussion March 2024UKCGE Parental Leave Discussion March 2024
UKCGE Parental Leave Discussion March 2024
 
Presentation on the Basics of Writing. Writing a Paragraph
Presentation on the Basics of Writing. Writing a ParagraphPresentation on the Basics of Writing. Writing a Paragraph
Presentation on the Basics of Writing. Writing a Paragraph
 
How to Add a New Field in Existing Kanban View in Odoo 17
How to Add a New Field in Existing Kanban View in Odoo 17How to Add a New Field in Existing Kanban View in Odoo 17
How to Add a New Field in Existing Kanban View in Odoo 17
 
M-2- General Reactions of amino acids.pptx
M-2- General Reactions of amino acids.pptxM-2- General Reactions of amino acids.pptx
M-2- General Reactions of amino acids.pptx
 
3.21.24 The Origins of Black Power.pptx
3.21.24  The Origins of Black Power.pptx3.21.24  The Origins of Black Power.pptx
3.21.24 The Origins of Black Power.pptx
 
Quality Assurance_GOOD LABORATORY PRACTICE
Quality Assurance_GOOD LABORATORY PRACTICEQuality Assurance_GOOD LABORATORY PRACTICE
Quality Assurance_GOOD LABORATORY PRACTICE
 

Accountability and Assessment - What can Tests tell you? by Alex Thorp

  • 1. Alex Thorp Academic Support Specialist Trinity College London AULC Conference – Cardiff 7th – 8th January 2016
  • 2. Accountability and Assessment - What can tests tell you? Alex Thorp AULC 7th – 8th January 2016
  • 3. Overview • How accountable are we? • What do students need for success? • Feedback and research – pre-sessional • Trinity – a response to contemporary assessment • Q&A Alex Thorp AULC 7th – 8th January 2016
  • 4. 4 Accountability and Assessment As a University Language Department / University, in what ways are you accountable for your students’ achievement?
  • 5. 5 Accountability and Assessment What are we accountable for? • Poor achievement levels • Dropouts • Failing the course / year • High levels of absenteeism • Student stress levels / anxiety • The ‘International Student Experience’ • Student identity • • Do these issues stem from language skills or something more? Dissatisfied fee-paying students have avenues for recourse: • Legal action • Igrad (feedback) • Reputation • PR • Social media • International agreements
  • 6. Language Skills Transferable Skills Study Strategies 6 What do students need to succeed? Academically, socially, culturally…
  • 8. 8 What do students need to succeed? Language Skills Bachman & Palmer (2010): communicative competence model Communicative Competence Linguistic competence Socio-linguistic competence Discourse competence Strategic competence
  • 10. 10 What do students need to succeed? Transferable Skills 1. Critical thinking & problem solving 2. Collaboration and leading by influence 3. Agility and adaptability 4. Initiative and entrepreneurship 5. Effective oral and written communication 6. Accessing and analyzing information 7. Curiosity and imagination Tony Wagner - Expert In Residence - Innovation Lab of Harvard
  • 12. 12 • Note taking • Summarising • Synthesising • Sourcing relevant data across texts • Planning • Self-checking and self-evaluation • Deducing and inferring • What do students need to succeed? Study Strategies 2500+ published academic papers
  • 13. Language Skills Transferable Skills Study Strategies 13 What do students need to succeed? Academically, socially, culturally…
  • 14. 14 Pre-sessional Trainers - Feedback Sample interviews with Pre-sessional trainers • Accuracy – 4 skills competences • Academic writing - discourse • Language for seminars and presentations • Ability to discuss / communicate • Academic vocabulary Language Skills (what is needed to succeed)
  • 15. 15 Pre-sessional Trainers - Feedback Sample interviews with Pre-sessional trainers • Socialisation skills • Self motivation • Leadership • Critical thinking • Debating • Creative thinking Transferable Skills (what is needed to succeed)
  • 16. 16 Pre-sessional Trainers - Feedback Sample interviews with Pre-sessional trainers • Note-taking • Listening and note-taking • Self correction and reflection • Deduce meaning of unknown item • Speed reading – selection • Research skills • Planning Study strategies (what is needed to succeed)
  • 17. 17 Pre-sessional Trainers - Feedback Sample interviews with Pre-sessional trainers Ring any bells….?
  • 18. Pre-sessional Trainers - Feedback Sample interviews with Pre-sessional trainers What negative expectations (skills?) do new students bring? Over-reliance on dictionaries and mobile media M.O. University of the Arts London Wanting to translate every word (productive and receptive). J.B. University of Bristol Not willing to participate in pair work / communication S.H. University of Sussex Want to be spoon-fed / expectation of teacher-centred input S.I. University of Birmingham Memorisation / working from scripts J.P-S. University of Edinburgh
  • 19. 19 What should a test tell you? In an ideal world…. Language Skills Transferable Skills Study Strategies
  • 20. Trinity ISE – revised 2015 An Integrated Skills exam
  • 21. Trinity ISE – revised 2015 An Integrated Skills exam
  • 22. The ISE formatISE Foundation ISE I ISE II ISE III CEFR level A2 B1 B2 C1 Topic task 4 minutes 4 minutes 4 minutes 8 minutes Collaborative task - - 4 minutes 4 minutes Conversation task 2 minutes 2 minutes 2 minutes 3 minutes Independent listening task 6 minutes 7 minutes 8 minutes 8 minutes Trinity ISE? Overview – Speaking & Listening Is this anything new?
  • 23. 23 When do you speak without listening? When do you write without reading? Communicative competence requires assessment that tests skill integration. Trinity ISE? An integrated approach
  • 24. MACRO - Receptive Listening Objectively tested MACRO - Receptive Reading Objectively tested MACRO - Receptive Speaking Subjectively tested MACRO - Receptive Writing Subjectively tested Interactive Listening (Subjectively tested) Reading into Writing (Subjectively tested) What do students need to succeed? Language Skills
  • 25. 25 Topic task Collaborative task (at higher grades) Conversation The test taker prepares ANY topic of their choice for discussion with the examiner The examiner selects topic from a list relevant to the level and asks the test taker questions to start a conversation The examiner reads a prompt which creates an information gap. This sets the scene for a test-taker led discussion NEW rating scale & Assessment of Interactive listening Trinity ISE? Overview – Speaking & Listening
  • 26. 26 What do students need to succeed? Transferable Skills planning/organisation practising English presentation skills creativity self-evaluation self-management critical thinking problem-solving Preparing for Trinity ISE: impact
  • 27. The ISE formatISE Foundation ISE I ISE II ISE III CEFR level A2 B1 B2 C1 Time 2 hours Task 1 Long reading 300 words 15 questions Long reading 400 words 15 questions Long reading 500 words 15 questions Long reading 700 words 15 questions Task 2 Multi-text reading 3 texts 300 words 15 questions Multi-text reading 4 texts 400 words 15 questions Multi-text reading 4 texts 500 words 15 questions Multi-text reading 4 texts 700 words 15 questions Task 3 Reading into writing 70-100 words Reading into writing 100-130 words Reading into writing 150-180 words Reading into writing 200-230 words Task 4 Extended writing 70-100 words Extended writing 100-130 words Extended writing 150-180 words Extended writing 200-230 words Trinity ISE? Overview – Reading and Writing
  • 28. Q6-10 Selecting true statements Understand specific information at sentence level Multiple genres: Factual texts familiar in an educational or everyday context Q1-5 Multiple matching Understand the main idea and purpose of each text Graphic Organiser representing complex information Contemporary digital reading strategies ISE Reading & Writing Example – Task 2, Multi-text reading
  • 29. ISE Reading & Writing Example – Task 2, Multi-text reading Q11-15 Completing summary notes Understand factual information at word or phrase level across texts. Use the information in a simple summary
  • 30. ISE Reading & Writing Example – Task 3, Reading into Writing • Use same texts from the reading task • Refer back to the summary notes as a spring board for planning • Identify relevant information from all texts • Paraphrase and summarise key words, phrases, sentences • Incorporate the information in a response to a prompt
  • 31. Language Skills Transferable Skills Study Strategies 31 What do students need to succeed? Academically, socially, culturally…
  • 32. 32 Trinity ISE and the CEFR Implications for standardisation and predictive validity. Trinity ISE mapped from the CEFR … not mapped to the CEFR
  • 33. Accountability and Assessment Summary We are accountable for our students’ achievement Need to know what applicant students can do Need to know what to teach pre-sessional students (and how) Language Skills Study Strategies Transferable Skills To what degree do the tests you use equip you to do this?
  • 34. Accountability and Assessment Summary Trinity Integrated Skills in English Exam (ISE) Pre- admission Predictive Validity Relevant Skills Part of Pre-sessional study Positive Washback Relevant skills
  • 36. 36 Factsheet leaflets for teachers & students Brochure for colleges and universities ISE Guides for teachers* Introductory overview & sample exam videos Online guidance & ISE Best practise guide for administrators Sample papers and classroom activities including Portfolio toolkit ISE Guides for students Resources Available online at www.trinitycollege.com
  • 37. Alex Thorp Academic Support Specialist Trinity College London AULC Conference – Cardiff 7th – 8th January 2016 Thank you. alex.thorp@trinitycollege.com