SlideShare una empresa de Scribd logo
1 de 15
Descargar para leer sin conexión
Applying standards to
testing
KAYSERI, 29-31 JANUARY 2014
Aims

! 

Objectives of setting up standards

! 

Overview of international testing standards

! 

The Common European Framework of Reference
Standards = code of practice

! 

an agreed set of guidelines which should be
consulted and, as far as possible, heeded in the
construction and evaluation of a test
(definition from Language Test Construction and
Evaluation by Alderson, Clapham and Wall, 1995
CUP)
Standards: history

! 

late 20th century:
!  various

competing educational and testing standards

!  some

widely respected, but no universal acceptance:
ALTE Code of Practice (1994) or UCLES Standards (for
Cambridge Main Suite exams)

! 

early 21st century:
!  move

towards internationally recognised standards: the
CEFR (2001)
What the CEFR is

! 

The Common European Framework of Reference for
Languages – Learning, Teaching, Assessment

! 

A Council of Europe project, initiated in 2001

! 

Designed to facilitate ‘mutual recognition of
qualifications, and communication concerning
objectives and achievement standards’

! 

Description, not prescription
What the CEFR isn’t

! 

Not a framework only for Europe (or for the EU)

! 

Not a language teaching curriculum, or syllabus plan

! 

Not an exam system

! 

The Portfolio is only part of the CEFR, and so are the
assessment tables
The Common Reference Levels
Reception
Listening

C2

Audiovisual

Interaction
Reading

Proficient user

C1
B2

Independent user

B1
A2
A1

Basic user

Production

Spoken

Spoken

Written

Written
Criticism of the CEFR
! 

Not user-friendly

! 

Practices differ from school to school, from country to
country

! 

Policymakers see CEFR as a quick fix

! 

The implementation is top-down

! 

Applying the assessment tables in practice is
complicated

! 

Favours the communicate approach only

! 

Creativity is limited
Benefits of the CEFR
! 

The CEFR can be the basis of a school (or national)
curriculum, offering transparent standards

! 

The CEFR can be the basis of a course syllabus

! 

The assessment criteria can serve as the basis for
exam specifications

! 

The Portfolio involves the learner in the process of
their learning (! self-assessment)

! 

The use of CEFR level labels makes distinction
between courses clearer
Disadvantages of applying
CEFR in the school classroom
! 

No measure of grammar-based progression

! 

Not geared towards school-based learners (and
towards non-adults)

! 

Self-assessment descriptors are not exhaustive

! 

Some functional areas are not covered
Advantages of applying CEFR
in the school classroom
! 

Focus on situational / functional language (real
world context)

! 

Skills and strategies (‘can do’)

! 

Less focus on mechanical practice

! 

Clear link between student achievement and exams

! 

Self-assessment and autonomy

! 

Encouragement of continuity
Portfolio
Portfolio: CEFR applied to teaching
! 

Continuous assessment throughout the
learning career

! 

Portfolio work is not only for beginners

! 

Any age group

! 

The Portfolio belongs to the learner, not to
the institution or teacher

! 

The Portfolio becomes a record of the
learning process
Thank you!

zoltan.rezmuves@digimedia.hu
consonantvoiced.blogspot.com

Más contenido relacionado

Destacado

Destacado (7)

Progetti PON C5
Progetti PON C5Progetti PON C5
Progetti PON C5
 
CTS-Academic: Module 2 session 2 theories of language learning
CTS-Academic: Module 2 session 2 theories of language learningCTS-Academic: Module 2 session 2 theories of language learning
CTS-Academic: Module 2 session 2 theories of language learning
 
Tutorial como insertar una imagen
Tutorial como insertar una imagenTutorial como insertar una imagen
Tutorial como insertar una imagen
 
Corsi di inglese per giovani ingegneri - English for Young Engineers
Corsi di inglese per giovani ingegneri - English for Young EngineersCorsi di inglese per giovani ingegneri - English for Young Engineers
Corsi di inglese per giovani ingegneri - English for Young Engineers
 
Corsi di business english 2016
Corsi di business english 2016Corsi di business english 2016
Corsi di business english 2016
 
Corso di Business English a Londra per giovani. Possibilità di stage successivo
Corso di Business English a Londra per giovani. Possibilità di stage successivoCorso di Business English a Londra per giovani. Possibilità di stage successivo
Corso di Business English a Londra per giovani. Possibilità di stage successivo
 
3.3 tests of productive skills: workshop CTS-Academic
3.3 tests of productive skills: workshop CTS-Academic3.3 tests of productive skills: workshop CTS-Academic
3.3 tests of productive skills: workshop CTS-Academic
 

Similar a 2.1 applying standards to testing: plenary CTS-Academic

A quality approach to CEFR implementation
A quality approach to CEFR implementation A quality approach to CEFR implementation
A quality approach to CEFR implementation
eaquals
 
Thom Kiddle: Responding to the challenge of testing and assessing speaking
Thom Kiddle: Responding to the challenge of testing and assessing speakingThom Kiddle: Responding to the challenge of testing and assessing speaking
Thom Kiddle: Responding to the challenge of testing and assessing speaking
eaquals
 
31GEP3_GA3_Common European Framework
31GEP3_GA3_Common European Framework31GEP3_GA3_Common European Framework
31GEP3_GA3_Common European Framework
carobuf
 
Thecommoneuropeanframeworkofreferenceforlanguages 110920205758-phpapp01
Thecommoneuropeanframeworkofreferenceforlanguages 110920205758-phpapp01Thecommoneuropeanframeworkofreferenceforlanguages 110920205758-phpapp01
Thecommoneuropeanframeworkofreferenceforlanguages 110920205758-phpapp01
Claudia Martínez
 
Sarah Aitken - Presenting Eaquals: Preparing for a successful Eaquals inspection
Sarah Aitken - Presenting Eaquals: Preparing for a successful Eaquals inspectionSarah Aitken - Presenting Eaquals: Preparing for a successful Eaquals inspection
Sarah Aitken - Presenting Eaquals: Preparing for a successful Eaquals inspection
eaquals
 
Assessnent literacy apr 14 (fiona barker)
Assessnent literacy apr 14 (fiona barker)Assessnent literacy apr 14 (fiona barker)
Assessnent literacy apr 14 (fiona barker)
eaquals
 
Using the European Profiling Grid
Using the European Profiling Grid Using the European Profiling Grid
Using the European Profiling Grid
eaquals
 

Similar a 2.1 applying standards to testing: plenary CTS-Academic (20)

Summary:The Common European Framework of Reference for Language
Summary:The Common European Framework of Reference for Language Summary:The Common European Framework of Reference for Language
Summary:The Common European Framework of Reference for Language
 
3.1 curriculum and assessment: plenary CTS-Academic
3.1 curriculum and assessment: plenary CTS-Academic3.1 curriculum and assessment: plenary CTS-Academic
3.1 curriculum and assessment: plenary CTS-Academic
 
1.1 language assessment in Turkey: plenary CTS-Academic
1.1 language assessment in Turkey: plenary CTS-Academic1.1 language assessment in Turkey: plenary CTS-Academic
1.1 language assessment in Turkey: plenary CTS-Academic
 
A quality approach to CEFR implementation
A quality approach to CEFR implementation A quality approach to CEFR implementation
A quality approach to CEFR implementation
 
Roadmap_MoE_290616.pptx
Roadmap_MoE_290616.pptxRoadmap_MoE_290616.pptx
Roadmap_MoE_290616.pptx
 
Khoa hoc TESOL tai truong Anh ngu EV - Cebu
Khoa hoc TESOL tai truong Anh ngu EV - CebuKhoa hoc TESOL tai truong Anh ngu EV - Cebu
Khoa hoc TESOL tai truong Anh ngu EV - Cebu
 
CEFR-based tools and resources: latest developments (Mila Angelova)
CEFR-based tools and resources: latest developments (Mila Angelova)CEFR-based tools and resources: latest developments (Mila Angelova)
CEFR-based tools and resources: latest developments (Mila Angelova)
 
Thom Kiddle: Responding to the challenge of testing and assessing speaking
Thom Kiddle: Responding to the challenge of testing and assessing speakingThom Kiddle: Responding to the challenge of testing and assessing speaking
Thom Kiddle: Responding to the challenge of testing and assessing speaking
 
Quality Assurance in Efl for TVET in Colleges of Excellence in Saudi Arabia: ...
Quality Assurance in Efl for TVET in Colleges of Excellence in Saudi Arabia: ...Quality Assurance in Efl for TVET in Colleges of Excellence in Saudi Arabia: ...
Quality Assurance in Efl for TVET in Colleges of Excellence in Saudi Arabia: ...
 
Assessment Module 3
Assessment Module 3Assessment Module 3
Assessment Module 3
 
ppt CEFR.ppt
ppt CEFR.pptppt CEFR.ppt
ppt CEFR.ppt
 
!ppt CEFR.ppt
!ppt CEFR.ppt!ppt CEFR.ppt
!ppt CEFR.ppt
 
31GEP3_GA3_Common European Framework
31GEP3_GA3_Common European Framework31GEP3_GA3_Common European Framework
31GEP3_GA3_Common European Framework
 
Thecommoneuropeanframeworkofreferenceforlanguages 110920205758-phpapp01
Thecommoneuropeanframeworkofreferenceforlanguages 110920205758-phpapp01Thecommoneuropeanframeworkofreferenceforlanguages 110920205758-phpapp01
Thecommoneuropeanframeworkofreferenceforlanguages 110920205758-phpapp01
 
53 1-6
53 1-653 1-6
53 1-6
 
Classroom Practices for English Learners (ELs) Instruction
Classroom Practices for English Learners (ELs) InstructionClassroom Practices for English Learners (ELs) Instruction
Classroom Practices for English Learners (ELs) Instruction
 
Sarah Aitken - Presenting Eaquals: Preparing for a successful Eaquals inspection
Sarah Aitken - Presenting Eaquals: Preparing for a successful Eaquals inspectionSarah Aitken - Presenting Eaquals: Preparing for a successful Eaquals inspection
Sarah Aitken - Presenting Eaquals: Preparing for a successful Eaquals inspection
 
Evaluation in Capacity-Building Strategy: The Next Step in the LMD Philosophy
Evaluation in Capacity-Building Strategy: The Next Step in the LMD PhilosophyEvaluation in Capacity-Building Strategy: The Next Step in the LMD Philosophy
Evaluation in Capacity-Building Strategy: The Next Step in the LMD Philosophy
 
Assessnent literacy apr 14 (fiona barker)
Assessnent literacy apr 14 (fiona barker)Assessnent literacy apr 14 (fiona barker)
Assessnent literacy apr 14 (fiona barker)
 
Using the European Profiling Grid
Using the European Profiling Grid Using the European Profiling Grid
Using the European Profiling Grid
 

Más de SeltAcademy

Más de SeltAcademy (15)

CTS-Academic: Module 2 session 9 cognitive processes
CTS-Academic: Module 2 session 9 cognitive processesCTS-Academic: Module 2 session 9 cognitive processes
CTS-Academic: Module 2 session 9 cognitive processes
 
CTS-Academic: Module 2 session 8 psycholinguistics
CTS-Academic: Module 2 session 8 psycholinguisticsCTS-Academic: Module 2 session 8 psycholinguistics
CTS-Academic: Module 2 session 8 psycholinguistics
 
CTS-Academic: Module 2 session 6 classroom sla
CTS-Academic: Module 2 session 6 classroom slaCTS-Academic: Module 2 session 6 classroom sla
CTS-Academic: Module 2 session 6 classroom sla
 
CTS-Academic: Module 2 session 5 sla research
CTS-Academic: Module 2 session 5 sla researchCTS-Academic: Module 2 session 5 sla research
CTS-Academic: Module 2 session 5 sla research
 
CTS-Academic: Module 2 session 3 theories of language learning
CTS-Academic: Module 2 session 3 theories of language learningCTS-Academic: Module 2 session 3 theories of language learning
CTS-Academic: Module 2 session 3 theories of language learning
 
CTS-Academic: Module 2 session 1 theories of language
CTS-Academic: Module 2 session 1 theories of languageCTS-Academic: Module 2 session 1 theories of language
CTS-Academic: Module 2 session 1 theories of language
 
1.3 tests of grammar and vocabulary: workshop CTS-Academic
1.3 tests of grammar and vocabulary: workshop CTS-Academic1.3 tests of grammar and vocabulary: workshop CTS-Academic
1.3 tests of grammar and vocabulary: workshop CTS-Academic
 
2.3 tests of receptive skills: workshop CTS-Academic
2.3 tests of receptive skills: workshop CTS-Academic2.3 tests of receptive skills: workshop CTS-Academic
2.3 tests of receptive skills: workshop CTS-Academic
 
3.2 test development cycle: plenary CTS-Academic
3.2 test development cycle: plenary CTS-Academic3.2 test development cycle: plenary CTS-Academic
3.2 test development cycle: plenary CTS-Academic
 
2.2.test design test writing: plenary CTS-Academic
2.2.test design test writing: plenary CTS-Academic2.2.test design test writing: plenary CTS-Academic
2.2.test design test writing: plenary CTS-Academic
 
1.2 principles of test design: plenary CTS-Academic
1.2 principles of test design: plenary CTS-Academic1.2 principles of test design: plenary CTS-Academic
1.2 principles of test design: plenary CTS-Academic
 
Part 3 great opportunities great expectations
Part 3 great opportunities great expectationsPart 3 great opportunities great expectations
Part 3 great opportunities great expectations
 
Part 2 great opportunities great expectations
Part 2 great opportunities great expectationsPart 2 great opportunities great expectations
Part 2 great opportunities great expectations
 
Part 1 great opportunities great expectations
Part 1 great opportunities great expectationsPart 1 great opportunities great expectations
Part 1 great opportunities great expectations
 
Types of stories for children
Types of stories for childrenTypes of stories for children
Types of stories for children
 

Último

The basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxThe basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptx
heathfieldcps1
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
ciinovamais
 
Spellings Wk 3 English CAPS CARES Please Practise
Spellings Wk 3 English CAPS CARES Please PractiseSpellings Wk 3 English CAPS CARES Please Practise
Spellings Wk 3 English CAPS CARES Please Practise
AnaAcapella
 
1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdf
QucHHunhnh
 

Último (20)

Introduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsIntroduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The Basics
 
Magic bus Group work1and 2 (Team 3).pptx
Magic bus Group work1and 2 (Team 3).pptxMagic bus Group work1and 2 (Team 3).pptx
Magic bus Group work1and 2 (Team 3).pptx
 
The basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxThe basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptx
 
SOC 101 Demonstration of Learning Presentation
SOC 101 Demonstration of Learning PresentationSOC 101 Demonstration of Learning Presentation
SOC 101 Demonstration of Learning Presentation
 
Unit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptxUnit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptx
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
 
How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17
 
microwave assisted reaction. General introduction
microwave assisted reaction. General introductionmicrowave assisted reaction. General introduction
microwave assisted reaction. General introduction
 
Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024
 
Micro-Scholarship, What it is, How can it help me.pdf
Micro-Scholarship, What it is, How can it help me.pdfMicro-Scholarship, What it is, How can it help me.pdf
Micro-Scholarship, What it is, How can it help me.pdf
 
This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.
 
Food safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdfFood safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdf
 
How to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POSHow to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POS
 
Spellings Wk 3 English CAPS CARES Please Practise
Spellings Wk 3 English CAPS CARES Please PractiseSpellings Wk 3 English CAPS CARES Please Practise
Spellings Wk 3 English CAPS CARES Please Practise
 
1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdf
 
Unit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxUnit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptx
 
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
 
SKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptx
SKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptxSKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptx
SKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptx
 
Mixin Classes in Odoo 17 How to Extend Models Using Mixin Classes
Mixin Classes in Odoo 17  How to Extend Models Using Mixin ClassesMixin Classes in Odoo 17  How to Extend Models Using Mixin Classes
Mixin Classes in Odoo 17 How to Extend Models Using Mixin Classes
 
Making communications land - Are they received and understood as intended? we...
Making communications land - Are they received and understood as intended? we...Making communications land - Are they received and understood as intended? we...
Making communications land - Are they received and understood as intended? we...
 

2.1 applying standards to testing: plenary CTS-Academic

  • 2.
  • 3. Aims !  Objectives of setting up standards !  Overview of international testing standards !  The Common European Framework of Reference
  • 4. Standards = code of practice !  an agreed set of guidelines which should be consulted and, as far as possible, heeded in the construction and evaluation of a test (definition from Language Test Construction and Evaluation by Alderson, Clapham and Wall, 1995 CUP)
  • 5. Standards: history !  late 20th century: !  various competing educational and testing standards !  some widely respected, but no universal acceptance: ALTE Code of Practice (1994) or UCLES Standards (for Cambridge Main Suite exams) !  early 21st century: !  move towards internationally recognised standards: the CEFR (2001)
  • 6. What the CEFR is !  The Common European Framework of Reference for Languages – Learning, Teaching, Assessment !  A Council of Europe project, initiated in 2001 !  Designed to facilitate ‘mutual recognition of qualifications, and communication concerning objectives and achievement standards’ !  Description, not prescription
  • 7. What the CEFR isn’t !  Not a framework only for Europe (or for the EU) !  Not a language teaching curriculum, or syllabus plan !  Not an exam system !  The Portfolio is only part of the CEFR, and so are the assessment tables
  • 8. The Common Reference Levels Reception Listening C2 Audiovisual Interaction Reading Proficient user C1 B2 Independent user B1 A2 A1 Basic user Production Spoken Spoken Written Written
  • 9. Criticism of the CEFR !  Not user-friendly !  Practices differ from school to school, from country to country !  Policymakers see CEFR as a quick fix !  The implementation is top-down !  Applying the assessment tables in practice is complicated !  Favours the communicate approach only !  Creativity is limited
  • 10. Benefits of the CEFR !  The CEFR can be the basis of a school (or national) curriculum, offering transparent standards !  The CEFR can be the basis of a course syllabus !  The assessment criteria can serve as the basis for exam specifications !  The Portfolio involves the learner in the process of their learning (! self-assessment) !  The use of CEFR level labels makes distinction between courses clearer
  • 11. Disadvantages of applying CEFR in the school classroom !  No measure of grammar-based progression !  Not geared towards school-based learners (and towards non-adults) !  Self-assessment descriptors are not exhaustive !  Some functional areas are not covered
  • 12. Advantages of applying CEFR in the school classroom !  Focus on situational / functional language (real world context) !  Skills and strategies (‘can do’) !  Less focus on mechanical practice !  Clear link between student achievement and exams !  Self-assessment and autonomy !  Encouragement of continuity
  • 14. Portfolio: CEFR applied to teaching !  Continuous assessment throughout the learning career !  Portfolio work is not only for beginners !  Any age group !  The Portfolio belongs to the learner, not to the institution or teacher !  The Portfolio becomes a record of the learning process