Assessment and testing language

M
Ma Luz Kantumaestra en Escuela Privada CELA
María Lucely Kantún Tzuc
Universidad Vizcaya de las Américas Campus Chetumal
DEFINITION:
The process of making a judgment or forming an
opinion, after considering something or someone
carefully.
PURPOSE:
Inform people about their progress in learning.
Assessment and testing language
Tests or exams.
The most traditional form of assess students.
Activities.
Self-assessment.
Student assess by themselves their own learning.
When do teachers should assess?
All the stage of the learning process. Very frequently.
Assessment
Assessment
Assessment
LANGUAGE
TESTING
WASHBACK
It refers to te impact that tests have on teaching
and learning.
Alderson and
Wall (1993)
list some
«Washback
Hypostheses»
Tests will have washback on what
teachers teach (Content).
Tests also have impact on how
teachers teach (methodology).
High-stakes tets (tests with important
consequences)would have more
impact than low-stakes tests.
 Alderson and Hamp-Lyons (1996) show that teachers
may indeed change the way they teachwhen teaching
towards a test (in this case, theTOEFL —Test of
English as a Foreign Language).
 They show that the nature of the change and the
methodology adopted varies from teacher to teacher
(supported by Watanabe’s findings, 1996).
 Shohamy et al, (1996) show that the nature of
washback varies according to factors such as the status
of the language being tested, and the uses of the test.
 Watanabe concludes that washback is caused by the
interplay between the test and the test taker in a
complex manner.
 He emphasises that what may be most important is
not the objective difficulty of the test, but the students'
perception of difficulty.
Wall summarises research findings which show that test
design is only one of the factors affecting washback, and
lists as factors influencing the nature of test washback.
She makes a number of recommendations about the steps
that test developers might take in the future in order to
assess the amount of risk involved in attempting to bring
about change through testing:
 assessing the feasibility of examination reform by
studying the 'antecedent' conditions —what is
increasingly referred to as a 'baseline study‘
 Policy makers
should be aware that
tests on their own
will not have positive
impact if the
materials and
practices they are
based on have not
been effective.
 Messick (1994) argues that all testing involves
making value judgements, and therefore language
testing is open to a critical discussion of whose
values are being represented and served.
 Spolsky (1997) points out that tests and examinations have always
been used as instruments of social policy and control, with the gate-
keeping function of tests often justifying their existence.
 Shohamy (1997a) argues that uses of tests which exercise control
and manipulate stakeholders rather than providing information on
proficiency levels are also unethical, and she advocates the
development of “critical language testing”
 A number of case studies have been presented recently
which illustrate the use and misuse of language tests.
 Hawthorne (1997) describes two examples of the
misuse of language tests: the use of the access test to
regulate the flow of migrants into Australia, and the
step test, allegedly designed to play a central role in the
determining of asylum seekers‘ residential status.
 Norton and Starfield (1997) argue that criteria for
assessment should be made explicit and public if
testers are to behave ethically.
 The International Language Testing Association
(ILTA) has recently developed a Code of Ethics (rather
than finalising the draft Code of Practice referred to
above), which is 'a set of principles which draws upon
moral philosophy and strives to guide good
professional conduct.
 This Code is clear: testers should follow ethical
practices, and have a moral responsibility to do so.
 Tests are frequently used as instruments of
educational policy, and they can be very powerful — as
attested by Shohamy (2001a).
 Brindley (1998,2001) describes the political use of test-
based assessment for reasons of public accountabilty,
often in the context of national frameworks, standards
or benchmarking.
 Politics can be defined as action, or activities, to
achieve power or to use power, and as beliefs about
government, attitudes to power, and to the use of
power.
 National educational policy
often involves innovations
in testing in order to
influence the curriculum,
or in order to open up or
restrict access to education
and employment.
 Politics can be seen as
methods, tactics, intrigue,
manoeuvring, within
institutions which are
themselves not political,
but commercial, financial
and educational.
STANDARDS IN
TESTING
NORMS
COMMON
EUROPEAN
FRAMEWORK
Levels of proficiency
Level certified by public
examinations
Guarantee educational
and employment
mobility
EUROPEAN COMMON
FRAMEWORK
 The development of national language tests continues
to be the focus of many publications, although many
are either simply descriptions of test development or
discussions of controversies, rather than reports on
research done in connection with test development.
 Page (1993) argues that the use of the target language
in questions makes it more difficult to sample the
syllabus adequately, and claims that the more
communicative and authentic the tasks in
examinations become, the more English (the mother
tongue) has to be used on the examination paper in
order to safeguard both the validity and the
authenticityof the task.
 In the Netherlands (Jansen &Peer,
1999) reports a study of the recently
introduced use of dictionaries in
Dutch foreign language examinations
and shows that dictionary use does not
have any significant effect on test
scores.
 Pupils are very positive about being
allowed to use dictionaries, claiming
that it reduces anxiety and enhances
their text comprehension.
 Guillon (1997) recommends that more
open-ended tasks be used, and that
teachers be trained in the reliable use
of valid criteria for subjective marking,
instead of their current practice of
merely counting errors in production.
 Language testing can inform debates in language
education more generally.
 Washback studies have also been used in teacher
training, both in order to influence test preparation
practices, but also to encourage teachers to reflect on
the reasons for their and others' practices.
 Douglas (1997, 2000) identifies two aspects that typically
distinguish LSP testing from general purpose testing.
a) The authenticity of the tasks,
b) The interaction between language knowledge and specific
content knowledge.
 The development of an LSP test typically begins with an in-
depth analysis of the target language use situation, perhaps
using genre analysis (see Tarone,2001).
 Attention is paid to general situational features such as
topics, typical lexis and grammatical structures.
 Douglas (2000) stands firmly by claims made much
earlier in the decade that in highly field-specific
language contexts, a field-specific language test is a
better predictor of performance than a general purpose
test (Douglas & Selinker, 1992)
 Computer-based testing has witnessed
rapid growth in the past decade and
computers are now used to deliver
language tests in many settings.
 A computerbased version of the TOEFL
was introduced on a regional basis in
the summer of 1998, tests are now
available on CD ROM, and the Internet
is increasingly used to deliver tests to
users.
 Computers can be used at all stages in
the test development and
administration process.
 The commonest use of computers in
language testing is to deliver tests
adaptively (e.g.,Young et al.,1996).
Computer
based-
testing
advantages
Candidates are
presented with items at
their level of ability.
computer-adaptive tests
(CATs) are typically
quicker to deliver.
 The introduction of self-assessment was viewed
aspromising by many, especially in formative assessment
contexts (Oscarson, 1989).
 It was considered to encourage increasing sophistication in
learner awareness, helping learners to:
A) gain confidence in their own judgement.
B) acquire a view of evaluation that covers the whole
learning process.
C) see errors as something helpful.
 It was also seen to be potentially useful to teachers,
providing information on learning styles, on areas needing
remediation and feedback on teaching (Barbot, 1991)
 Carton (1993) discusses how self-assessment can
become part of the learning process.
 In general, these studies have found self-assessment to
be a robust method for gathering information about
learner proficiency and that the risk of cheating is low
(see Barbot, 1991).
 It is usually taken to mean assessment procedures which are less formal than
traditional testing, which are gathered over a period of time rather than being
taken at one point in time, which are usually formative
 rather than summative in function, are often
 low-stakes in terms of consequences, and are claimed
 to have beneficial washback effects. Although such
 procedures may be time-consuming and not very
 easy to administer and score, their claimed advantages
 are that they provide easily understood information,
 they are more integrative than traditional tests and
 they are more easily integrated into the classroom.
 McNamara (1998) makes the point that alternative
 assessment procedures are often developed in an
 attempt to make testing and assessment
Aternative
assessment
Less
formal
Gather
over a
period of
time
formative
More
integrative
1 de 32

Recomendados

Designing language test por
Designing language testDesigning language test
Designing language testJesullyna Manuel
5.8K vistas28 diapositivas
Testing for Language Teachers Arthur Hughes por
Testing for Language TeachersArthur HughesTesting for Language TeachersArthur Hughes
Testing for Language Teachers Arthur HughesRajputt Ainee
12.2K vistas16 diapositivas
Teaching and testing por
Teaching and testingTeaching and testing
Teaching and testingMohammed Alkhamali
25K vistas18 diapositivas
Achieving beneficial blackwash por
Achieving beneficial blackwashAchieving beneficial blackwash
Achieving beneficial blackwashMaury Martinez
8.7K vistas21 diapositivas
Types of tests and types of testing por
Types of tests and types of testingTypes of tests and types of testing
Types of tests and types of testingPhạm Phúc Khánh Minh
63.4K vistas33 diapositivas
Kinds of testing (2nd) por
Kinds of testing (2nd)Kinds of testing (2nd)
Kinds of testing (2nd)Harry Subagyo
20.9K vistas24 diapositivas

Más contenido relacionado

La actualidad más candente

Language Assessment : Kinds of tests and testing por
Language Assessment : Kinds of tests and testingLanguage Assessment : Kinds of tests and testing
Language Assessment : Kinds of tests and testingMusfera Nara Vadia
18.7K vistas15 diapositivas
Testing oral ability por
Testing oral abilityTesting oral ability
Testing oral abilityArfan rai
4.1K vistas7 diapositivas
Stages of test development and common test techniques (1) por
Stages of test development and common test techniques (1)Stages of test development and common test techniques (1)
Stages of test development and common test techniques (1)Maury Martinez
14.4K vistas34 diapositivas
Testing Grammar and Vocabulary Skill por
Testing Grammar and Vocabulary SkillTesting Grammar and Vocabulary Skill
Testing Grammar and Vocabulary SkillMyno Uddin
3.4K vistas10 diapositivas
testing writing por
testing writingtesting writing
testing writingAfif Kurniawan
9.3K vistas9 diapositivas
Test methods in Language Testing por
Test methods in Language TestingTest methods in Language Testing
Test methods in Language TestingSeray Tanyer
10.3K vistas25 diapositivas

La actualidad más candente(20)

Language Assessment : Kinds of tests and testing por Musfera Nara Vadia
Language Assessment : Kinds of tests and testingLanguage Assessment : Kinds of tests and testing
Language Assessment : Kinds of tests and testing
Musfera Nara Vadia18.7K vistas
Testing oral ability por Arfan rai
Testing oral abilityTesting oral ability
Testing oral ability
Arfan rai4.1K vistas
Stages of test development and common test techniques (1) por Maury Martinez
Stages of test development and common test techniques (1)Stages of test development and common test techniques (1)
Stages of test development and common test techniques (1)
Maury Martinez14.4K vistas
Testing Grammar and Vocabulary Skill por Myno Uddin
Testing Grammar and Vocabulary SkillTesting Grammar and Vocabulary Skill
Testing Grammar and Vocabulary Skill
Myno Uddin3.4K vistas
Test methods in Language Testing por Seray Tanyer
Test methods in Language TestingTest methods in Language Testing
Test methods in Language Testing
Seray Tanyer10.3K vistas
Types of test and testing por uzma bashir
Types of test and testingTypes of test and testing
Types of test and testing
uzma bashir10.5K vistas
Testing writing por Marta Ribas
Testing writingTesting writing
Testing writing
Marta Ribas8.2K vistas
Language Testing : Principles of language assessment por Yulia Eolia
Language Testing : Principles of language assessment Language Testing : Principles of language assessment
Language Testing : Principles of language assessment
Yulia Eolia3.9K vistas
Designing classroom language tests por Sutrisno Evenddy
Designing classroom language testsDesigning classroom language tests
Designing classroom language tests
Sutrisno Evenddy18.1K vistas
Alternative assessment por cholovacs
Alternative assessmentAlternative assessment
Alternative assessment
cholovacs7.8K vistas
Test specifications and designs por ahfameri
Test specifications and designs  Test specifications and designs
Test specifications and designs
ahfameri11.6K vistas
language testing: testing writing por Intan Sari
language testing: testing writinglanguage testing: testing writing
language testing: testing writing
Intan Sari4.6K vistas
Alternatives in assessment por RochiLuu
Alternatives in assessmentAlternatives in assessment
Alternatives in assessment
RochiLuu7.8K vistas

Destacado

Ethics in Assessment por
Ethics in AssessmentEthics in Assessment
Ethics in AssessmentPotterheadNove
6.2K vistas7 diapositivas
Assessment of Work Ethics in Middle East por
Assessment of Work Ethics in Middle EastAssessment of Work Ethics in Middle East
Assessment of Work Ethics in Middle EastAjay Bhati
2.2K vistas28 diapositivas
Detecting Unethical practices at Supplier Factories por
Detecting Unethical practices at Supplier FactoriesDetecting Unethical practices at Supplier Factories
Detecting Unethical practices at Supplier FactoriesMusabbirul Islam
1.1K vistas14 diapositivas
Ethical por
EthicalEthical
EthicalDevendra Bansal
1.3K vistas22 diapositivas
Definition of Assessment, por
Definition of Assessment,Definition of Assessment,
Definition of Assessment,Joanna Rose Saculo
67.3K vistas33 diapositivas
Types of Test por
Types of TestTypes of Test
Types of Testirshad narejo
119.2K vistas13 diapositivas

Destacado(12)

Assessment of Work Ethics in Middle East por Ajay Bhati
Assessment of Work Ethics in Middle EastAssessment of Work Ethics in Middle East
Assessment of Work Ethics in Middle East
Ajay Bhati2.2K vistas
Detecting Unethical practices at Supplier Factories por Musabbirul Islam
Detecting Unethical practices at Supplier FactoriesDetecting Unethical practices at Supplier Factories
Detecting Unethical practices at Supplier Factories
Musabbirul Islam1.1K vistas
Formative Assessment vs. Summative Assessment por jcheek2008
Formative Assessment vs. Summative AssessmentFormative Assessment vs. Summative Assessment
Formative Assessment vs. Summative Assessment
jcheek2008171.3K vistas
Test and some test types (ev elt) por theryszard
Test and some test types (ev elt)Test and some test types (ev elt)
Test and some test types (ev elt)
theryszard35.4K vistas
Types of assessment por cwhinsch
Types of assessmentTypes of assessment
Types of assessment
cwhinsch116.1K vistas
Unethical advertisements por Amit Gehi
Unethical advertisementsUnethical advertisements
Unethical advertisements
Amit Gehi146.3K vistas
Types of Test por jasper gaboc
Types of Test Types of Test
Types of Test
jasper gaboc66.8K vistas

Similar a Assessment and testing language

Summary on LANGUAGE TESTING & ASSESSMENT (Part I) Alderson & Banerjee por
Summary on LANGUAGE TESTING & ASSESSMENT (Part I) Alderson & Banerjee Summary on LANGUAGE TESTING & ASSESSMENT (Part I) Alderson & Banerjee
Summary on LANGUAGE TESTING & ASSESSMENT (Part I) Alderson & Banerjee MissJillSmith
2.9K vistas30 diapositivas
Tsl 3123 Language Assessment Module ppg por
Tsl 3123 Language Assessment Module ppgTsl 3123 Language Assessment Module ppg
Tsl 3123 Language Assessment Module ppgRavi Nair
6.4K vistas125 diapositivas
8. brown & hudson 1998 the alternatives in language assessment por
8. brown & hudson 1998 the alternatives in language assessment8. brown & hudson 1998 the alternatives in language assessment
8. brown & hudson 1998 the alternatives in language assessmentCate Atehortua
980 vistas23 diapositivas
Communicative testing por
Communicative testingCommunicative testing
Communicative testingSamcruz5
10.2K vistas16 diapositivas
Communicative Testing por
Communicative TestingCommunicative Testing
Communicative TestingSamcruz5
808 vistas16 diapositivas
Communicative language testing por
Communicative language testingCommunicative language testing
Communicative language testingIda Mantra
27.4K vistas48 diapositivas

Similar a Assessment and testing language(20)

Summary on LANGUAGE TESTING & ASSESSMENT (Part I) Alderson & Banerjee por MissJillSmith
Summary on LANGUAGE TESTING & ASSESSMENT (Part I) Alderson & Banerjee Summary on LANGUAGE TESTING & ASSESSMENT (Part I) Alderson & Banerjee
Summary on LANGUAGE TESTING & ASSESSMENT (Part I) Alderson & Banerjee
MissJillSmith2.9K vistas
Tsl 3123 Language Assessment Module ppg por Ravi Nair
Tsl 3123 Language Assessment Module ppgTsl 3123 Language Assessment Module ppg
Tsl 3123 Language Assessment Module ppg
Ravi Nair6.4K vistas
8. brown & hudson 1998 the alternatives in language assessment por Cate Atehortua
8. brown & hudson 1998 the alternatives in language assessment8. brown & hudson 1998 the alternatives in language assessment
8. brown & hudson 1998 the alternatives in language assessment
Cate Atehortua980 vistas
Communicative testing por Samcruz5
Communicative testingCommunicative testing
Communicative testing
Samcruz510.2K vistas
Communicative Testing por Samcruz5
Communicative TestingCommunicative Testing
Communicative Testing
Samcruz5808 vistas
Communicative language testing por Ida Mantra
Communicative language testingCommunicative language testing
Communicative language testing
Ida Mantra27.4K vistas
Communicative language testing por Ida Mantra
Communicative language testingCommunicative language testing
Communicative language testing
Ida Mantra1.4K vistas
Pro questdocuments 2015-03-08 (1) por Rose Jedin
Pro questdocuments 2015-03-08 (1)Pro questdocuments 2015-03-08 (1)
Pro questdocuments 2015-03-08 (1)
Rose Jedin424 vistas
Communicative testing 1 por Samcruz5
Communicative testing 1Communicative testing 1
Communicative testing 1
Samcruz5699 vistas
Communicative Testing por Samcruz5
Communicative TestingCommunicative Testing
Communicative Testing
Samcruz5638 vistas
Learner Autonomy por nadiahhuda
Learner AutonomyLearner Autonomy
Learner Autonomy
nadiahhuda1.5K vistas
Alternative Assessment in EFL Classrooms Why and How to Implement It.pdf por Robin Beregovska
Alternative Assessment in EFL Classrooms  Why and How to Implement It.pdfAlternative Assessment in EFL Classrooms  Why and How to Implement It.pdf
Alternative Assessment in EFL Classrooms Why and How to Implement It.pdf
Robin Beregovska4 vistas
What does language testing have to offier por APSACS
What does language testing have to offierWhat does language testing have to offier
What does language testing have to offier
APSACS1.4K vistas
Action Research In Second Language Teacher Education por Cynthia King
Action Research In Second Language Teacher EducationAction Research In Second Language Teacher Education
Action Research In Second Language Teacher Education
Cynthia King3 vistas
Testing and Evaluation Strategies in Second Language Teaching.pptx por Subramanian Mani
Testing and Evaluation Strategies in Second Language Teaching.pptxTesting and Evaluation Strategies in Second Language Teaching.pptx
Testing and Evaluation Strategies in Second Language Teaching.pptx
Subramanian Mani22 vistas
Assessing the use of language learning strategies worldwide with the ESL and ... por mizzyatie14
Assessing the use of language learning strategies worldwide with the ESL and ...Assessing the use of language learning strategies worldwide with the ESL and ...
Assessing the use of language learning strategies worldwide with the ESL and ...
mizzyatie143.2K vistas

Último

ISO/IEC 27001 and ISO/IEC 27005: Managing AI Risks Effectively por
ISO/IEC 27001 and ISO/IEC 27005: Managing AI Risks EffectivelyISO/IEC 27001 and ISO/IEC 27005: Managing AI Risks Effectively
ISO/IEC 27001 and ISO/IEC 27005: Managing AI Risks EffectivelyPECB
585 vistas18 diapositivas
The Accursed House by Émile Gaboriau por
The Accursed House  by Émile GaboriauThe Accursed House  by Émile Gaboriau
The Accursed House by Émile GaboriauDivyaSheta
201 vistas15 diapositivas
Class 10 English lesson plans por
Class 10 English  lesson plansClass 10 English  lesson plans
Class 10 English lesson plansTARIQ KHAN
288 vistas53 diapositivas
Drama KS5 Breakdown por
Drama KS5 BreakdownDrama KS5 Breakdown
Drama KS5 BreakdownWestHatch
79 vistas2 diapositivas
ANATOMY AND PHYSIOLOGY UNIT 1 { PART-1} por
ANATOMY AND PHYSIOLOGY UNIT 1 { PART-1}ANATOMY AND PHYSIOLOGY UNIT 1 { PART-1}
ANATOMY AND PHYSIOLOGY UNIT 1 { PART-1}DR .PALLAVI PATHANIA
249 vistas195 diapositivas
When Sex Gets Complicated: Porn, Affairs, & Cybersex por
When Sex Gets Complicated: Porn, Affairs, & CybersexWhen Sex Gets Complicated: Porn, Affairs, & Cybersex
When Sex Gets Complicated: Porn, Affairs, & CybersexMarlene Maheu
67 vistas73 diapositivas

Último(20)

ISO/IEC 27001 and ISO/IEC 27005: Managing AI Risks Effectively por PECB
ISO/IEC 27001 and ISO/IEC 27005: Managing AI Risks EffectivelyISO/IEC 27001 and ISO/IEC 27005: Managing AI Risks Effectively
ISO/IEC 27001 and ISO/IEC 27005: Managing AI Risks Effectively
PECB 585 vistas
The Accursed House by Émile Gaboriau por DivyaSheta
The Accursed House  by Émile GaboriauThe Accursed House  by Émile Gaboriau
The Accursed House by Émile Gaboriau
DivyaSheta201 vistas
Class 10 English lesson plans por TARIQ KHAN
Class 10 English  lesson plansClass 10 English  lesson plans
Class 10 English lesson plans
TARIQ KHAN288 vistas
Drama KS5 Breakdown por WestHatch
Drama KS5 BreakdownDrama KS5 Breakdown
Drama KS5 Breakdown
WestHatch79 vistas
When Sex Gets Complicated: Porn, Affairs, & Cybersex por Marlene Maheu
When Sex Gets Complicated: Porn, Affairs, & CybersexWhen Sex Gets Complicated: Porn, Affairs, & Cybersex
When Sex Gets Complicated: Porn, Affairs, & Cybersex
Marlene Maheu67 vistas
UWP OA Week Presentation (1).pptx por Jisc
UWP OA Week Presentation (1).pptxUWP OA Week Presentation (1).pptx
UWP OA Week Presentation (1).pptx
Jisc88 vistas
Education and Diversity.pptx por DrHafizKosar
Education and Diversity.pptxEducation and Diversity.pptx
Education and Diversity.pptx
DrHafizKosar173 vistas
Narration ppt.pptx por TARIQ KHAN
Narration  ppt.pptxNarration  ppt.pptx
Narration ppt.pptx
TARIQ KHAN135 vistas
Class 10 English notes 23-24.pptx por TARIQ KHAN
Class 10 English notes 23-24.pptxClass 10 English notes 23-24.pptx
Class 10 English notes 23-24.pptx
TARIQ KHAN131 vistas
Scope of Biochemistry.pptx por shoba shoba
Scope of Biochemistry.pptxScope of Biochemistry.pptx
Scope of Biochemistry.pptx
shoba shoba133 vistas
Sociology KS5 por WestHatch
Sociology KS5Sociology KS5
Sociology KS5
WestHatch70 vistas
11.30.23 Poverty and Inequality in America.pptx por mary850239
11.30.23 Poverty and Inequality in America.pptx11.30.23 Poverty and Inequality in America.pptx
11.30.23 Poverty and Inequality in America.pptx
mary850239160 vistas
REPRESENTATION - GAUNTLET.pptx por iammrhaywood
REPRESENTATION - GAUNTLET.pptxREPRESENTATION - GAUNTLET.pptx
REPRESENTATION - GAUNTLET.pptx
iammrhaywood100 vistas
Are we onboard yet University of Sussex.pptx por Jisc
Are we onboard yet University of Sussex.pptxAre we onboard yet University of Sussex.pptx
Are we onboard yet University of Sussex.pptx
Jisc96 vistas
JiscOAWeek_LAIR_slides_October2023.pptx por Jisc
JiscOAWeek_LAIR_slides_October2023.pptxJiscOAWeek_LAIR_slides_October2023.pptx
JiscOAWeek_LAIR_slides_October2023.pptx
Jisc96 vistas

Assessment and testing language

  • 1. María Lucely Kantún Tzuc Universidad Vizcaya de las Américas Campus Chetumal
  • 2. DEFINITION: The process of making a judgment or forming an opinion, after considering something or someone carefully. PURPOSE: Inform people about their progress in learning.
  • 4. Tests or exams. The most traditional form of assess students.
  • 6. Self-assessment. Student assess by themselves their own learning.
  • 7. When do teachers should assess? All the stage of the learning process. Very frequently. Assessment Assessment Assessment
  • 9. WASHBACK It refers to te impact that tests have on teaching and learning.
  • 10. Alderson and Wall (1993) list some «Washback Hypostheses» Tests will have washback on what teachers teach (Content). Tests also have impact on how teachers teach (methodology). High-stakes tets (tests with important consequences)would have more impact than low-stakes tests.
  • 11.  Alderson and Hamp-Lyons (1996) show that teachers may indeed change the way they teachwhen teaching towards a test (in this case, theTOEFL —Test of English as a Foreign Language).  They show that the nature of the change and the methodology adopted varies from teacher to teacher (supported by Watanabe’s findings, 1996).
  • 12.  Shohamy et al, (1996) show that the nature of washback varies according to factors such as the status of the language being tested, and the uses of the test.  Watanabe concludes that washback is caused by the interplay between the test and the test taker in a complex manner.  He emphasises that what may be most important is not the objective difficulty of the test, but the students' perception of difficulty.
  • 13. Wall summarises research findings which show that test design is only one of the factors affecting washback, and lists as factors influencing the nature of test washback. She makes a number of recommendations about the steps that test developers might take in the future in order to assess the amount of risk involved in attempting to bring about change through testing:  assessing the feasibility of examination reform by studying the 'antecedent' conditions —what is increasingly referred to as a 'baseline study‘
  • 14.  Policy makers should be aware that tests on their own will not have positive impact if the materials and practices they are based on have not been effective.
  • 15.  Messick (1994) argues that all testing involves making value judgements, and therefore language testing is open to a critical discussion of whose values are being represented and served.  Spolsky (1997) points out that tests and examinations have always been used as instruments of social policy and control, with the gate- keeping function of tests often justifying their existence.  Shohamy (1997a) argues that uses of tests which exercise control and manipulate stakeholders rather than providing information on proficiency levels are also unethical, and she advocates the development of “critical language testing”
  • 16.  A number of case studies have been presented recently which illustrate the use and misuse of language tests.  Hawthorne (1997) describes two examples of the misuse of language tests: the use of the access test to regulate the flow of migrants into Australia, and the step test, allegedly designed to play a central role in the determining of asylum seekers‘ residential status.  Norton and Starfield (1997) argue that criteria for assessment should be made explicit and public if testers are to behave ethically.
  • 17.  The International Language Testing Association (ILTA) has recently developed a Code of Ethics (rather than finalising the draft Code of Practice referred to above), which is 'a set of principles which draws upon moral philosophy and strives to guide good professional conduct.  This Code is clear: testers should follow ethical practices, and have a moral responsibility to do so.
  • 18.  Tests are frequently used as instruments of educational policy, and they can be very powerful — as attested by Shohamy (2001a).  Brindley (1998,2001) describes the political use of test- based assessment for reasons of public accountabilty, often in the context of national frameworks, standards or benchmarking.  Politics can be defined as action, or activities, to achieve power or to use power, and as beliefs about government, attitudes to power, and to the use of power.
  • 19.  National educational policy often involves innovations in testing in order to influence the curriculum, or in order to open up or restrict access to education and employment.  Politics can be seen as methods, tactics, intrigue, manoeuvring, within institutions which are themselves not political, but commercial, financial and educational.
  • 21. Levels of proficiency Level certified by public examinations Guarantee educational and employment mobility EUROPEAN COMMON FRAMEWORK
  • 22.  The development of national language tests continues to be the focus of many publications, although many are either simply descriptions of test development or discussions of controversies, rather than reports on research done in connection with test development.  Page (1993) argues that the use of the target language in questions makes it more difficult to sample the syllabus adequately, and claims that the more communicative and authentic the tasks in examinations become, the more English (the mother tongue) has to be used on the examination paper in order to safeguard both the validity and the authenticityof the task.
  • 23.  In the Netherlands (Jansen &Peer, 1999) reports a study of the recently introduced use of dictionaries in Dutch foreign language examinations and shows that dictionary use does not have any significant effect on test scores.  Pupils are very positive about being allowed to use dictionaries, claiming that it reduces anxiety and enhances their text comprehension.  Guillon (1997) recommends that more open-ended tasks be used, and that teachers be trained in the reliable use of valid criteria for subjective marking, instead of their current practice of merely counting errors in production.
  • 24.  Language testing can inform debates in language education more generally.  Washback studies have also been used in teacher training, both in order to influence test preparation practices, but also to encourage teachers to reflect on the reasons for their and others' practices.
  • 25.  Douglas (1997, 2000) identifies two aspects that typically distinguish LSP testing from general purpose testing. a) The authenticity of the tasks, b) The interaction between language knowledge and specific content knowledge.  The development of an LSP test typically begins with an in- depth analysis of the target language use situation, perhaps using genre analysis (see Tarone,2001).  Attention is paid to general situational features such as topics, typical lexis and grammatical structures.
  • 26.  Douglas (2000) stands firmly by claims made much earlier in the decade that in highly field-specific language contexts, a field-specific language test is a better predictor of performance than a general purpose test (Douglas & Selinker, 1992)
  • 27.  Computer-based testing has witnessed rapid growth in the past decade and computers are now used to deliver language tests in many settings.  A computerbased version of the TOEFL was introduced on a regional basis in the summer of 1998, tests are now available on CD ROM, and the Internet is increasingly used to deliver tests to users.  Computers can be used at all stages in the test development and administration process.  The commonest use of computers in language testing is to deliver tests adaptively (e.g.,Young et al.,1996).
  • 28. Computer based- testing advantages Candidates are presented with items at their level of ability. computer-adaptive tests (CATs) are typically quicker to deliver.
  • 29.  The introduction of self-assessment was viewed aspromising by many, especially in formative assessment contexts (Oscarson, 1989).  It was considered to encourage increasing sophistication in learner awareness, helping learners to: A) gain confidence in their own judgement. B) acquire a view of evaluation that covers the whole learning process. C) see errors as something helpful.  It was also seen to be potentially useful to teachers, providing information on learning styles, on areas needing remediation and feedback on teaching (Barbot, 1991)
  • 30.  Carton (1993) discusses how self-assessment can become part of the learning process.  In general, these studies have found self-assessment to be a robust method for gathering information about learner proficiency and that the risk of cheating is low (see Barbot, 1991).
  • 31.  It is usually taken to mean assessment procedures which are less formal than traditional testing, which are gathered over a period of time rather than being taken at one point in time, which are usually formative  rather than summative in function, are often  low-stakes in terms of consequences, and are claimed  to have beneficial washback effects. Although such  procedures may be time-consuming and not very  easy to administer and score, their claimed advantages  are that they provide easily understood information,  they are more integrative than traditional tests and  they are more easily integrated into the classroom.  McNamara (1998) makes the point that alternative  assessment procedures are often developed in an  attempt to make testing and assessment