SlideShare una empresa de Scribd logo
1 de 10
Iterative Selection
Instructions for Test Takers, part 1 of 2:

  Answer each question by selecting
  the option that you think most closely
  corresponds to the right answer.
  If you get it wrong you can have a
  second go, and then a third go if
  necessary, or you can choose to give
  up at any time.
Instructions for Test Takers, part 2 of 2:

  Your mark will be +3, +1, -1 or -3
  depending respectively on whether
  you selected the right answer on your
  1st, 2nd or 3rd attempt, or not at all.

  If you give up then your mark will be
  the average of the remaining available
  marks.
Iterative selection yields more reliable
test scores compared with traditional
multiple-choice tests because:

1) it allows Test Takers to identify
   their 2nd and 3rd choice options,
   so it rewards those who have some
   partial knowledge,

2) it discourages pure guesswork.
Iterative selection is also known as
“answer until correct”, which is quite
a self-explanatory name.

The marking scheme (+3, +1, -1 or -3)
discourages pure guesswork because
Test Takers are just as likely to lose
marks as to gain marks if they make
random selections.
Test Takers may also choose to give up
at any point, in which case their mark
will be the average of the remaining
available marks.

So if they give up after one incorrect
selection their mark will be -1; if they
give up after two incorrect selections
their mark will be -2.
Consider the following
multiple-choice
question.
Only one of the options
A, B, C and D is correct.
                         Most spiders have...

                             A) 2 wings
                             B) 4 legs
                             C) 6 ears
                             D) 8 eyes
Suppose that a
particular Test Taker
believes that options A
and B are both
incorrect.
In a traditional test Most spiders have...
they must then choose
either C or D, and they
will either get the      A) 2 wings ✘
maximum mark or the
minimum mark for that    B) 4 legs     ✘
question, which could
be a minus mark if       C) 6 ears      ?
negative marking is
used.                    D) 8 eyes      ?
(See our presentation
on negative marking for
a fuller explanation.)
In fact D is the right
answer, so their mark
will be +3 or +1.
If they select D first in
the belief that D seems
more likely to be      Most spiders have...
correct than C, they
will be rewarded with
full marks.               A) 2 wings ✘
However, if they believe   B) 4 legs
that C is more likely to
                                          ✘
be correct then at
least they will get +1,
                           C) 6 ears      ?    ✘ +1
which seems fairer
than getting nothing,
                           D) 8 eyes      ?    ✔ +3
and much fairer than
getting a negative
mark!                                  Score = +3 or +1
To conclude, here’s the third slide again...


   Iterative selection yields more reliable
   test scores compared with traditional
   multiple-choice tests because:

   1) it allows Test Takers to identify
      their 2nd and 3rd choice options,
      so it rewards those who have some
      partial knowledge,

   2) it discourages pure guesswork.
Thank you for viewing this presentation!
          www.ProperTests.com

Más contenido relacionado

Destacado

Ucan do-iwbs
Ucan do-iwbsUcan do-iwbs
Ucan do-iwbsjohnp
 
Computer Games Based Learning in Scottish Schools
Computer Games Based Learning in Scottish SchoolsComputer Games Based Learning in Scottish Schools
Computer Games Based Learning in Scottish SchoolsOllie Bray
 
OKoloogiline Uus Veeb Ja Selle Kasutamine Keskkonnahariduses
OKoloogiline Uus Veeb Ja Selle Kasutamine KeskkonnaharidusesOKoloogiline Uus Veeb Ja Selle Kasutamine Keskkonnahariduses
OKoloogiline Uus Veeb Ja Selle Kasutamine KeskkonnaharidusesKai Pata
 
Kogukondjavorgustik
KogukondjavorgustikKogukondjavorgustik
KogukondjavorgustikKai Pata
 
CRM & HE
CRM & HECRM & HE
CRM & HEscottw
 
Getting the Maximum Benefit from Free and Open Source Software
Getting the Maximum Benefit from Free and Open Source SoftwareGetting the Maximum Benefit from Free and Open Source Software
Getting the Maximum Benefit from Free and Open Source Softwarescottw
 
Hayley Designers
Hayley DesignersHayley Designers
Hayley DesignersOllie Bray
 
The Awaited Savior
The Awaited SaviorThe Awaited Savior
The Awaited Saviorzain
 
Fours And Fives
Fours And FivesFours And Fives
Fours And Fivesrwstip
 
Learninganalytic 2015
Learninganalytic 2015Learninganalytic 2015
Learninganalytic 2015Kai Pata
 
Making Games Based Learning Work in Secondary Schools
Making Games Based Learning Work in Secondary SchoolsMaking Games Based Learning Work in Secondary Schools
Making Games Based Learning Work in Secondary SchoolsOllie Bray
 
How to engage students in real open source projects
How to engage students in real open source projectsHow to engage students in real open source projects
How to engage students in real open source projectsscottw
 
Geocaching
GeocachingGeocaching
Geocachingbbelardi
 
HAPPY VALENTINE'S DAY NICOLE!!
HAPPY VALENTINE'S DAY NICOLE!!HAPPY VALENTINE'S DAY NICOLE!!
HAPPY VALENTINE'S DAY NICOLE!!tm_marino
 
Widgets and Mashups for Personal and Institutional Technologies
Widgets and Mashups for Personal and Institutional Technologies Widgets and Mashups for Personal and Institutional Technologies
Widgets and Mashups for Personal and Institutional Technologies scottw
 

Destacado (19)

Ch01
Ch01Ch01
Ch01
 
Ucan do-iwbs
Ucan do-iwbsUcan do-iwbs
Ucan do-iwbs
 
Computer Games Based Learning in Scottish Schools
Computer Games Based Learning in Scottish SchoolsComputer Games Based Learning in Scottish Schools
Computer Games Based Learning in Scottish Schools
 
OKoloogiline Uus Veeb Ja Selle Kasutamine Keskkonnahariduses
OKoloogiline Uus Veeb Ja Selle Kasutamine KeskkonnaharidusesOKoloogiline Uus Veeb Ja Selle Kasutamine Keskkonnahariduses
OKoloogiline Uus Veeb Ja Selle Kasutamine Keskkonnahariduses
 
Experiences with social media
Experiences with social mediaExperiences with social media
Experiences with social media
 
Kogukondjavorgustik
KogukondjavorgustikKogukondjavorgustik
Kogukondjavorgustik
 
CRM & HE
CRM & HECRM & HE
CRM & HE
 
Getting the Maximum Benefit from Free and Open Source Software
Getting the Maximum Benefit from Free and Open Source SoftwareGetting the Maximum Benefit from Free and Open Source Software
Getting the Maximum Benefit from Free and Open Source Software
 
Hayley Designers
Hayley DesignersHayley Designers
Hayley Designers
 
The Awaited Savior
The Awaited SaviorThe Awaited Savior
The Awaited Savior
 
Proeven aan Proeve HvA 15 april 2010
Proeven aan Proeve HvA 15 april 2010Proeven aan Proeve HvA 15 april 2010
Proeven aan Proeve HvA 15 april 2010
 
Fours And Fives
Fours And FivesFours And Fives
Fours And Fives
 
Learninganalytic 2015
Learninganalytic 2015Learninganalytic 2015
Learninganalytic 2015
 
Mets1
Mets1Mets1
Mets1
 
Making Games Based Learning Work in Secondary Schools
Making Games Based Learning Work in Secondary SchoolsMaking Games Based Learning Work in Secondary Schools
Making Games Based Learning Work in Secondary Schools
 
How to engage students in real open source projects
How to engage students in real open source projectsHow to engage students in real open source projects
How to engage students in real open source projects
 
Geocaching
GeocachingGeocaching
Geocaching
 
HAPPY VALENTINE'S DAY NICOLE!!
HAPPY VALENTINE'S DAY NICOLE!!HAPPY VALENTINE'S DAY NICOLE!!
HAPPY VALENTINE'S DAY NICOLE!!
 
Widgets and Mashups for Personal and Institutional Technologies
Widgets and Mashups for Personal and Institutional Technologies Widgets and Mashups for Personal and Institutional Technologies
Widgets and Mashups for Personal and Institutional Technologies
 

Último

Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in DelhiRussian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhikauryashika82
 
Application orientated numerical on hev.ppt
Application orientated numerical on hev.pptApplication orientated numerical on hev.ppt
Application orientated numerical on hev.pptRamjanShidvankar
 
Role Of Transgenic Animal In Target Validation-1.pptx
Role Of Transgenic Animal In Target Validation-1.pptxRole Of Transgenic Animal In Target Validation-1.pptx
Role Of Transgenic Animal In Target Validation-1.pptxNikitaBankoti2
 
Z Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot GraphZ Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot GraphThiyagu K
 
Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104misteraugie
 
Food Chain and Food Web (Ecosystem) EVS, B. Pharmacy 1st Year, Sem-II
Food Chain and Food Web (Ecosystem) EVS, B. Pharmacy 1st Year, Sem-IIFood Chain and Food Web (Ecosystem) EVS, B. Pharmacy 1st Year, Sem-II
Food Chain and Food Web (Ecosystem) EVS, B. Pharmacy 1st Year, Sem-IIShubhangi Sonawane
 
The basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxThe basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxheathfieldcps1
 
General Principles of Intellectual Property: Concepts of Intellectual Proper...
General Principles of Intellectual Property: Concepts of Intellectual  Proper...General Principles of Intellectual Property: Concepts of Intellectual  Proper...
General Principles of Intellectual Property: Concepts of Intellectual Proper...Poonam Aher Patil
 
Unit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxUnit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxVishalSingh1417
 
ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.MaryamAhmad92
 
Sociology 101 Demonstration of Learning Exhibit
Sociology 101 Demonstration of Learning ExhibitSociology 101 Demonstration of Learning Exhibit
Sociology 101 Demonstration of Learning Exhibitjbellavia9
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdfQucHHunhnh
 
microwave assisted reaction. General introduction
microwave assisted reaction. General introductionmicrowave assisted reaction. General introduction
microwave assisted reaction. General introductionMaksud Ahmed
 
psychiatric nursing HISTORY COLLECTION .docx
psychiatric  nursing HISTORY  COLLECTION  .docxpsychiatric  nursing HISTORY  COLLECTION  .docx
psychiatric nursing HISTORY COLLECTION .docxPoojaSen20
 
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...christianmathematics
 
How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17Celine George
 
Making and Justifying Mathematical Decisions.pdf
Making and Justifying Mathematical Decisions.pdfMaking and Justifying Mathematical Decisions.pdf
Making and Justifying Mathematical Decisions.pdfChris Hunter
 
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...Nguyen Thanh Tu Collection
 
Measures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SDMeasures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SDThiyagu K
 

Último (20)

Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in DelhiRussian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
 
Application orientated numerical on hev.ppt
Application orientated numerical on hev.pptApplication orientated numerical on hev.ppt
Application orientated numerical on hev.ppt
 
Role Of Transgenic Animal In Target Validation-1.pptx
Role Of Transgenic Animal In Target Validation-1.pptxRole Of Transgenic Animal In Target Validation-1.pptx
Role Of Transgenic Animal In Target Validation-1.pptx
 
Z Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot GraphZ Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot Graph
 
Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104
 
Food Chain and Food Web (Ecosystem) EVS, B. Pharmacy 1st Year, Sem-II
Food Chain and Food Web (Ecosystem) EVS, B. Pharmacy 1st Year, Sem-IIFood Chain and Food Web (Ecosystem) EVS, B. Pharmacy 1st Year, Sem-II
Food Chain and Food Web (Ecosystem) EVS, B. Pharmacy 1st Year, Sem-II
 
The basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxThe basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptx
 
General Principles of Intellectual Property: Concepts of Intellectual Proper...
General Principles of Intellectual Property: Concepts of Intellectual  Proper...General Principles of Intellectual Property: Concepts of Intellectual  Proper...
General Principles of Intellectual Property: Concepts of Intellectual Proper...
 
Unit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxUnit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptx
 
ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.
 
Sociology 101 Demonstration of Learning Exhibit
Sociology 101 Demonstration of Learning ExhibitSociology 101 Demonstration of Learning Exhibit
Sociology 101 Demonstration of Learning Exhibit
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
 
microwave assisted reaction. General introduction
microwave assisted reaction. General introductionmicrowave assisted reaction. General introduction
microwave assisted reaction. General introduction
 
Asian American Pacific Islander Month DDSD 2024.pptx
Asian American Pacific Islander Month DDSD 2024.pptxAsian American Pacific Islander Month DDSD 2024.pptx
Asian American Pacific Islander Month DDSD 2024.pptx
 
psychiatric nursing HISTORY COLLECTION .docx
psychiatric  nursing HISTORY  COLLECTION  .docxpsychiatric  nursing HISTORY  COLLECTION  .docx
psychiatric nursing HISTORY COLLECTION .docx
 
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
 
How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17
 
Making and Justifying Mathematical Decisions.pdf
Making and Justifying Mathematical Decisions.pdfMaking and Justifying Mathematical Decisions.pdf
Making and Justifying Mathematical Decisions.pdf
 
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
 
Measures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SDMeasures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SD
 

Iterative selection v2

  • 1. Iterative Selection Instructions for Test Takers, part 1 of 2: Answer each question by selecting the option that you think most closely corresponds to the right answer. If you get it wrong you can have a second go, and then a third go if necessary, or you can choose to give up at any time.
  • 2. Instructions for Test Takers, part 2 of 2: Your mark will be +3, +1, -1 or -3 depending respectively on whether you selected the right answer on your 1st, 2nd or 3rd attempt, or not at all. If you give up then your mark will be the average of the remaining available marks.
  • 3. Iterative selection yields more reliable test scores compared with traditional multiple-choice tests because: 1) it allows Test Takers to identify their 2nd and 3rd choice options, so it rewards those who have some partial knowledge, 2) it discourages pure guesswork.
  • 4. Iterative selection is also known as “answer until correct”, which is quite a self-explanatory name. The marking scheme (+3, +1, -1 or -3) discourages pure guesswork because Test Takers are just as likely to lose marks as to gain marks if they make random selections.
  • 5. Test Takers may also choose to give up at any point, in which case their mark will be the average of the remaining available marks. So if they give up after one incorrect selection their mark will be -1; if they give up after two incorrect selections their mark will be -2.
  • 6. Consider the following multiple-choice question. Only one of the options A, B, C and D is correct. Most spiders have... A) 2 wings B) 4 legs C) 6 ears D) 8 eyes
  • 7. Suppose that a particular Test Taker believes that options A and B are both incorrect. In a traditional test Most spiders have... they must then choose either C or D, and they will either get the A) 2 wings ✘ maximum mark or the minimum mark for that B) 4 legs ✘ question, which could be a minus mark if C) 6 ears ? negative marking is used. D) 8 eyes ? (See our presentation on negative marking for a fuller explanation.)
  • 8. In fact D is the right answer, so their mark will be +3 or +1. If they select D first in the belief that D seems more likely to be Most spiders have... correct than C, they will be rewarded with full marks. A) 2 wings ✘ However, if they believe B) 4 legs that C is more likely to ✘ be correct then at least they will get +1, C) 6 ears ? ✘ +1 which seems fairer than getting nothing, D) 8 eyes ? ✔ +3 and much fairer than getting a negative mark! Score = +3 or +1
  • 9. To conclude, here’s the third slide again... Iterative selection yields more reliable test scores compared with traditional multiple-choice tests because: 1) it allows Test Takers to identify their 2nd and 3rd choice options, so it rewards those who have some partial knowledge, 2) it discourages pure guesswork.
  • 10. Thank you for viewing this presentation! www.ProperTests.com