Recomendados
Más contenido relacionado
La actualidad más candente
La actualidad más candente (20)
Destacado
Destacado (17)
Similar a 2014 what-is-a-cat-narrated
Similar a 2014 what-is-a-cat-narrated (20)
Último
Último (20)
2014 what-is-a-cat-narrated
- 2. Introduction
- 3. What is a CAT?
- 4. What is a CAT? COMPUTER ADAPTIVE TEST + performance task
- 5. What is a CAT? COMPUTER ADAPTIVE TEST Often referred to as C-A-T or a CAT.
- 6. The Computer Part of a CAT
- 7. What is a CAT? COMPUTER
- 8. What is a CAT? • more efficient and appropriate for students than a typical paper-and-pencil test COMPUTER
- 9. What is a CAT? •allows students to have more engaging test questions from the real world COMPUTER
- 10. What is a CAT? Items might include: • videos or audio, • PowerPoint slides, or • interactive test questions. COMPUTER
- 11. What is a CAT? • allow students flexibility and accessibility • put the student in control • give access to helpful tools and resources COMPUTERS
- 12. What is a CAT? Usability, Accessibility and Accommodations Guidelines Can be found on the Smarter Balanced website.
- 13. The Test Part of a CAT
- 14. What is a CAT? TEST The Smarter Balanced Test is designed to assess how well a student has mastered the expectations of the Common Core State Standards in both English language arts or mathematics for his or her grade level.
- 15. The Adaptive Part of a CAT
- 16. What is a CAT? ADAPTIVE COMPUTER ADAPTIVE TEST
- 17. What is a CAT? In the adaptive portion of Smarter Balanced tests, the questions (or items) are chosen for each student so that the test is neither too hard nor too easy. ADAPTIVE
- 18. What is a CAT? While the CAT is adaptive, it operates from logical rules that can be inspected or examined, and that are known and published. ADAPTIVE
- 19. What is a CAT? COMPUTER ADAPTIVE TEST Provides a unique and effective way to test what a student has learned.
- 20. What is a CAT? COMPUTER ADAPTIVE TEST ? ? ? ? ? ? ?
- 21. Copyright 2013 by Educational Testing Service. All rights reserved.
- 22. How can a CAT do that?
- 23. What is a CAT? How can a CAT do that? 1) Bank of Test Items 2) A Recommended Blueprint 3) Programming (or Algorithm) 4) Algorithm Constraints
- 24. What is a CAT?
- 25. What is a CAT? ? ? ? ? ? ?
- 26. What is a CAT? ? ? ? ? ? ?
- 27. What is a CAT? How does it know which question to pick?
- 28. What is a CAT? Test Blueprint • focuses the selection of questions from the test bank to the appropriate content so the structure of the test is similar for every student • selects the precise questions based on the individual student’s responses to previous questions in the test
- 29. What is a CAT?
- 30. What is a CAT? Important Rules to make the test Balance (enough of the concept?) Question Type (Selected Response? Constructed Response?) Reading Length (Short? Medium? Long?) Difficulty (appropriate for the grade level?)
- 31. How does a CAT work for the student?
- 32. What is a CAT? How will it work for me?
- 33. How will it work for the student? The test starts with an item from a pre- determined difficulty level. It may be based on average difficulty for the grade, or it may be based on information known about the student from previous tests.
- 34. How will it work for the student? Question Selection The student receives questions based on his or her response to the previous questions. The computer program quickly selects a new question after reviewing how well the student performed on all the previous questions. Based on the responses, the program selects a question that fits the test blueprint and gives the best information about what the student knows. This is how a CAT can customize each test so it is an accurate measure of any student’s skills.
- 35. How will it work for the student? Questions will ADAPT If the student continues to answer questions correctly, the questions covering the blueprint will continue to get more challenging. If the student starts missing the answers to questions, the program will start to select questions that are easier. The program adapts to how the student is performing.
- 36. How will it work for the student? Responses Because the program knows which questions are harder and which are easier, several students may have answered a similar number of questions correctly, but the student who has answered the more challenging questions correctly will achieve a higher score.
- 37. How will it work for the student? That's it! A student’s score is based on the difficulty of the items that were right or wrong, not on the total number of correct answers. Of course, it all seems so simple when described like this. But there is a very complex process happening within the CAT engine to make all of these determinations simultaneously with predictability built in.
- 38. CAT Review
- 39. CAT Defined Introduction Let's review the parts that make up a CAT — COMPUTER ADAPTIVE TEST Computer Adaptive Test
- 40. CAT Defined The COMPUTER is important in CAT because: •it makes the test more efficient and appropriate for every student; •it allows students more flexibility and accessibility during testing; and •it has the ability to include videos, audio, PowerPoint slides, and interactive test items. Computer Adaptive Test
- 41. CAT Defined The ADAPTIVE part of the CAT makes the test unique for every student: • it looks to see if the student response is correct; and •it selects the next question to build a custom-made test for each student. Computer Test Adaptive
- 42. CAT Defined The Smarter Balanced TEST is testing how well a student has mastered the expectations of the Common Core State Standards in • English language arts (ELA) and • mathematics. The test ends when the student has answered a sufficient number of questions that satisfy the requirements of the blueprint and provide a good estimate of the student’s proficiency. Computer Adaptive Test
- 44. What is a CAT? How does a CAT provide better assessment results? With a CAT, each student will demonstrate the level of his or her content knowledge based on the item selection that adjusts to his or her particular responses.
- 45. How does a CAT provide better assessment results? It is ACCURATE It is INDIVIDUALIZED It is SECURE It is EFFICIENT It delivers FAST RESULTS This provides a testing experience that is a more accurate way to evaluate mastery of a subject by minimizing the difference between what a test score indicates and a student’s actual knowledge and abilities.
- 46. How does a CAT provide better assessment results? It is ACCURATE It is INDIVIDUALIZED It is SECURE It is EFFICIENT It delivers FAST RESULTS Because the program knows which questions are harder and which are easier, the student will see items that are neither too easy nor too hard.
- 47. How does a CAT provide better assessment results? It is ACCURATE It is INDIVIDUALIZED It is SECURE It is EFFICIENT It delivers FAST RESULTS Not all students receive the same questions; therefore, cheating is more difficult than it would be on a paper test with fewer items and with paper forms that can be copied.
- 48. How does a CAT provide better assessment results? It is ACCURATE It is INDIVIDUALIZED It is SECURE It is EFFICIENT It delivers FAST RESULTS It provides items in an order that best determines a student’s proficiency.
- 49. How does a CAT provide better assessment results? It is ACCURATE It is INDIVIDUALIZED It is SECURE It is EFFICIENT It delivers FAST RESULTS Many items are scored in real time by the computer. Student test scores and reports are not delivered until the entire test, including parts requiring human scoring, has been evaluated.
- 50. How does a CAT provide better assessment results? It is ACCURATE It is INDIVIDUALIZED It is SECURE It is EFFICIENT It delivers FAST RESULTS The students’ testing experience will be their very own and provides them with the chance to show what they know.
- 51. What is a CAT? Now you know!
Notas del editor
- What is a CAT?
- Students in your state will be taking the Smarter Balanced Assessment based on the Common Core State Standards.
- The Smarter Balanced Assessment includes both a Computer Adaptive Test component and a performance task component.
- This Computer Adaptive Test is often referred to as C-A-T or a CAT.
- Two of the words used in “Computer Adaptive Test” are likely not new to you.
- The word “COMPUTER” is important for a Computer Adaptive Test because the computer makes this kind of test much more efficient and appropriate for students than a typical paper-and-pencil test.
- Using a computer allows students to have more engaging test questions from the real world.
- Items might include videos or audio, PowerPoint slides, or interactive test questions.
- Computers also allow students more flexibility and accessibility during testing than taking paper-and-pencil tests. For example, when tests are delivered on computers, students may have the ability to control text size and audio volume. They may also have access to tools such as online calculators and glossaries.
- For a full listing of the available universal tools, accommodations, and designated supports, please refer to the Usability, Accessibility, and Accommodations Guidelines found on the Smarter Balanced website. Each student will have access to all universal tools, as well as any accommodations and designated supports they usually are given with other tests.
- The word, “TEST,” is certainly something you’re familiar with. The Smarter Balanced test is designed to assess how well a student has mastered the expectations of the Common Core State Standards in both English language arts or mathematics for his or her grade level.
- The keyword in the phrase — COMPUTER ADAPTIVE TEST — is “ADAPTIVE”.
- In the adaptive portion of the Smarter Balanced tests, the questions (often referred to as items) are chosen for each student so that the test is neither too hard nor too easy.
- While the CAT is adaptive, it operates from logical rules that can be inspected or examined, and that are known and published.
- We have adapted our CAT to provide a unique and effective way to test what a student has learned.
- ADAPTIVE is what makes the CAT different from other traditional tests by making the test unique for every student. The CAT assessments automatically adjust to fit the ability level demonstrated by a student. The computer looks at a student’s response to an item to see if it was answered correctly.
- And, quickly, along with the test’s blueprint requirements, the computer programming selects the next question. In this way, the computer ADAPTS as it gains information about the student and builds a custom-made test for each student as it moves along. A student may or may not receive the same items as his or her friends. Each test is dynamically built to the ability level of the individual student. In addition, the student’s score is intended to be more precise than a paper-and-pencil assessment could offer, since the assessment was tailored to the student’s ability.
- HOW CAN A CAT DO THAT? There are 4 CAT elements working simultaneously to make this happen: 1) Bank of Test Items 2) A Recommended Blueprint 3) Programming (or Algorithm) and 4) Algorithm Constraints
- The first element is a large bank of field-tested items covering all areas the test is designed to assess. There are many items across all difficulty levels, including some that are more challenging and some that are less challenging. During the test, each item is selected based upon answers to previous items.
- Smarter Balanced has created tens of thousands of items. These items are written and approved by many content experts and educators, including those who work with diverse student populations.
- The items were field-tested, or tried out, by students. Following the Field Test administration, those items were reviewed again to make sure they worked as intended. The thousands of items that passed the reviews made it into the item bank. The CAT engine will select questions for the assessment from this approved bank of items.
- "HOW DOES IT KNOW WHICH QUESTION TO PICK?" Well, the second element takes care of that.
- The second element is the test blueprint. The test blueprint is designed to focus on the selection of questions from the test bank and apply the appropriate content so the structure of the test is similar for every student. For example, each student in grade three will receive a certain number of questions about multiplication and division. However, there are lots of questions about this in the item bank, the test blueprint selects the precise questions based on the individual student's responses to previous questions in the test. This process allows questions to be administered in a logical way and keeps the student's experience controlled and appropriate for him or her.
- The third element is the programming language, or algorithms, that tell the computer how the test is to be administered. Content and measurement experts for mathematics and ELA put their heads together to give the computer programmers “guidelines” about how to select questions and what category of question to present. Then they create an algorithm—or a step-by-step approach—that tells the CAT what to do next based on each student’s answers provided and when to finish the test.
- The fourth element is the set of rules, or “constraints,” that need to be given to the algorithm. Just as in paper-and-pencil tests, managing content, question types, reading passage length, and difficulty is extremely important in a CAT. In the case of a CAT, experts construct tables of rules or constraints used by the algorithm to make sure that anything that must, or must not, occur in a particular test is controlled in the rules. The proper types of questions are presented, ensuring that the test adapts correctly to the student and his or her overall test experience.
- HOW WILL IT WORK FOR THE STUDENT?
- The test starts with an item from a pre-determined difficulty level. It may be based on average difficulty for the grade, or it may be based on information known about the student from previous tests.
- The student receives questions based on his or her response to the previous questions. The computer program quickly selects a new question after reviewing how well the student performed on all the previous questions. Based on the responses, the program selects a question that fits the test blueprint and gives the best information about what the student knows. This is how a CAT can customize each test so it is an accurate measure of any student’s skills.
- If the student continues to answer questions correctly, the questions covering the blueprint will continue to get more challenging. If the student starts missing the answers to questions, the program will start to select questions that are easier. The program adapts to how the student is performing.
- Because the program knows which questions are harder and which are easier, several students may have answered a similar number of questions correctly, but the student who has answered the more challenging questions correctly will achieve a higher score.
- A student’s score is based on the difficulty of the items that were right or wrong, not on the number total of correct answers. Of course, it all seems so simple when described like this. But there is a very complex process happening within the CAT engine to make all of these determinations simultaneously with predictability built in.
- Let’s review the parts that make up a CAT — Computer Adaptive Test.
- First is the “C” for COMPUTER. The COMPUTER is important in CAT because: it makes the test more efficient and appropriate for every student; it allows students more flexibility and accessibility during testing; and it has the ability to include videos, audio, PowerPoint slides, and interactive test items.
- Next is “A” for ADAPTIVE. The ADAPTIVE part of the CAT makes the test unique for every student: it looks to see if the student response is correct; and it selects the next question to build a custom-made test for each student.
- Last is “T” for TEST. The Smarter Balanced TEST is testing how well a student has mastered the expectations of the Common Core State Standards in English language arts (ELA) and mathematics. The test ends when the student has answered a sufficient number of questions that satisfy the requirements of the blueprint and provide a good estimate of the student’s proficiency.
- “HOW DOES A CAT PROVIDE BETTER ASSESSMENT RESULTS?” With a CAT, each student will demonstrate the level of his or her content knowledge based on the item selection that adjusts to his or her particular responses.
- It is ACCURATE. This provides a testing experience that is a more accurate way to evaluate mastery of a subject by minimizing the difference between what a test score indicates and a student’s actual knowledge and abilities.
- It is INDIVIDUALIZED. Because the program knows which questions are harder and which are easier, the student will see items that are neither too easy nor too hard.
- It is SECURE. Not all students receive the same questions; therefore, cheating is more difficult than it would be on a paper test with fewer items and with paper forms that can be copied.
- It is EFFICIENT. It provides items in an order that best determines a student’s proficiency.
- It provides FAST RESULTS because many items are scored in real time by the computer. Student test scores and reports are not delivered until the entire test, including parts requiring human scoring, has been evaluated.
- In summary: The students’ testing experience will be their very own and provides them with the chance to show what they know.
- Now you know more about the Smarter Balanced CAT.