SlideShare una empresa de Scribd logo
1 de 23
Practical Alignment  for Item / Test Developers: Revised Bloom’s Taxonomy (RBT) and  Depth of Knowledge Levels (DOK) Staff Trainings,  2009 Jerrie W. Brown, Content Lead for Social Studies Assessments North Carolina State University  Center for Urban & Community Services Technical Outreach for Public Schools (TOPS)
[object Object],[object Object],[object Object],“ Alignment also helps ensure the validity of test results. If standards and tests are not aligned, results might provide a misleading picture of how well students are attaining standards.” -Robert Rothman, 2003 Annenberg Institute for School Reform
What is alignment? The No Child Left Behind Act of 2001 (NCLB) requires that each state align assessments to content standards.  Once the  enacted  (instruction),  intended  (state standards), and  assessed  (state tests)  curricula  have been measured, questions can be asked about the extent to which content is similar across them.  To the extent  content  is the same, they are said to be aligned.  J. Brown, NCSU, 2009
Defining Alignment ,[object Object],[object Object],[object Object],[object Object],J. Brown, NCSU, 2009
Alignment Procedure ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],J. Brown, NCSU, 2009
Alignment Dimensions ,[object Object],[object Object],[object Object],[object Object],J. Brown, NCSU, 2009 ,[object Object],[object Object],[object Object],[object Object],6. Create 5. Evaluate 4. Analyze 3. Apply 2. Understand 1. Remember Content Topic/Strand A 4. Extended Thinking 3. Strategic Thinking 2. Skill/Concept 1. Recall A. Factual B. Conceptual C. Procedural D. Meta-Cognitive Content Topic/Strand B Content Topic/Strand C (Note:  achieves  content  validity) (Note:  achieves  content  validity and  instructional  validity)
Revised Bloom’s Taxonomy (RBT) Table  for _____________________________ (Subject / Grade Level) Adapted from  Anderson, Lorin W. and David R. Krathwohl, et al., (2001).   J. Brown, NCSU, 2009 Knowledge Dimension (Lower Order =  0% )  Cognitive Process Dimension  (Higher Order =  0% ) 1. Remember 2. Understand 3. Apply 4. Analyze 5. Evaluate 6. Create A.  Factual Knowledge  (0%) B. Conceptual Knowledge (0%) C. Procedural Knowledge (0%) D. Meta- Cognitive Knowledge (0%)
Depth of Knowledge (DOK) Levels  for _____________________________ (Subject / Grade Level) Adapted from  Norm Webb, (2002).   J. Brown, NCSU, 2009 Content Categories Depth of Knowledge Levels Categorical Concurrence Yes / No 1. Recall 2. Skill/Concept 3. Strategic Thinking 4. Extended Thinking A.  Topic/Strand __________ (Specify) B. Topic/Strand __________ (Specify) C. Topic/Strand __________ (Specify)
RBT’s Knowledge Dimension:  J. Brown, NCSU, 2009 Major Types Definitions A Factual The basic elements students must know to be acquainted with a discipline or solve problems in it B Conceptual The interrelationships among the basic elements within a larger structure that enable them to function together C Procedural How to do something, methods of inquiry, and criteria for using skills, algorithms, techniques, and methods D Metacognitive Knowledge of cognition in general as well as awareness and knowledge of one’s own cognition
RBT’s Knowledge Dimension:  J. Brown, NCSU, 2009 Major Types Subtypes A Factual AA.  Knowledge of terminology AB.  Knowledge of specific details and elements B Conceptual BA.  Knowledge of classifications and categories BB.  Knowledge of principles and generalizations BC.  Knowledge of theories, models, and structures C Procedural CA.  Knowledge of subject-specific skills and algorithms CB.  Knowledge of subject-specific techniques and methods CC.  Knowledge of criteria for determining when to use appropriate procedures D Metacognitive DA.  Strategic knowledge DB.  Knowledge about cognitive tasks, including appropriate contextual and conditional knowledge DC.  Self-knowledge
RBT’s Cognitive Process Dimension:  J. Brown, NCSU, 2009 Cognitive Process Categories Definitions 1 Remember Retrieve relevant knowledge from long-term memory 2 Understand Construct meaning from instructional messages, including oral, written, and graphic communication 3 Apply Carry out or use a procedure in a given situation 4 Analyze Break material down into its constituent parts and determine how the parts relate to one another and to an overall structure or purpose 5 Evaluate Make judgments based on criteria and standards 6 Create Put elements together to form a coherent or functional whole; reorganize elements into a new pattern or structure
RBT’s Cognitive Process Dimension:  J. Brown, NCSU, 2009 Cognitive Process Categories Cognitive Processes 1 Remember 1.1  Recognizing 1.2  Recalling 2 Understand 2.1  Interpreting 2.2  Exemplifying 2.3  Classifying 2.4  Summarizing 2.5  Inferring 2.6  Comparing 2.7  Explaining 3 Apply 3.1  Executing 3.2  Implementing 4 Analyze 4.1  Differentiating 4.2  Organizing 4.3  Attributing 5 Evaluate 5.1  Checking 5.2  Critiquing 6 Create 6.1  Generating 6.2  Planning 6.3  Producing
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Formal Alignment Studies and Depth of Knowledge Levels (DOKs) J. Brown, NCSU, 2009
Depth of Knowledge Levels ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],J. Brown, NCSU, 2009
Subject-Specific DOKs J. Brown, NCSU, 2009 Science Social Studies Math Level 1 Recall and Reproduction Recall of Information Recall Level 2 Skills and Concepts Basic Reasoning Skill/ Concept Level 3 Strategic Thinking Complex Reasoning Strategic Thinking Level 4 Extended Thinking Extended Reasoning Extended Thinking
Reading DOKs J. Brown, NCSU, 2009 ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Getting Started ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],J. Brown, NCSU, 2009
Rating WA State Standards J. Brown, NCSU, 2009
Plotting Standards J. Brown, NCSU, 2009 Knowledge Dimension (Lower Order =  0% )  Cognitive Process Dimension  (Higher Order =  0% ) 1. Remember 2. Understand 3. Apply 4. Analyze 5. Evaluate 6. Create A.  Factual Knowledge  (0%) 10 1, 5 9 B. Conceptual Knowledge (0%) 2, 3 8 6 C. Procedural Knowledge (0%) 7 4 D. Meta- Cognitive Knowledge (0%)
Rating ‘WASL’ Test Items J. Brown, NCSU, 2009
Plotting Test Items J. Brown, NCSU, 2009 Knowledge Dimension (Lower Order =  0% )  Cognitive Process Dimension  (Higher Order =  0% ) 1. Remember 2. Understand 3. Apply 4. Analyze 5. Evaluate 6. Create A.  Factual Knowledge  (0%) 10 1, 5 9 B. Conceptual Knowledge (0%) 2, 3 8 6 C. Procedural Knowledge (0%) 7 4 D. Meta- Cognitive Knowledge (0%)
Individual and Group Results
Thank You for Participating! FOR MORE INFORMATION : Mr. Jerrie W. Brown, Consultant North Carolina State University Center for Urban and Community Services Technical Outreach for Public Schools 1500 Blue Ridge Road Raleigh, N. Carolina  27607 Tel:  (919) 515-1125 Email:  [email_address] Website:  http://www.cuacs.ncsu.edu

Más contenido relacionado

La actualidad más candente

halaga ng pag-aaral para sa pagnenegosyo at paghahanapbuhay.pptx
halaga ng pag-aaral para sa pagnenegosyo at paghahanapbuhay.pptxhalaga ng pag-aaral para sa pagnenegosyo at paghahanapbuhay.pptx
halaga ng pag-aaral para sa pagnenegosyo at paghahanapbuhay.pptx
Renatoofong
 
IPCRF for Teacher I-III from RPMS Manual 2018
IPCRF for Teacher I-III from RPMS Manual 2018IPCRF for Teacher I-III from RPMS Manual 2018
IPCRF for Teacher I-III from RPMS Manual 2018
Allan Roloma
 

La actualidad más candente (20)

ESP7 Modyul 11 Panloob na Salik na Nakakaapekto sa Pagpapahalaga
ESP7 Modyul 11 Panloob na Salik na Nakakaapekto sa PagpapahalagaESP7 Modyul 11 Panloob na Salik na Nakakaapekto sa Pagpapahalaga
ESP7 Modyul 11 Panloob na Salik na Nakakaapekto sa Pagpapahalaga
 
1 st periodical test in esp with tos
1 st periodical test in esp with tos 1 st periodical test in esp with tos
1 st periodical test in esp with tos
 
K TO 12 GRADE 9 LEARNER’S MATERIAL IN EDUKASYON sa PAGPAPAKATAO (EsP)
K TO 12 GRADE 9 LEARNER’S MATERIAL IN EDUKASYON sa PAGPAPAKATAO (EsP)K TO 12 GRADE 9 LEARNER’S MATERIAL IN EDUKASYON sa PAGPAPAKATAO (EsP)
K TO 12 GRADE 9 LEARNER’S MATERIAL IN EDUKASYON sa PAGPAPAKATAO (EsP)
 
ESP8-DLL.docx
ESP8-DLL.docxESP8-DLL.docx
ESP8-DLL.docx
 
EsP 7 Modyul 9 Ang Kaugnayan ng Pagpapahalaga sa Birtud
EsP 7 Modyul 9 Ang Kaugnayan ng Pagpapahalaga sa BirtudEsP 7 Modyul 9 Ang Kaugnayan ng Pagpapahalaga sa Birtud
EsP 7 Modyul 9 Ang Kaugnayan ng Pagpapahalaga sa Birtud
 
DLL EsP 9
DLL EsP 9DLL EsP 9
DLL EsP 9
 
IPCRF DEVELOPMENT PLAN.docx
IPCRF DEVELOPMENT PLAN.docxIPCRF DEVELOPMENT PLAN.docx
IPCRF DEVELOPMENT PLAN.docx
 
Hirarkiya ng pagpapahalaga.pptx
Hirarkiya ng pagpapahalaga.pptxHirarkiya ng pagpapahalaga.pptx
Hirarkiya ng pagpapahalaga.pptx
 
EsP-9-Q2-Week-1.pdf
EsP-9-Q2-Week-1.pdfEsP-9-Q2-Week-1.pdf
EsP-9-Q2-Week-1.pdf
 
KATAPATAN, ISABUHAY ESP 8.pptx
KATAPATAN, ISABUHAY ESP 8.pptxKATAPATAN, ISABUHAY ESP 8.pptx
KATAPATAN, ISABUHAY ESP 8.pptx
 
halaga ng pag-aaral para sa pagnenegosyo at paghahanapbuhay.pptx
halaga ng pag-aaral para sa pagnenegosyo at paghahanapbuhay.pptxhalaga ng pag-aaral para sa pagnenegosyo at paghahanapbuhay.pptx
halaga ng pag-aaral para sa pagnenegosyo at paghahanapbuhay.pptx
 
ESP 7 - QUARTER 3 - MODULE 6 - WEEK 6 2.pptx
ESP 7 - QUARTER 3 - MODULE 6 - WEEK 6 2.pptxESP 7 - QUARTER 3 - MODULE 6 - WEEK 6 2.pptx
ESP 7 - QUARTER 3 - MODULE 6 - WEEK 6 2.pptx
 
Edukasyon sa Pagpapakatao Grade 8 Teacher's Guide
Edukasyon sa Pagpapakatao Grade 8 Teacher's Guide Edukasyon sa Pagpapakatao Grade 8 Teacher's Guide
Edukasyon sa Pagpapakatao Grade 8 Teacher's Guide
 
Course Desciption - Edukasyon sa Pagpapakatao (EsP)
Course Desciption - Edukasyon sa Pagpapakatao (EsP)Course Desciption - Edukasyon sa Pagpapakatao (EsP)
Course Desciption - Edukasyon sa Pagpapakatao (EsP)
 
ESP 8 Modyul 11
ESP 8 Modyul 11ESP 8 Modyul 11
ESP 8 Modyul 11
 
Esp 8 lesson plan
Esp 8 lesson planEsp 8 lesson plan
Esp 8 lesson plan
 
ESP 7 Modyul 14 Ang Kahalagahan ng Mabuting Pagpapasiya
ESP 7  Modyul 14 Ang Kahalagahan ng Mabuting PagpapasiyaESP 7  Modyul 14 Ang Kahalagahan ng Mabuting Pagpapasiya
ESP 7 Modyul 14 Ang Kahalagahan ng Mabuting Pagpapasiya
 
Pakikilahok at Bolunterismo.pptx
Pakikilahok at Bolunterismo.pptxPakikilahok at Bolunterismo.pptx
Pakikilahok at Bolunterismo.pptx
 
IPCRF for Teacher I-III from RPMS Manual 2018
IPCRF for Teacher I-III from RPMS Manual 2018IPCRF for Teacher I-III from RPMS Manual 2018
IPCRF for Teacher I-III from RPMS Manual 2018
 
Esp 7 talento at kakayahan sim
Esp 7 talento at kakayahan simEsp 7 talento at kakayahan sim
Esp 7 talento at kakayahan sim
 

Destacado

Table of Specifications (TOS) and Test Construction Review
Table of Specifications (TOS) and Test Construction ReviewTable of Specifications (TOS) and Test Construction Review
Table of Specifications (TOS) and Test Construction Review
Rivera Arnel
 

Destacado (13)

2014 penilaian hasil belajar oleh pendidik-prof udin
2014 penilaian hasil belajar oleh pendidik-prof udin 2014 penilaian hasil belajar oleh pendidik-prof udin
2014 penilaian hasil belajar oleh pendidik-prof udin
 
Bergenfield workshop on common core and parcc
Bergenfield workshop on common core and parccBergenfield workshop on common core and parcc
Bergenfield workshop on common core and parcc
 
Depth of Knowledge
Depth of KnowledgeDepth of Knowledge
Depth of Knowledge
 
Providing vegetables for the full eating season 2013 Pam Dawling
Providing vegetables for the full eating season 2013 Pam DawlingProviding vegetables for the full eating season 2013 Pam Dawling
Providing vegetables for the full eating season 2013 Pam Dawling
 
Depth of Knowledge in Math
Depth of Knowledge in MathDepth of Knowledge in Math
Depth of Knowledge in Math
 
Instructional Objectives: Bloom's Revised Taxonomy
Instructional Objectives: Bloom's Revised TaxonomyInstructional Objectives: Bloom's Revised Taxonomy
Instructional Objectives: Bloom's Revised Taxonomy
 
How to make table of specs
How to make table of specsHow to make table of specs
How to make table of specs
 
Preparing table of specification for Grade 7 and Grade 8
Preparing table of specification for Grade 7 and Grade 8Preparing table of specification for Grade 7 and Grade 8
Preparing table of specification for Grade 7 and Grade 8
 
Second periodical test english grade 3
Second periodical test english grade 3Second periodical test english grade 3
Second periodical test english grade 3
 
TOS in Science III and Sample Test
TOS in Science III and Sample TestTOS in Science III and Sample Test
TOS in Science III and Sample Test
 
Preparing The Table of Specification
Preparing The Table of SpecificationPreparing The Table of Specification
Preparing The Table of Specification
 
Table of Specifications (TOS) and Test Construction Review
Table of Specifications (TOS) and Test Construction ReviewTable of Specifications (TOS) and Test Construction Review
Table of Specifications (TOS) and Test Construction Review
 
Table of specifications
Table of specificationsTable of specifications
Table of specifications
 

Similar a RBT and DOK Alignment for Practitioners

Nj model curriculum
Nj model curriculumNj model curriculum
Nj model curriculum
MrSanchez
 
William paper presentation
William paper presentationWilliam paper presentation
William paper presentation
William Kapambwe
 
Stages of test writings final by joy,, language testing
Stages of test writings final by joy,, language testingStages of test writings final by joy,, language testing
Stages of test writings final by joy,, language testing
patiluna
 
Task based language test
Task based language testTask based language test
Task based language test
Vronit82
 

Similar a RBT and DOK Alignment for Practitioners (20)

Drafting written questions and marking schemes Liz Norman ANZCVS 2020
Drafting written questions and marking schemes Liz Norman ANZCVS 2020Drafting written questions and marking schemes Liz Norman ANZCVS 2020
Drafting written questions and marking schemes Liz Norman ANZCVS 2020
 
Objectives and Assessments
Objectives and AssessmentsObjectives and Assessments
Objectives and Assessments
 
Resaerch-design-Presentation-MTTE-1st-sem-2023.pptx
Resaerch-design-Presentation-MTTE-1st-sem-2023.pptxResaerch-design-Presentation-MTTE-1st-sem-2023.pptx
Resaerch-design-Presentation-MTTE-1st-sem-2023.pptx
 
Assignment· using the instructional task created earliergradual
Assignment· using the instructional task created earliergradualAssignment· using the instructional task created earliergradual
Assignment· using the instructional task created earliergradual
 
RUBRICS.pptx
RUBRICS.pptxRUBRICS.pptx
RUBRICS.pptx
 
pr2 dll week 1.docx
pr2 dll week 1.docxpr2 dll week 1.docx
pr2 dll week 1.docx
 
Nj model curriculum
Nj model curriculumNj model curriculum
Nj model curriculum
 
2010 01 psyf 588 master syllabus
2010 01 psyf 588 master syllabus2010 01 psyf 588 master syllabus
2010 01 psyf 588 master syllabus
 
Designing language test
Designing language testDesigning language test
Designing language test
 
Rubrics sb
Rubrics sbRubrics sb
Rubrics sb
 
Daily alignment (1)
Daily alignment (1)Daily alignment (1)
Daily alignment (1)
 
General Framework for Setting Examination Papers and Test Papers
General Framework for Setting Examination Papers and Test PapersGeneral Framework for Setting Examination Papers and Test Papers
General Framework for Setting Examination Papers and Test Papers
 
William paper presentation
William paper presentationWilliam paper presentation
William paper presentation
 
Syllabus
SyllabusSyllabus
Syllabus
 
Pgptp session 2
Pgptp session 2Pgptp session 2
Pgptp session 2
 
Stages of test writings final by joy,, language testing
Stages of test writings final by joy,, language testingStages of test writings final by joy,, language testing
Stages of test writings final by joy,, language testing
 
The Revised Blooms Taxonomy of Educational Objectives.pdf
The Revised Blooms Taxonomy of Educational Objectives.pdfThe Revised Blooms Taxonomy of Educational Objectives.pdf
The Revised Blooms Taxonomy of Educational Objectives.pdf
 
Task based language test
Task based language testTask based language test
Task based language test
 
COT.pptx
COT.pptxCOT.pptx
COT.pptx
 
TEST DEVELOPMENT AND EVALUATION (6462)
TEST DEVELOPMENT AND EVALUATION (6462)TEST DEVELOPMENT AND EVALUATION (6462)
TEST DEVELOPMENT AND EVALUATION (6462)
 

Último

Último (20)

How to Add New Custom Addons Path in Odoo 17
How to Add New Custom Addons Path in Odoo 17How to Add New Custom Addons Path in Odoo 17
How to Add New Custom Addons Path in Odoo 17
 
Graduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - EnglishGraduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - English
 
ICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptxICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptx
 
Food safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdfFood safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdf
 
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdfUGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
 
Wellbeing inclusion and digital dystopias.pptx
Wellbeing inclusion and digital dystopias.pptxWellbeing inclusion and digital dystopias.pptx
Wellbeing inclusion and digital dystopias.pptx
 
Key note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfKey note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdf
 
Single or Multiple melodic lines structure
Single or Multiple melodic lines structureSingle or Multiple melodic lines structure
Single or Multiple melodic lines structure
 
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...
 
Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)
 
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
 
ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.
 
Kodo Millet PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...
Kodo Millet  PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...Kodo Millet  PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...
Kodo Millet PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...
 
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
 
Plant propagation: Sexual and Asexual propapagation.pptx
Plant propagation: Sexual and Asexual propapagation.pptxPlant propagation: Sexual and Asexual propapagation.pptx
Plant propagation: Sexual and Asexual propapagation.pptx
 
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdf
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdfUnit 3 Emotional Intelligence and Spiritual Intelligence.pdf
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdf
 
On_Translating_a_Tamil_Poem_by_A_K_Ramanujan.pptx
On_Translating_a_Tamil_Poem_by_A_K_Ramanujan.pptxOn_Translating_a_Tamil_Poem_by_A_K_Ramanujan.pptx
On_Translating_a_Tamil_Poem_by_A_K_Ramanujan.pptx
 
Sociology 101 Demonstration of Learning Exhibit
Sociology 101 Demonstration of Learning ExhibitSociology 101 Demonstration of Learning Exhibit
Sociology 101 Demonstration of Learning Exhibit
 
On National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan FellowsOn National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan Fellows
 
Python Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docxPython Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docx
 

RBT and DOK Alignment for Practitioners

  • 1. Practical Alignment for Item / Test Developers: Revised Bloom’s Taxonomy (RBT) and Depth of Knowledge Levels (DOK) Staff Trainings, 2009 Jerrie W. Brown, Content Lead for Social Studies Assessments North Carolina State University Center for Urban & Community Services Technical Outreach for Public Schools (TOPS)
  • 2.
  • 3. What is alignment? The No Child Left Behind Act of 2001 (NCLB) requires that each state align assessments to content standards. Once the enacted (instruction), intended (state standards), and assessed (state tests) curricula have been measured, questions can be asked about the extent to which content is similar across them. To the extent content is the same, they are said to be aligned. J. Brown, NCSU, 2009
  • 4.
  • 5.
  • 6.
  • 7. Revised Bloom’s Taxonomy (RBT) Table for _____________________________ (Subject / Grade Level) Adapted from Anderson, Lorin W. and David R. Krathwohl, et al., (2001). J. Brown, NCSU, 2009 Knowledge Dimension (Lower Order = 0% ) Cognitive Process Dimension (Higher Order = 0% ) 1. Remember 2. Understand 3. Apply 4. Analyze 5. Evaluate 6. Create A. Factual Knowledge (0%) B. Conceptual Knowledge (0%) C. Procedural Knowledge (0%) D. Meta- Cognitive Knowledge (0%)
  • 8. Depth of Knowledge (DOK) Levels for _____________________________ (Subject / Grade Level) Adapted from Norm Webb, (2002). J. Brown, NCSU, 2009 Content Categories Depth of Knowledge Levels Categorical Concurrence Yes / No 1. Recall 2. Skill/Concept 3. Strategic Thinking 4. Extended Thinking A. Topic/Strand __________ (Specify) B. Topic/Strand __________ (Specify) C. Topic/Strand __________ (Specify)
  • 9. RBT’s Knowledge Dimension: J. Brown, NCSU, 2009 Major Types Definitions A Factual The basic elements students must know to be acquainted with a discipline or solve problems in it B Conceptual The interrelationships among the basic elements within a larger structure that enable them to function together C Procedural How to do something, methods of inquiry, and criteria for using skills, algorithms, techniques, and methods D Metacognitive Knowledge of cognition in general as well as awareness and knowledge of one’s own cognition
  • 10. RBT’s Knowledge Dimension: J. Brown, NCSU, 2009 Major Types Subtypes A Factual AA. Knowledge of terminology AB. Knowledge of specific details and elements B Conceptual BA. Knowledge of classifications and categories BB. Knowledge of principles and generalizations BC. Knowledge of theories, models, and structures C Procedural CA. Knowledge of subject-specific skills and algorithms CB. Knowledge of subject-specific techniques and methods CC. Knowledge of criteria for determining when to use appropriate procedures D Metacognitive DA. Strategic knowledge DB. Knowledge about cognitive tasks, including appropriate contextual and conditional knowledge DC. Self-knowledge
  • 11. RBT’s Cognitive Process Dimension: J. Brown, NCSU, 2009 Cognitive Process Categories Definitions 1 Remember Retrieve relevant knowledge from long-term memory 2 Understand Construct meaning from instructional messages, including oral, written, and graphic communication 3 Apply Carry out or use a procedure in a given situation 4 Analyze Break material down into its constituent parts and determine how the parts relate to one another and to an overall structure or purpose 5 Evaluate Make judgments based on criteria and standards 6 Create Put elements together to form a coherent or functional whole; reorganize elements into a new pattern or structure
  • 12. RBT’s Cognitive Process Dimension: J. Brown, NCSU, 2009 Cognitive Process Categories Cognitive Processes 1 Remember 1.1 Recognizing 1.2 Recalling 2 Understand 2.1 Interpreting 2.2 Exemplifying 2.3 Classifying 2.4 Summarizing 2.5 Inferring 2.6 Comparing 2.7 Explaining 3 Apply 3.1 Executing 3.2 Implementing 4 Analyze 4.1 Differentiating 4.2 Organizing 4.3 Attributing 5 Evaluate 5.1 Checking 5.2 Critiquing 6 Create 6.1 Generating 6.2 Planning 6.3 Producing
  • 13.
  • 14.
  • 15. Subject-Specific DOKs J. Brown, NCSU, 2009 Science Social Studies Math Level 1 Recall and Reproduction Recall of Information Recall Level 2 Skills and Concepts Basic Reasoning Skill/ Concept Level 3 Strategic Thinking Complex Reasoning Strategic Thinking Level 4 Extended Thinking Extended Reasoning Extended Thinking
  • 16.
  • 17.
  • 18. Rating WA State Standards J. Brown, NCSU, 2009
  • 19. Plotting Standards J. Brown, NCSU, 2009 Knowledge Dimension (Lower Order = 0% ) Cognitive Process Dimension (Higher Order = 0% ) 1. Remember 2. Understand 3. Apply 4. Analyze 5. Evaluate 6. Create A. Factual Knowledge (0%) 10 1, 5 9 B. Conceptual Knowledge (0%) 2, 3 8 6 C. Procedural Knowledge (0%) 7 4 D. Meta- Cognitive Knowledge (0%)
  • 20. Rating ‘WASL’ Test Items J. Brown, NCSU, 2009
  • 21. Plotting Test Items J. Brown, NCSU, 2009 Knowledge Dimension (Lower Order = 0% ) Cognitive Process Dimension (Higher Order = 0% ) 1. Remember 2. Understand 3. Apply 4. Analyze 5. Evaluate 6. Create A. Factual Knowledge (0%) 10 1, 5 9 B. Conceptual Knowledge (0%) 2, 3 8 6 C. Procedural Knowledge (0%) 7 4 D. Meta- Cognitive Knowledge (0%)
  • 23. Thank You for Participating! FOR MORE INFORMATION : Mr. Jerrie W. Brown, Consultant North Carolina State University Center for Urban and Community Services Technical Outreach for Public Schools 1500 Blue Ridge Road Raleigh, N. Carolina 27607 Tel: (919) 515-1125 Email: [email_address] Website: http://www.cuacs.ncsu.edu