SlideShare una empresa de Scribd logo
1 de 46
Test Worthiness Chapter 3
Test Worthiness ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Correlation Coefficient ,[object Object],[object Object],[object Object],[object Object],[object Object]
Correlation Coefficient (Cont’d) ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Correlation Coefficient (Cont’d) ,[object Object],[object Object],[object Object],[object Object],[object Object]
Correlation (cont’d) ,[object Object],[object Object],[object Object],-1 0 +1 Direct Inverse Weak Strong Strong
Correlation Examples r = .35 r = -.67 SAT score Coll. GPA 930 3.0 750 2.9 1110 3.8 625 2.1 885 3.3 950 2.6 605 2.8 810 3.2 1045 3.0 910 3.5 Missed Classes Coll. GPA 3 3.0 5 2.9 2 3.8 8 2.1 1 3.3 6 2.6 3 2.8 1 3.2 3 3.0 0 3.5
Correlation Scatterplots ,[object Object],[object Object],[object Object],[object Object]
Examples of Scatterplots
Scatterplots (cont’d) ,[object Object],[object Object]
More Scatterplots ,[object Object],[object Object]
More Scatterplots ,[object Object],[object Object]
Coefficient of Determination  (Shared Variance) ,[object Object],[object Object],[object Object],[object Object],[object Object],Depression Anxiety Shared Trait Variance
Validity ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Content Validity ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Content Validity (cont’d) Survey of Domain Step 1: Survey the Domain Step 2: Content Matches Domain  Step 3: Test items reflect content Step 4: Adjusted for relative importance Content Matches Domain Item 1 x  3 Item 2 x 2 Item 3 x 1 Item 4 x 2 Item 5 x 2.5
Content Validity (cont’d) ,[object Object],[object Object],[object Object],[object Object],[object Object]
Criterion-Related Validity:  Concurrent and Predictive Validity ,[object Object],[object Object],[object Object],[object Object],[object Object]
Criterion-Related Validity:  Concurrent Validity ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Criterion-Related Validity:  Predictive Validity ,[object Object],[object Object],[object Object],[object Object],[object Object]
Concepts Related to Predictive Validity  ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Construct Validity ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Construct Validity (cont’d) ,[object Object],[object Object],[object Object],[object Object],[object Object]
Construct Validity:  Experimental Design ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Construct Validity:  Factor Analysis ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Construct Validity:  Convergent Validity ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Construct Validity:  Discriminant Validity ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Validity Recap ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Reliability ,[object Object],[object Object],[object Object],[object Object]
Three Ways of  Determining Reliability ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Test-Retest Reliability ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Time A A
Alternate, Parallel,  or Equivalent Forms Reliability ,[object Object],[object Object],[object Object],[object Object],[object Object],A B
Internal Consistency Reliability ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Split-half or  Odd-even Reliability ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Split-half or Odd-even  Reliability Internal Consistency ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],A
Cronbach’s Alpha and Kuder-Richardson Internal Consistency ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],A
Item Response Theory:  Another Way of Looking at Reliability ,[object Object],[object Object],[object Object]
Item Response Theory:  Another Way of Looking at Reliability ,[object Object],[object Object],[object Object],[object Object],[object Object]
Cross-Cultural Fairness ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Cross-Cultural Fairness ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Cross-Cultural Fairness ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Cross-Cultural Fairness ,[object Object],[object Object],[object Object],[object Object],[object Object]
Cross-Cultural Fairness ,[object Object],[object Object]
Disparities in Ability ,[object Object],[object Object],[object Object],[object Object]
Practicality ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Selecting & Administering Tests ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Más contenido relacionado

La actualidad más candente

Development of health measurement scales – part 2
Development of health measurement scales – part 2Development of health measurement scales – part 2
Development of health measurement scales – part 2
Rizwan S A
 
7 measurement & questionnaires design (Dr. Mai,2014)
7 measurement & questionnaires design (Dr. Mai,2014)7 measurement & questionnaires design (Dr. Mai,2014)
7 measurement & questionnaires design (Dr. Mai,2014)
Phong Đá
 
Correlational research
Correlational researchCorrelational research
Correlational research
Aiden Yeh
 
Correlational research 1 1
Correlational research 1 1Correlational research 1 1
Correlational research 1 1
sdwilson88
 
Moderator mediator
Moderator mediatorModerator mediator
Moderator mediator
Carlo Magno
 

La actualidad más candente (20)

Seawell_Exam
Seawell_ExamSeawell_Exam
Seawell_Exam
 
Development of health measurement scales – part 2
Development of health measurement scales – part 2Development of health measurement scales – part 2
Development of health measurement scales – part 2
 
Monika seminar
Monika seminarMonika seminar
Monika seminar
 
Likert scale
Likert scaleLikert scale
Likert scale
 
Correlational research
Correlational researchCorrelational research
Correlational research
 
7 measurement & questionnaires design (Dr. Mai,2014)
7 measurement & questionnaires design (Dr. Mai,2014)7 measurement & questionnaires design (Dr. Mai,2014)
7 measurement & questionnaires design (Dr. Mai,2014)
 
Attitude Scales
Attitude ScalesAttitude Scales
Attitude Scales
 
Correlational research
Correlational researchCorrelational research
Correlational research
 
Difficulty Index, Discrimination Index, Reliability and Rasch Measurement Ana...
Difficulty Index, Discrimination Index, Reliability and Rasch Measurement Ana...Difficulty Index, Discrimination Index, Reliability and Rasch Measurement Ana...
Difficulty Index, Discrimination Index, Reliability and Rasch Measurement Ana...
 
statistical analysis of questionnaires
statistical analysis of questionnairesstatistical analysis of questionnaires
statistical analysis of questionnaires
 
Scaling
ScalingScaling
Scaling
 
Final.Ppt007
Final.Ppt007Final.Ppt007
Final.Ppt007
 
Chapter 7
Chapter 7Chapter 7
Chapter 7
 
Types of Scales and Scaling Techniques
Types of Scales and Scaling TechniquesTypes of Scales and Scaling Techniques
Types of Scales and Scaling Techniques
 
Attitude scales ppt
Attitude scales pptAttitude scales ppt
Attitude scales ppt
 
Business research measurement and scaling
Business research measurement and scalingBusiness research measurement and scaling
Business research measurement and scaling
 
Correlation research
Correlation researchCorrelation research
Correlation research
 
Correlational research 1 1
Correlational research 1 1Correlational research 1 1
Correlational research 1 1
 
Correlational Research
Correlational ResearchCorrelational Research
Correlational Research
 
Moderator mediator
Moderator mediatorModerator mediator
Moderator mediator
 

Destacado

Chapter 12
Chapter 12Chapter 12
Chapter 12
fosterlh
 
Chapter 10
Chapter 10Chapter 10
Chapter 10
fosterlh
 
Chapter 11
Chapter 11Chapter 11
Chapter 11
fosterlh
 
Water Quality and Pollution
Water Quality and PollutionWater Quality and Pollution
Water Quality and Pollution
Katie Priebe
 
Download-manuals-surface water-manual-sw-volume6fieldmanualwqsampling
 Download-manuals-surface water-manual-sw-volume6fieldmanualwqsampling Download-manuals-surface water-manual-sw-volume6fieldmanualwqsampling
Download-manuals-surface water-manual-sw-volume6fieldmanualwqsampling
hydrologywebsite1
 
Chapter 1 of Standard Methods for the Examination of Water and Wastewater
Chapter 1 of Standard Methods for the Examination of Water and WastewaterChapter 1 of Standard Methods for the Examination of Water and Wastewater
Chapter 1 of Standard Methods for the Examination of Water and Wastewater
WaterWeUpTo
 
(Standard methods for the examination of water and wastewater) lenore s. cles...
(Standard methods for the examination of water and wastewater) lenore s. cles...(Standard methods for the examination of water and wastewater) lenore s. cles...
(Standard methods for the examination of water and wastewater) lenore s. cles...
Gohar Ali
 
Water analysis website
Water analysis websiteWater analysis website
Water analysis website
TheDalles
 
Environmental_soil_and_water_chemistry__principles_and_applications
  Environmental_soil_and_water_chemistry__principles_and_applications  Environmental_soil_and_water_chemistry__principles_and_applications
Environmental_soil_and_water_chemistry__principles_and_applications
Daniel Delgado MSc
 
Introduction of PT
Introduction of PTIntroduction of PT
Introduction of PT
Joseph Chan
 

Destacado (20)

Chapter 12
Chapter 12Chapter 12
Chapter 12
 
Chapter 10
Chapter 10Chapter 10
Chapter 10
 
Chapter 8
Chapter 8Chapter 8
Chapter 8
 
Chapter 1
Chapter 1Chapter 1
Chapter 1
 
Chapter 11
Chapter 11Chapter 11
Chapter 11
 
Chapter 7
Chapter 7Chapter 7
Chapter 7
 
Chapter 4
Chapter 4Chapter 4
Chapter 4
 
Chapter 5
Chapter 5Chapter 5
Chapter 5
 
Chapter 2
Chapter 2Chapter 2
Chapter 2
 
Chapter 6
Chapter 6Chapter 6
Chapter 6
 
Chapter 9
Chapter 9Chapter 9
Chapter 9
 
Water Quality and Pollution
Water Quality and PollutionWater Quality and Pollution
Water Quality and Pollution
 
Download-manuals-surface water-manual-sw-volume6fieldmanualwqsampling
 Download-manuals-surface water-manual-sw-volume6fieldmanualwqsampling Download-manuals-surface water-manual-sw-volume6fieldmanualwqsampling
Download-manuals-surface water-manual-sw-volume6fieldmanualwqsampling
 
Session 3C - Simple Methods of Water Quality & Quantity Determination
Session 3C - Simple Methods of Water Quality & Quantity DeterminationSession 3C - Simple Methods of Water Quality & Quantity Determination
Session 3C - Simple Methods of Water Quality & Quantity Determination
 
Chapter 1 of Standard Methods for the Examination of Water and Wastewater
Chapter 1 of Standard Methods for the Examination of Water and WastewaterChapter 1 of Standard Methods for the Examination of Water and Wastewater
Chapter 1 of Standard Methods for the Examination of Water and Wastewater
 
(Standard methods for the examination of water and wastewater) lenore s. cles...
(Standard methods for the examination of water and wastewater) lenore s. cles...(Standard methods for the examination of water and wastewater) lenore s. cles...
(Standard methods for the examination of water and wastewater) lenore s. cles...
 
Water analysis website
Water analysis websiteWater analysis website
Water analysis website
 
Statistics excellent
Statistics excellentStatistics excellent
Statistics excellent
 
Environmental_soil_and_water_chemistry__principles_and_applications
  Environmental_soil_and_water_chemistry__principles_and_applications  Environmental_soil_and_water_chemistry__principles_and_applications
Environmental_soil_and_water_chemistry__principles_and_applications
 
Introduction of PT
Introduction of PTIntroduction of PT
Introduction of PT
 

Similar a Chapter 3

Correlational research
Correlational researchCorrelational research
Correlational research
Jijo G John
 
Louzel Report - Reliability & validity
Louzel Report - Reliability & validity Louzel Report - Reliability & validity
Louzel Report - Reliability & validity
Louzel Linejan
 

Similar a Chapter 3 (20)

Reliability and validity
Reliability and validityReliability and validity
Reliability and validity
 
Establishing Validity-and-Reliability-Test ppt.pptx
Establishing Validity-and-Reliability-Test ppt.pptxEstablishing Validity-and-Reliability-Test ppt.pptx
Establishing Validity-and-Reliability-Test ppt.pptx
 
Qualities of a Good Test
Qualities of a Good TestQualities of a Good Test
Qualities of a Good Test
 
Correlational research
Correlational researchCorrelational research
Correlational research
 
Validity and reliability
Validity and reliabilityValidity and reliability
Validity and reliability
 
Testing in language programs (chapter 8)
Testing in language programs (chapter 8)Testing in language programs (chapter 8)
Testing in language programs (chapter 8)
 
Correlational research
Correlational researchCorrelational research
Correlational research
 
Meta analysis with R
Meta analysis with RMeta analysis with R
Meta analysis with R
 
Doing observation and Data Analysis for Qualitative Research
Doing observation and Data Analysis for Qualitative ResearchDoing observation and Data Analysis for Qualitative Research
Doing observation and Data Analysis for Qualitative Research
 
Commonly Used Statistics in Survey Research
Commonly Used Statistics in Survey ResearchCommonly Used Statistics in Survey Research
Commonly Used Statistics in Survey Research
 
Reliability in Language Testing
Reliability in Language Testing Reliability in Language Testing
Reliability in Language Testing
 
Correlation research design presentation 2015
Correlation research design presentation 2015Correlation research design presentation 2015
Correlation research design presentation 2015
 
Convergent Validity And Discriminant Validity.ppt
Convergent Validity And Discriminant Validity.pptConvergent Validity And Discriminant Validity.ppt
Convergent Validity And Discriminant Validity.ppt
 
Valiadity and reliability- Language testing
Valiadity and reliability- Language testingValiadity and reliability- Language testing
Valiadity and reliability- Language testing
 
Practical Language Testing by Fulcher (2010)
Practical Language Testing by Fulcher (2010)Practical Language Testing by Fulcher (2010)
Practical Language Testing by Fulcher (2010)
 
Validity, Reliability ,Objective & Their Types
Validity, Reliability ,Objective & Their TypesValidity, Reliability ,Objective & Their Types
Validity, Reliability ,Objective & Their Types
 
Research Procedure
Research ProcedureResearch Procedure
Research Procedure
 
Reliability bachman 1990 chapter 6
Reliability bachman 1990 chapter 6Reliability bachman 1990 chapter 6
Reliability bachman 1990 chapter 6
 
Reliability bachman 1990 chapter 6
Reliability bachman 1990 chapter 6Reliability bachman 1990 chapter 6
Reliability bachman 1990 chapter 6
 
Louzel Report - Reliability & validity
Louzel Report - Reliability & validity Louzel Report - Reliability & validity
Louzel Report - Reliability & validity
 

Chapter 3

  • 2.
  • 3.
  • 4.
  • 5.
  • 6.
  • 7. Correlation Examples r = .35 r = -.67 SAT score Coll. GPA 930 3.0 750 2.9 1110 3.8 625 2.1 885 3.3 950 2.6 605 2.8 810 3.2 1045 3.0 910 3.5 Missed Classes Coll. GPA 3 3.0 5 2.9 2 3.8 8 2.1 1 3.3 6 2.6 3 2.8 1 3.2 3 3.0 0 3.5
  • 8.
  • 10.
  • 11.
  • 12.
  • 13.
  • 14.
  • 15.
  • 16. Content Validity (cont’d) Survey of Domain Step 1: Survey the Domain Step 2: Content Matches Domain Step 3: Test items reflect content Step 4: Adjusted for relative importance Content Matches Domain Item 1 x 3 Item 2 x 2 Item 3 x 1 Item 4 x 2 Item 5 x 2.5
  • 17.
  • 18.
  • 19.
  • 20.
  • 21.
  • 22.
  • 23.
  • 24.
  • 25.
  • 26.
  • 27.
  • 28.
  • 29.
  • 30.
  • 31.
  • 32.
  • 33.
  • 34.
  • 35.
  • 36.
  • 37.
  • 38.
  • 39.
  • 40.
  • 41.
  • 42.
  • 43.
  • 44.
  • 45.
  • 46.