Here is a simplified version of Item Analysis for Educational Assessments. Covered here are terminologies, formulas, and processes in conducting Item Discrimination and Difficulty. Thank you. Namaste!
11. Very difficult
or very easy
items
contribute
little to the
discriminating
power of a
test.
12. each of these groups
consists of
twenty-seven
percent of the
total group of
students who took
the test and is based
on the students’
total score for
the test
13. It is the difference
between the proportion
of the top scorers who
got an item correct
and the proportion of the
bottom scorers who got
the item right
14. each of these groups
consists of twenty-seven
percent of the total
group of students who
took the test and is based
on the students’ total
score for the test
18. Such an item should be
revised and eliminated
from scoring as it
indicates that the
lower performing
students actually
selected the key or
correct response more
frequently than the top
performers.
19. It is another useful step in
reviewing the effectiveness
of a test item. All of the
incorrect options, or
distractors, should
actually be distracting.
26. 1. Arrange the test scores
from highest to lowest.
2. Select the Criterion Group
- identify the high group
(top 27%)
and low group
(lowest 27%)
27. Note:
Top 50% and
bottom 50% for a
class with less
than 30 students
Top 27% and
bottom 27% for a
class with 30 or
more students
28. 3. For each item, count the
number of examinees in the
upper group who have
correct responses. Do a
separate, similar procedure
for the lower group.
29. 4. Solve for the difficulty index
of each item:
(for test items scored with 0 and 1 like matching
type, multiple choice and true or false )
n
cLcH
p
2
Index of difficulty of each item
No. of students in the high group who got correct responses
on the particular item
No. of students in the low group who got correct responses
on the particular item
n
cL
cH
p
No. of students in the criterion group
30. 5. Difficulty index (p) scale:
below 0.25 item is very difficult
0.25 - 0.75 item is of average
difficulty
Above 0.75 item is easy
31. 6. Solve for the discrimination
index (D) of each item:
(for test items scored with 0 and 1 like matching
type, multiple choice and true or false )
n
cLcH
D
n
cL
cH
D
No. of examinees in the high group who have correct responses
to the particular item
Is the discrimination index of a particular item
No. of examinees in the criterion group
No. of examinees in the low group who have correct responses
to the particular item
32. 7. Discrimination index (D) scale:
0.40 and above very good item
0.30 - 0.39 reasonably good item
but possibly subject
for improvement
0.20 – 0.29 marginal item, subject
to improvement
Below 0.20 poor item, to be
rejected or revised