Item analysis checks how well each question on a test works. The item difficulty and discrimination calculator takes the size of the upper and lower groups, the correct answers in each and the number of answer options, and gives the difficulty index, the discrimination index, the chance level and the ideal difficulty.
How the calculation works
- Rank the test takers by total score and take the upper group and the lower group, often the top and bottom 27 %, with the same size n.
- The difficulty index is the proportion who answered the item correctly across both groups: p = (correct upper + correct lower) ÷ (2 × n). A high p means an easy item.
- The discrimination index is the gap between the groups: D = (correct upper − correct lower) ÷ n. It runs from −1 to +1.
- The ideal difficulty for a multiple-choice item is halfway between chance, which is 1 ÷ options, and 1: (1 + 1 ÷ options) ÷ 2.
Example
An item is given to the top 27 and the bottom 27 test takers, with 4 options. 24 of the top group and 10 of the bottom group answer correctly. The difficulty is 34 ÷ 54 = 0.630, close to the ideal of 0.625. The discrimination is 14 ÷ 27 = 0.519, which is excellent. Chance level is 0.25.
Why it matters
A test is only as good as its questions. Item analysis finds the items that are too easy, too hard, miskeyed or unable to tell strong students from weak ones, so they can be fixed before the next use.
Good to know
The indices come from small groups and are noisy, so use them as flags and not as verdicts. They also assume a test that measures one main skill, and an item in a mixed test can look weak while measuring something that matters. Review flagged items before deleting them.
Related tools
The Cronbach’s alpha calculator measures the consistency of the whole test, and the percentile calculator ranks a single score within a group.