Simpson's Paradox
Teams and play two independent soccer matches. In match 1, team ’s average shooting accuracy exceeds team ’s. In match 2, team ’s average accuracy again exceeds team ’s. Does this guarantee that team ’s average accuracy over the two matches combined exceeds team ’s? If so, prove it; if not, give a counter-example with explicit shot counts and accuracies.
Work it out, then compare with the answer.
SolutionShow the worked solution
No. Interpret “average accuracy” as goals divided by shots. A team’s combined accuracy is then a weighted average of its two match accuracies. Each team’s weights are the fractions of its own shots taken in each match. If team takes almost all its shots in the match where everyone’s accuracy is low, and team in the match where it is high, the combined comparison can reverse.
Write for team ’s accuracy in match , and for the fraction of team ’s total shots taken in match . Then
The inequalities and say nothing about versus once .
Counter-example.
| Match 1 | Match 2 | Combined | |
|---|---|---|---|
| Team | |||
| Team |
Team is more accurate in match 1 () and in match 2 (). Yet over both matches scores of shots and scores of . So ’s combined accuracy is far higher.
The reason is the weights: while . Almost all of ’s shots come in the low-accuracy match, and almost all of ’s come in the high-accuracy match. This reversal is Simpson’s paradox.
Generalisation. The conclusion does hold if both teams split their shots between the matches in the same proportion, i.e. . In that case
Key idea. Pooled rates are weighted averages with group-specific weights, so a comparison that holds within every group can reverse in the aggregate.