Paired Comparisons
Systematically compare options in pairs to produce a ranked list
What is Paired Comparisons?
Paired Comparisons is a decision technique where every option is compared to every other option one pair at a time. For each pair, the team votes on which is better. The option that wins the most comparisons ranks highest. It is especially useful when criteria are hard to quantify or when the team struggles with the abstraction of scoring matrices.
When to Use It
- •When criteria-based scoring feels too abstract for the team
- •When options are qualitatively different and hard to score on a common scale
- •When the team needs a quick ranking of 4-8 options
- •As a validation check on criteria matrix results
How to Use It: Step by Step
- 1
List all options
Write each solution or option on a card or row. Label them A, B, C, etc.
- 2
Compare each pair
For every possible pair (A vs B, A vs C, B vs C, etc.), ask: "Which is better overall?" Record the winner.
- 3
Tally wins
Count how many times each option won. The option with the most wins ranks first.
- 4
Review the ranking
Does the ranking make intuitive sense? If not, revisit the comparisons where the team was most divided.
Example
Ranking 5 training program improvements
Options: A (video tutorials), B (peer mentoring), C (external certification), D (lunch-and-learn series), E (hands-on workshops). After 10 pairwise comparisons, the ranking was: E (4 wins), B (3 wins), A (2 wins), D (1 win), C (0 wins). Hands-on workshops won because they consistently beat every other option on engagement and retention.
Pro Tips
- ✓With N options, you need N*(N-1)/2 comparisons — keep options to 8 or fewer to stay practical
- ✓Use secret ballot for each comparison if power dynamics are a concern
- ✓If there is a tie, use a tiebreaker criterion the team agrees on in advance
Facilitation Guide
Run a 2-hour selection and planning workshop. Review the shortlisted ideas from Step 3 (10 min). Define evaluation criteria as a team and assign weights by consensus (20 min). Score each solution independently, then discuss and reconcile scores (30 min). Select the winning solution and document the rationale (10 min). Build the RACI chart — list tasks, assign R/A/C/I for each team member (20 min). Draft the implementation timeline with milestones, owners, and dates (25 min). Close with a risk brainstorm and mitigation plan (15 min).
Other Tools in Step 4
Criteria Matrix
Score and rank solutions against weighted criteria
RACI Chart
Assign roles: Responsible, Accountable, Consulted, Informed
Implementation Plan
Timeline, resources, milestones, and risk mitigation
Balance Sheet
Weigh gains vs. losses for each solution option to support selection decisions
Cost-Benefit Analysis
Compare the financial costs and projected benefits of proposed solutions
Try Paired Comparisons in your own project
Start Free