Prioritize your A/B tests by traffic times impact times ease, not by whoever argues loudest in the meeting. Every store has more test ideas than traffic to run them, which makes prioritization the actual skill. The store that runs its best idea first beats the store that runs its founder’s favorite, every quarter, forever.
The scoring takes ten minutes. For each idea, rate three things from 1 to 5: Traffic, how many sessions actually see the thing you are changing; Impact, how big a behavior change you honestly expect if it wins; Ease, how cheap it is to build and undo. Multiply. Run the highest score first. That is the whole system, and its entire value is that multiplication does not have feelings.
The scorecard, worked
Four real-shaped ideas from one backlog. Note who wins and who loses.
| Idea | Traffic | Impact | Ease | Score |
|---|---|---|---|---|
| Move guarantee + delivery estimate next to add-to-cartevery PDP session sees it | 5 | 3 | 5 | 75 |
| New hero concept on home pagehigh traffic, real build effort | 4 | 4 | 2 | 32 |
| Rewrite bundle page copystrong idea, page nobody visits | 1 | 4 | 4 | 16 |
| Founder’s favorite: rearrange footer linksloud advocate, quiet numbers | 2 | 1 | 5 | 10 |
The footer idea had the loudest champion and scores dead last. That is the scorecard doing its job: it converts opinions into arithmetic, and arithmetic is hard to filibuster.
Scoring honestly
- Traffic is a lookup, not an opinion. Pull page sessions from analytics before scoring. Ideas on low-traffic pages are hobby projects wearing lab coats: remember from tip 7, thin traffic means tests that cannot reach a verdict.
- Impact is where your funnel data earns its keep. Ideas aimed at the leaky step you circled in tip 11 score high; ideas polishing an already-healthy step score low, however pretty the mockup.
- Ease includes the undo. A change you can revert in five minutes is worth an extra point. A change that needs a developer and an apology tour is not “a 4.”
- Rescore monthly. Traffic shifts, seasons turn, and last month’s number 3 idea may be this month’s number 1.
Keep the backlog in a plain spreadsheet where everyone can add ideas and see the scores. The transparency is half the value: when the loudest voice in the room can watch their pet idea lose to arithmetic in public, your testing program stops being politics and starts being compounding.
