Conversion Rate Optimization Testing & Experimentation

Freeze Experiments Before BFCM: Run the Playbook

November 9, 2026 by Wade

Freeze experiments before BFCM: from here on you run the playbook, not the lab. Ship winners, park the rest until December.

← All 100 tips · Tip 80 of 100 · 21 days to Cyber Monday

Freeze your A/B tests before BFCM. Three weeks out is the line: from here to Cyber Monday you run the playbook, not the lab. Every experiment currently live on your store should end this week with one of two verdicts. It has a winner: ship the winner to 100% and thank it for its service. It does not have a winner yet: park it, write down exactly where it stood, and restart it in December with clean data.

This feels wrong to exactly the merchants who have been doing this series right. You built the testing habit, you have a backlog of good hypotheses, and now the biggest traffic of the year is coming, surely that is the best time to test? It is the worst, for two separate reasons.

Reason one: the data is poisoned. BFCM shoppers are not your shoppers. They are colder, more deal-driven, more mobile, more first-time, and they behave like it. A variant that wins with November’s discount hunters can lose with the customers who pay your bills the other eleven months. Whatever you “learn” between now and Cyber Monday describes a population that vanishes on December 2nd.

Reason two: the downside is asymmetric. A losing variant in February costs you half your traffic’s conversion for a couple of weeks, annoying but survivable, that is the price of learning. The same loser running through Black Friday weekend takes its bite out of the densest revenue hours of your entire year. You are wagering your Super Bowl on a coin whose whole premise is that you do not know which way it lands.

The freeze checklist

Close every live test this week. Ship winners fully. Park anything unresolved; a paused test is not a failure, it is a bookmark.
Write the December restart list. Every parked test and every backlog idea goes on it, with the hypothesis and metric already written. December-you will be tired; leave December-you a script.
Keep measuring everything. The freeze is on experiments, not instruments. Your baselines, funnel numbers, and heatmaps keep running; BFCM data is gold for observation even though it is poison for testing.

From tomorrow, every tip in this series is playbook material: things you ship because they are right, not things you test because you wonder. The lab reopens in December. Go make sure there is something worth measuring by then.

← All 100 tips · Tomorrow, tip 81: where thumbs can actually reach on a phone, and which of your buttons live outside that zone.

Small catalog (under 50 products)? Fewer, richer collections beat a taxonomy built for a catalog you don’t have.

Small Catalog? Fewer, Richer Collections Win

← All 100 tips · Tip 82 of 100 · 19 days to Cyber Monday Small catalog collection strategy in one line: if you sell fewer than 50 products, you almost certainly need fewer collections, not more. This is the opposite of the instinct. Merchants with 30 products look at stores with 3,000, copy their […]

Thumb Zone: Primary Actions in the Bottom Half

← All 100 tips · Tip 81 of 100 · 20 days to Cyber Monday The thumb zone is the region of a phone screen a thumb reaches without the hand shifting grip, and it should dictate where every primary action on your mobile store lives. Most of your BFCM traffic will arrive on phones, […]

Social proof above the fold on the home page: review count, press, customer photos. Borrowed trust for first-time visitors.

Social Proof Above the Fold on Your Home Page

← All 100 tips · Tip 79 of 100 · 22 days to Cyber Monday Social proof above the fold on your home page is not decoration, it is the answer to the only question a first-time visitor is silently asking: “is this store real?” Your Black Friday ads are about to send you the […]

PDP Cross-Sell: Complements, Not Alternatives

← All 100 tips · Tip 78 of 100 · 23 days to Cyber Monday Product page cross-sells come in exactly two species: “goes with this” and “instead of this”. One grows the order. The other hands your almost-buyer a menu of reasons to keep shopping. Most Shopify themes ship a “related products” section that […]

When NOT to test: obvious fixes, broken things, and anything with too little traffic to decide. Just ship.

When NOT to A/B Test: Just Ship the Obvious Fixes

← All 100 tips · Tip 77 of 100 · 24 days to Cyber Monday Knowing when NOT to A/B test is as much a CRO skill as knowing how to run one. This series has spent several tips teaching testing discipline, so here is the counterweight: testing has a cost. Every test takes calendar […]

Merchandise Your Search Results Page Like a Collection

← All 100 tips · Tip 76 of 100 · 25 days to Cyber Monday Your search results page is a collection page visited exclusively by your highest-intent shoppers, and it is probably the least merchandised page on your store. Think about that asymmetry for a second. You agonize over which product leads your bestsellers […]

Cart cross-sell: complementary and cheap (“add the matching X”) lifts AOV; competing products just add doubt.

Cart Cross-Sell: Complementary and Cheap Lifts AOV

← All 100 tips · Tip 75 of 100 · 26 days to Cyber Monday Cart cross-sell is the highest-leverage upsell placement on your store, and it is also the easiest one to botch. The shopper has decided. The wallet is halfway out. What you show in the cart at that moment either rides the […]

Shopify Sidekick can already answer real merchandising questions about your store: what it does well today, and where apps extend it.

What Shopify Sidekick Answers Well Today

← All 100 tips · Tip 74 of 100 · 27 days to Cyber Monday Shopify Sidekick is the AI assistant already built into your Shopify admin, and most merchants still treat it like a search box with delusions. That is a waste, especially 27 days out, when every question you can answer in one […]

Set-and-forget merchandising rots: bestsellers change weekly in Q4. Automate the re-sort or calendar it.

Set-and-Forget Merchandising Rots in Q4

← All 100 tips · Tip 73 of 100 · 28 days to Cyber Monday Set-and-forget merchandising rots, and in Q4 it rots on fast-forward. The collection order you lovingly arranged in September was a photograph of a store that no longer exists: different bestsellers, different stock levels, and, crucially, different shoppers. The gift buyer […]

GA4 and Shopify analytics will never match: know why, pick one source of truth, and stop re-litigating the gap every Monday.

GA4 and Shopify Analytics Will Never Match: Here Is Why

← All 100 tips · Tip 72 of 100 · 29 days to Cyber Monday GA4 and Shopify analytics will never agree, and the sooner your team accepts this as physics rather than a bug, the sooner Monday mornings stop being a jurisdictional dispute. The two systems count different things, with different rules, from different […]

Urgency only works when it’s true: real stock counts and real deadlines. Fake timers train shoppers to ignore you.

Urgency Only Works When It Is True

← All 100 tips · Tip 71 of 100 · 30 days to Cyber Monday Urgency on a product page works for exactly one reason: it is information. “Two left in your size” answers a real question, should I decide now or can I sleep on it, with a real fact. The moment the fact […]

Price Anchoring Done Honestly

← All 100 tips · Tip 70 of 100 · 31 days to Cyber Monday Price anchoring works because a price has no meaning until it stands next to another price. $69 is just a number; “$89, now $69” is a story with a hero. Shopify hands you the mechanism in the compare-at price field, […]