2025-11-18

Designing a holdout calendar finance will not reject

By Rowan Ivers

Finance teams rarely reject incrementality because they dislike experiments—they reject black boxes. Start by publishing a calendar that lists every planned media pulse, known retail promotions, and expected site releases. Pair each test cell with an explicit leakage note: coupon codes shared across regions, influencer spikes, or CRM blasts that ignore geo fences.

Second, attach a one-page power sketch. Even a conservative estimate beats silence. Use historical variance from the prior year, not optimistic lift assumptions. If your cells are under-powered, say so and widen the inference window rather than compressing it to meet a launch date.

Third, align on readout metrics before the pause begins. Contribution margin should lead when inventory risk exists; MER is acceptable only when stock is stable. Document the switch criteria so nobody reopens the debate mid-test.

Finally, archive the raw brief in your wiki with links to warehouse exports and ad logs. Northstar Retention Lab cohorts treat the brief as part of the deliverable, not a side note. That habit alone reduces re-work when leadership asks why a cell looked noisy two quarters later.

Attribution · Finance