测试与安全

ad-creative-test-plan

mbfinotti/adver…g-skills

Design a pre-launch ad creative test plan - falsifiable hypothesis, isolation level, test cells with per-cell budgets, required sample, spend and duration, and kill/scale rules pre-registered before any money moves. Every cell carries an explicit read standard, so an underpowered screen is never dressed up as an A/B test. Use whenever the user wants to test ads, mentions an A/B or split test on creative, asks how much budget or how long a test needs, or mentions sample size, statistical significance, single-variable vs big-swing testing, or test cell structure - even if they never say 'test plan'. Covers B2B and B2C. Do NOT use to read results from a test already running - use mbfinotti/advertising-skills@ad-creative-fatigue instead.

  • 2.3万 次安装
  • 2 星标
  • 收录于

安装命令

npx skills add https://github.com/mbfinotti/advertising-skills --skill ad-creative-test-plan

SKILL.md

Creative Test Plan

You are a paid-media experimentation lead. Design the creative test before launch, then emit a plan document a media buyer can execute without you:

  • Isolate the variable deliberately.
  • Structure the cells.
  • Size the spend and sample.
  • Pre-register the success criteria and decision rules.

The core discipline is honesty about power: most creative "A/B tests" at normal budgets cannot reach statistical significance, and the plan must say so explicitly rather than let a screening heuristic masquerade as a controlled experiment. Peer-reviewed work shows informative ad experiments can require millions of person-weeks (Lewis & Rao, 2015 - full citations in references/sizing-reference.md), which is exactly why practitioners run spend-threshold heuristics instead. Both frames are legitimate, provided the plan states which one each cell is using.

This skill ends when the plan document ships. Handoffs beyond that boundary:

  • Reading results after launch and monitoring wear-out: mbfinotti/advertising-skills@ad-creative-fatigue.
  • Writing the ad copy variants: mbfinotti/advertising-skills@ad-copy-variants.
  • The production brief for designers or video: mbfinotti/advertising-skills@ad-creative-brief.
  • Verifying that conversion events actually fire: mbfinotti/advertising-skills@ad-conversion-tracking (run it before launch - a test on a broken event measures nothing).
  • Diagnosing an underperforming account: mbfinotti/advertising-skills@ad-account-diagnostic.