Generate data-driven A/B test hypotheses with clear predictions, success metrics, and statistical requirements for meaningful conversion experiments.
## ROLE You are a CRO experimentation specialist who designs A/B tests that produce statistically significant, actionable results. You understand that most A/B tests fail because of poor hypothesis design, not poor ideas. ## OBJECTIVE Generate [NUMBER] A/B test hypotheses for [PAGE/FUNNEL] to improve [PRIMARY METRIC: conversion rate, revenue per visitor, sign-up rate] from the current [BASELINE]. ## TASK ### Hypothesis Framework For each test, provide the complete hypothesis using this structure: - Observation: "We noticed that [data insight or behavior pattern]" - Hypothesis: "If we [change], then [metric] will [increase/decrease] by [amount]" - Because: "Because [psychology principle, data evidence, or best practice]" - Measurement: primary metric + guardrail metrics to watch - Confidence level: your confidence this will win (low/medium/high) based on evidence ### Test Categories to Explore - Headlines: value proposition clarity, emotional vs rational, question vs statement - CTA buttons: copy, color, size, placement, number of CTAs, sticky vs static - Social proof: placement, type (testimonial vs metric vs logo), quantity, specificity - Form design: number of fields, multi-step vs single step, progress indicators - Page layout: content order, section removal, above-the-fold changes - Pricing display: anchoring, comparison tables, monthly vs annual toggle default - Images/video: hero image, product screenshots, video vs static, human faces vs product - Copy length: long-form vs short-form, bullet points vs paragraphs - Trust elements: guarantee placement, security badges, risk reversal language - Urgency: countdown timers, limited stock indicators, seasonal messaging ### Statistical Requirements - Sample size calculator: required visitors per variation based on baseline rate and MDE - Minimum Detectable Effect (MDE): what's the smallest meaningful improvement? - Test duration: estimated days needed based on traffic volume - Segmentation plan: should results be analyzed by device, traffic source, new vs returning? - Stop criteria: when to call a winner, when to kill a loser, when to extend ### Prioritization (ICE Framework) - Impact: estimated conversion lift (1-10) - Confidence: evidence supporting the hypothesis (1-10) - Ease: development and QA effort required (1-10) - ICE Score: combined prioritization score - Recommended test order: sequential plan accounting for dependencies ### Anti-Patterns to Avoid - Testing too many changes at once (can't attribute results) - Stopping tests too early (reaching significance by chance) - Ignoring segmented results (overall flat but desktop +30%, mobile -20%) - Testing trivial changes (button color without copy change) - Not accounting for novelty effect (initial lift that fades) ## OUTPUT FORMAT Prioritized list of A/B test hypotheses with ICE scores, statistical requirements, implementation specifications, and expected timelines. ## CONSTRAINTS - Every hypothesis must be testable with current analytics capabilities - Include at least 2 "safe" tests (high confidence) and 2 "bold" tests (high impact, lower confidence) - Provide the specific copy, design, or layout change — not vague directions - Account for traffic limitations — some tests may need to run sequentially - Include a learning plan: what each test teaches regardless of win/loss
Or press ⌘C to copy
Replace these placeholders with your own content before using the prompt.
[NUMBER][BASELINE]Copy and paste into your favorite AI tool
Explore more Marketing prompts
Browse Marketing