Skip to main content

A plain-English guide

A/B test

A comparison of two versions shown to separate groups to learn which performs better on a chosen measure.

Also called: Split test

What it means in practice

Change one important element where possible and decide what success means before starting. Small samples can produce misleading winners.

An everyday example

A shop tests two email subject lines and compares clicks to the same collection.

Why it matters

Testing replaces guesswork with evidence, but a short-term result should not be treated as a universal rule.

Your preferences

Privacy choices

Choose which optional services can run on this website. Everything optional stays off until you choose. You can change your settings at any time.

Advertising tags are not configured on this website. These settings apply to this browser on this website; platform and ordering accounts have their own choices.

Make yourself comfortable

Accessibility

Choose what makes this page comfortable. Preferences stay on this device.

Navigate this page

Keyboard shortcuts

On a Mac, Alt is the Option key. Shortcuts do not run while you’re typing in a field, or with Control or Command held.

Alt + Shift + A
Open accessibility tools
Alt + Shift + S
Navigate by page structure
Alt + Shift + ?
Show keyboard shortcuts
Alt + Shift + T
Text size: next size
Alt + Shift + C
Contrast: next level
Alt + Shift + F
Focus outline on or off
Alt + Shift + L
Highlight links on or off
Alt + Shift + H
Highlight headings on or off
Alt + Shift + M
Stop animation on or off
Alt + Shift + G
Reading guide on or off
Alt + Shift + R
Reset everything

Policies & Choices

Open Page →