A/B testing: definition and method.

How to compare two versions of a page on live traffic, what to test first, and the mistakes that produce false winners.
Portrait of Roland Vekemans, co-founder of BeBranded
Roland, co-founder of BeBranded
Consulting · Updated Nov 7, 2026

DEFINITION

A/B testing compares two versions of a page or element on live traffic to find which one performs better against a defined goal such as conversions.

ALSO CALLED

Split testing

CATEGORY

Consulting

RELATED

CRO, KPI

The essentials · 30-second read

A/B testing compares two versions of a page or element on live traffic to find which one performs better against a defined goal such as conversions.

  • Use it on high-traffic pages with a clear goal: landing, pricing, checkout.
  • Change one thing at a time, and define the KPI before the test starts.
  • Run it for at least two full weeks, or until the planned sample size.

Summarize this page with AI

A/B testing, also called split testing, is an experiment in which two versions of the same page or element are shown to different visitors at the same time. Version A is the control, version B is the variation. After enough traffic, you compare a single metric, such as sign-ups or clicks, to see which version wins.

The value of the method is that it replaces opinions with evidence. Instead of debating which headline is better, you let real visitors decide.

01

How an A/B test works

A test follows a simple loop. Visitors are split at random between the two versions, each visitor always sees the same version, and the results are recorded against one goal.

  • Hypothesis: "If we shorten the form, more visitors will submit it."
  • Variation: change one meaningful element, not ten.
  • Split: typically 50/50 of the traffic.
  • Measurement: one primary KPI defined before the test starts.
  • Decision: keep the winner or learn from a flat result.
02

What to test first

Start where a small gain has the biggest impact: pages with high traffic and a clear goal. A landing page, a pricing page or a checkout step is a better candidate than a rarely visited page.

  • Headlines and value propositions
  • Call-to-action wording, colour and position
  • Form length and field order
  • Page layout and social proof
  • Pricing display and offers
03

A/B testing, multivariate and split URL: the differences

MethodWhat changes
A/B testOne element, two versionsModerate
Multivariate testSeveral elements combinedHigh
Split URL testTwo different pages on two URLsModerate
04

Common A/B testing mistakes

Most failed tests share the same causes. Stopping a test as soon as one version looks ahead produces false winners: wait for the planned sample size and a full business cycle, usually at least two weeks. Testing several changes at once makes it impossible to know what worked. Running a test on a page with too little traffic gives results that are mostly noise.

Also remember that a statistically significant result is not always a meaningful one. Check that the gain matters for your business before rolling it out.

05

A/B testing at BeBranded

We help teams choose what deserves a test, define the KPI and read the results with the right level of caution. It fits into our consulting service, where we turn analytics and user feedback into prioritised experiments.

FAQ

Questions about A/B testing.

Another question?

Write to us
What is A/B testing?
It is an experiment that shows two versions of a page or element to different visitors at the same time, then compares them on one metric to find the better one.
How long should an A/B test run?
Until it reaches the planned sample size, and for at least one or two full weeks to cover weekly behaviour. Stopping early is the most common cause of false winners.
How much traffic do I need?
It depends on your conversion rate and the gain you expect to detect. Low-traffic pages often cannot support a reliable test, so test bigger changes or pool similar pages.
What is the difference between A/B and multivariate testing?
An A/B test compares two versions with one change. A multivariate test combines several changes at once and needs much more traffic.
Does A/B testing affect SEO?
Not if done properly. Avoid cloaking, use a rel=canonical on split URL tests, and end the test once you have a result.
What should I test first?
Start with high-traffic pages that have a clear goal, such as a landing page, a pricing page or a checkout step, and test headlines or calls to action first.

Related

Related terms, and where to go next.

BeBranded
Conversion

CRO: definition, method and how to apply it on Webflow

What is CRO? Definition, conversion rate formula, 4-step method, KPIs to track, and practical application on Webflow. Complete guide for SMBs, SaaS & e-commerce

Read the article
BeBranded
Conversion

Landing page: examples, structure and mistakes

Landing page: proven structure, concrete examples by goal, common mistakes that kill conversion, and why Webflow is the ideal platform.

Read the article
BeBranded
Webflow

Webflow developer in 2026: role, rates and how to hire the right one

What a Webflow developer does, what one costs in 2026 depending on the profile, how far custom Webflow development goes, what AI changes, and how to choose between a freelancer and an agency.

Read the article

Let’s talk

Tell us what you want to build.

Thirty minutes with the people who will work on your project. You leave with a clear view of the scope, the timeline and the next steps.

What happens next

  1. 1A 30-minute callWe listen to your goals, your constraints and your context.
  2. 2A clear scopeWe map what is worth doing first, and what it takes.
  3. 3A costed proposalYou decide, with no commitment and no sales pitch.