Browse the help center

Use case: A/B-test creatives inside one campaign

Rotate two or more banners against each other inside one campaign with equal weights, read per-banner CTR or I2C in a report after a few hundred clicks each, and promote the winner by weight, by switching the loser off, or by handing the pick to CTR optimization.

How-to network manager Account → Advertisers → advertiser → campaign

Who: a network manager (or an advertiser with a network manager’s help) running the campaign Brand Awareness Q3 for Northwind Media. Goal: find out whether the new MPU creative Variant C beats Variant B before the whole budget goes to one of them. Outcome: both variants rotate 50/50 inside the same campaign for a week; the report shows Variant B at 0.21 % CTR on 4,800 clicks and Variant C at 0.34 % on 4,650 — the loser’s weight is dropped and the campaign spends the rest of its budget on the winner. No extra campaign copies, no change to targeting, pricing or placements.

Typical scenarios

You wantSetWhere
A fair 50/50 between two creativesBoth banners Weight 1 (the default), optimizers offBanner → Basic information; campaign → Advanced settings
A careful ramp of a new creativeNew banner Weight 1, incumbent Weight 9 (≈10/90)Banner → Basic information
Judge on conversions, not clicksAttach a conversion action to the campaign; read I2C in the reportCampaign → conversion actions; Analytics
Let the platform promote the winnerTick CTR optimization (or I2C optimization for actions) once the test window is overCampaign → Basic information → Advanced settings
Retire the loser at onceSwitch its Active off (a weight alone cannot stop a banner; its minimum is 1)Banner → Basic information, or the tree’s power icon

Step by step

Before you start you need one campaign whose banners already serve — linked to placements, or matched by rules (see the Go-live checklist) — and two or more banners of the same type and size, so they compete for the same slots.

  1. Create the variants. In the campaign, use Add new banner to add the versions. Name them so the report reads well: MPU 300x250 — Variant B, MPU 300x250 — Variant C.

  2. Split the traffic. Open each banner and set Weight on its Basic information card. The field is required, accepts 1–32 767 and starts at 1, so banners you leave alone already rotate evenly. Set explicit weights (50/50, or 90/10 for a careful ramp) only when you want an uneven split, and keep them equal until you have data. Rotation is a weighted lottery run per request, not a rota — over a few dozen impressions the realised split can look nothing like the configured one.

    Banner Basic information card with the Weight field

  3. Don’t optimize while testing. On the campaign’s Basic information card, open Advanced settings and leave CTR optimization and I2C optimization for actions unticked for the test window. Once either is ticked, the share of traffic the optimizer steers stops following weights and concentrates on the creative that is scoring best, which spoils a fair read-out. Turn one on later as your “auto-promote” step (step 6).

    Campaign Advanced settings with CTR optimization and I2C optimization for actions unticked

  4. Run the test window. Give each variant enough volume — as a rule of thumb a few hundred clicks per variant, not a threshold the product enforces — before CTR differences mean anything.

  5. Read the results. In Account → Analytics, set the Date range, choose Group by → Banner, tick the campaign in the Advertisers filter tree, and click Run report. Compare CTR and, if a conversion action is attached, I2C. The tree hides inactive entities by default (the eye button at the top of the panel), so a banner you have already paused is only tickable after you un-hide inactive ones.

    Analytics report grouped by banner comparing CTR across creatives

  6. Promote the winner. Pick one:

    • lower the loser’s Weight (the smallest value is 1, so a weight alone cannot stop a banner) or switch it off with its Active switch;
    • tick CTR optimization (or I2C optimization for actions) on the campaign and let the optimizer take over the pick.

Caveats and exceptions

  • Who can do this. The stock Network Manager role sets campaign and banner Weight and the CTR optimization and I2C optimization for actions checkboxes, so nothing here needs your network administrator. On the stock Advertiser role Weight is read-only and the optimizer checkboxes are off: an advertiser can create the variants, use the Active switch and read the results, and asks their network manager to set the split and the optimizer (or to switch these on for the role). Priority is the network’s call. The optional Banners probability check reads a placement, a supply-side page a network manager reaches directly and an advertiser does not. On a Can view share Weight and the optimizer checkboxes are locked; the report still runs.
  • Weights only arbitrate between banners that both match the request. If Variant C has narrower targeting or a different size, the split will not follow the weights — fix the matching first.
  • Turning an optimizer on mid-test reshapes the split without any warning. The optimizer serves the single best-scoring banner for the share of traffic it steers and falls back to weights only for the remaining exploration share, so the “loser” may simply have stopped getting traffic, not lost. Compare only windows where the optimization state was constant. Unticking the box deletes what it had learned, so switching it off and on again restarts from zero. The share of traffic the optimizer steers is a network-wide optimization setting, which your network administrator owns.
  • CTR and I2C optimization are mutually exclusive — the form unticks the other. The Actions picker beside I2C limits which conversion actions count (All by default).
  • An optimizer never changes a banner’s stored Weight. After you switch it off, delivery returns to whatever weights are saved.
  • Banners probability is a forecast of the weighted path only. It models nine kinds of targeting (blocked advertisers, campaigns, banners, placements and sites, plus Country, Browser, Operating System and Mobile Carrier) and ignores day, time, device and the rest, and it does not know about the CTR or I2C optimizers — on an optimized campaign the real split is more concentrated than the card shows. Its Ignore Priority filter spreads probability across every priority tier at once; the default As served view does not. Use it to confirm that all your variants are eligible on a placement, not to predict an optimized split. See Optimize ad rotation.
  • Pausing keeps history; deleting hides it. Prefer pausing to deleting until the analysis is archived.

Not working?

SymptomCheckWhere
The split is nowhere near 50/50Too few impressions (a lottery per request, not a rota); or one variant has narrower targeting or a different size and does not match the same requests.Banner → Targeting; banner size vs. placement
One variant suddenly gets almost all the trafficAn optimizer was ticked mid-test. Compare only windows with a constant optimization state.Campaign → Advanced settings
The loser still serves after you lowered its weightThe minimum weight is 1; switch the banner’s Active off instead.Banner → Basic information
A paused banner is missing from the report filterThe Advertisers filter hides inactive entities by default; click the eye button.Analytics → Advertisers filter
Weight or the optimizer checkboxes are lockedStock Advertiser role, or a Can view share. Ask the network manager.Role grants; share level
Banners probability shows an even split on an optimized campaignThe card ignores the optimizers; it forecasts the weighted path only.—
The optimizer “forgot” after a retickUnticking deletes what it learned; it restarts from zero.Campaign → Advanced settings
No I2C columnNo conversion action is attached to the campaign.Campaign → conversion actions

Reference

LeverWhereUse it for
Banner WeightBanner → Basic informationFixed traffic split during the test. Required, 1–32 767, default 1.
Banner Active switchBanner → Basic information; the power icon beside the banner in the treeRetiring a losing variant at once.
CTR optimizationCampaign → Basic information → Advanced settingsAfter the test: steers the banner pick toward the best click-through rate. Mutually exclusive with I2C — the form unticks the other.
I2C optimization for actionsSame placeSteers the pick toward the best impression-to-conversion rate; the Actions picker beside it limits which conversion actions count (All by default).
Group by → Banner and the Advertisers filterAccount → AnalyticsThe per-banner read-out.
Banners probability cardPlacement → Banners probabilityA read-only forecast of the weighted split on one placement. It shows the draw, it never changes it.

Related pages

Please disable Adblock
Are you using adblock? Disable it and reload the page to proceed to the destination page.

A registration has already been submitted from this page. Please try again in 10 minutes.