Use production data to compare ad unit configurations and monetization strategies.

Introduction

CloudX assigns eligible traffic between a control group running your current setup and a test group running an edited variant. This lets you try different line items, bid floors, or network configurations while keeping a control group for comparison. Throughout the test, CloudX tracks total revenue, ARPU, eCPM, fill rate, and impressions side by side and surfaces daily trends and cumulative comparisons. When you’re ready, you can easily apply the winning variant to production.

Create an A/B test

See the Dynamic Pricing guide for its A/B workflow.

For line-item tests, CloudX splits ad traffic between your current setup and a test variant.

• Control group A uses your current setup
• Test group B uses cloned or suggested line items that you can edit before launch

Before creating a test, make sure the ad unit:

1. Belongs to an active app
2. Has at least one active line item that applies to it
3. Has the bidder mappings required by the test configuration

To create an A/B test:

1. Open Ad Units and select the ad unit you want to test
2. Open the A/B tests tab and click Create A/B test
3. Choose an experiment type:
   • Manual setup: clone your current line items into the test group
   • Suggested setup: let CloudX suggest the test group from your revenue data
4. Enter a test name
5. Set Apply test treatment to to a whole percentage from 1% to 50%. The remaining traffic stays in Control group A
6. Click Create A/B test

You can also select Create A/B test from A/B Tests in the sidebar and choose an ad unit.

With Manual setup, CloudX creates a draft test and clones the applicable line items into Test group B. This includes line items assigned through ad unit groups.

Suggested line items

Choose Suggested setup to fill Test group B with suggested line items instead of copies of your current ones. CloudX uses the same analysis as the Line Items section on the ad unit’s Monetization tab in Manual mode.

‹

›

Start a test

For manual or suggested line items, open the draft test detail page to review the setup before it starts.

In draft status, you can:

• Update the test name
• Change the test group’s traffic share
• Review the control and test line items
• Edit the cloned test line items
• Resolve bidder mapping gaps

Click Start A/B test to begin splitting traffic between the two groups.

Review results

Use A/B Tests in the sidebar to review tests across your account. You can search by test name or ID, and filter by status, app, or ad unit.

Use Group to group tests by status, app, or ad unit, with an optional second level. Use Columns to choose which details appear. The ad unit’s A/B tests tab also lists completed tests under History.

For line-item tests, the detail page shows:

• Start date and duration
• App and ad unit
• Traffic split
• Daily trends for Total revenue, Impressions, eCPM, and Fill rate
• Cumulative comparison metrics for ARPU, Total revenue, Impressions, eCPM, and Fill rate

The result badge summarizes the current statistical read:

• Pending: the test has not reached a statistically significant conclusion
• Directional: the test has a visible direction but has not met the threshold for an achieved result
• Achieved: the test has reached a statistically significant conclusion

CloudX also keeps a historical line item snapshot so you can review the test configuration after the run ends.

End the test

To finish an active line-item test, click End test and choose an outcome:

• Promote test: apply the test-group configuration to the live ad unit
• Keep control: discard the test-group line items and keep the current production setup

After the test ends, the result remains visible in the A/B Tests workspace for future reference.

Promoting a test variant cloned from a shared ad unit group also updates that group’s line item. Review the affected ad units shown in the confirmation dialog.