Incrementality Testing
AI-powered Incrementality Test
Incrementality Test Introduction
A GeoLift experiment (often referred to as Incrementality Test) is, in general, the most accurate way to measure the true impact of marketing without relying on individual tracking, which can bias results due to privacy restrictions.
It splits the target market into similar test and control regions, launches ads only in the test regions while keeping the control regions as the holdout, and then compares the business outcomes between the two to estimate the incremental impact of the marketing activity.
Marketing Measurement Overview summarizes its benefits and limitations and compares this approach with other common methods.
The Maxma Advantage
While incrementality testing is the gold standard for measuring marketing impact, it has traditionally been limited to big brands and tech companies due to its high cost and complexity. Even modern vendors charge around $10,000 per experiment, making it impractical for most businesses to run tests at scale.
Maxma is changing that with our AI-powered Incrementality Test, designed to make rigorous experimentation accessible, scalable, and cost-effective.
Challenges with Traditional Incrementality Testing
- Requires deep statistical expertise to design valid experiments
- High cost of professional services or specialized in-house teams
- Long lead times to set up and analyze experiments
- Risk of inconclusive results due to poor experimental design
Imagine an AI expert embedded with deep knowledge of attribution, statistical methods, and marketing domain knowledges, understand all the pitfalls and best practices of incrementality testing, to guide you through the entire process - from experiment design to analysis. Human experts with such expertise are hard to find and expensive. But our AI expert is always available to help you run rigorous tests with confidence.
Expert Support
While our AI makes incrementality testing accessible to everyone, our team of experts is always available for additional support and consultation.
Scale Without Sacrifice
- Reduce costs—run experiments for a fraction of traditional costs
- Instant guidance—AI expert available 24/7
- Human expert support—human expertise is optional, not a bottleneck
Flexible and Customizable
- Tailor experiments to fit your business needs and constraints
- Iterate quickly—refine your test design without additional costs or delays
Use Cases
Different Testing Scenarios
Maxma Incrementality Testing supports a variety of testing scenarios:
- Current Budget: Measure incrementality at the existing spend level.
- Heavy-Up: Test the impact of increasing ad spend to prevent diminishing returns and saturation.
- Dial-Down: Reduce spend safely with potential missed opportunities measured.
- New Launch: Before scaling a new advertising initiative, test for detectable incremental impact at the lowest possible spend level to minimize risk.
Multiple Metrics
Maxma Incrementality Testing supports measuring multiple metrics within a single experiment. Beyond a primary conversion metric (e.g. orders, signups, app installs, etc.), you can measure additional metrics for a broader view of marketing impact. Examples include:
- Conversion Funnel Stages – Track multiple points in the funnel, such as web visits, signups, and purchases.
- Conversion Segments – Compare new vs. returning customers, or Shopify vs. Amazon orders.
Note: The experiment is optimized to detect lift for the primary metric, so additional metrics may have lower statistical power (i.e. ability to get statistically significant results). But the platform will tell you what's the minimum lift you can detect for the addtional metrics so you can adjust the design or promote the metric as the primary metric.
Lingering Effect
Incrementality Testing can capture short-term lingering effects of advertising. While it cannot fully measure long-term brand awareness effects that may take months to materialize, it can capture delayed impact in the weeks following the advertising.
The results of the experiment will show the incremental conversions continue to grow after the experiment concludes.
Offline Advertising
Incrementality Test is not limited to digital advertising—it can also be applied to offline marketing channels, such as out-of-home, TV, radio, and print. The requirement is you can target only some of the regions with the offline advertising.
Getting Started
You can now Sign up to run a test end-to-end for free. Additional tests are charged per test see pricing. Once you're in the app, go to "Experiment" -> "Geolift" for our AI Incrementality Test product. If you want to signup with personal email (e.g. gmail), reach out to support@maxma.ai.
See What You Get
Curious what a finished test looks like before running one? Deliverables walks through the results — incremental impact, cost per conversion, and the lift charts. For the end-to-end flow from design to launch to results, see How It Works.
Sample Data
To help you get started, we've prepared some sample data that you can use to test the tool: