New A/B Test Report & Per-Project Currency

A common question we hear when talking to new Improvely users is when to end an A/B split test of ad landing pages. While we’ve always shown you the relative conversion rates of your different landing pages, you really have to do some math to decide if you’ve run the test long enough to be confident in those numbers. This week, we added a new report to do that math for you —

The new A/B Split Test Results report quickly shows you the confidence interval for each variation’s conversion rate, the percent improvement over your baseline page, and the p-value of that improvement. If you see a significant improvement, and the p-value is below 0.05, it might be the right time to declare a winner in your test and start sending all your clicks to that landing page.

To find the new report, look for the new icon in your Tracking Links report next to any link with multiple landing pages —

This week, we also added a new currency setting, allowing you to choose what currency is displayed in reports for each of your projects. You’ll find it on the Project Settings page.