A/B Smartly

Get Booking.com and Netflix's Experimentation Culture without the big investment.

Knowledge based and engineering centric experimentation platform where multiple teams can run hundreds or thousands of simultaneous experiments without stepping on each other toes, with transparency to all stakeholders, and full visibility about possible interactions.

Like a home-built solution

• Run it locally: The world’s first single-tenant/private cloud experimentation platform. Like a home built solution.
• Store the data anywhere: Multiple data sinks supported: Redshift, BigQuery, Snowflake, Hadoop, S3, Apache Druid, ClickHouse and more to come.
• Real-time reports: Sub-minute latency in the dashboards. Start one experiment now and look at the data right away. Identify breakages quickly or even have broken experiments being stopped automatically in seconds.
• Rely on guardrail and debugging metrics: A/B Smartly automatically warns you about sample ratio mismatches, novelty effects, trigger day effects, deeps or spikes caused by robots/scrappers, etc. You can even add your own custom guardrails.

Unlimited potential for growth

Run thousands of simultaneous A/B tests across your entire infrastructure with reliable results. A/B Smartly helps you plan to avoid experiment interactions and detects interactions for you when they happen.

• Unlimited users
• Unlimited A/B tests
• Unlimited metrics
• Unlimited segments

No flickering, no lags

Third-party platforms can result in performance issues like flickering or lags. It's very difficult to experimenting if the process harms some of your key conversion drivers — user experience and page load times.

A/B Smartly runs locally, eliminating costly user experience issues.

Once A/B Smartly is deployed, your team is in control. The data never leaves your data center and you can easily integrate it with other internal tools you might have built. Great for privacy, great for development flexibility.

Make better decisions at every level

• Performance: See the impact of your experiments on page load, query, and render times.
• Bye-bye bots: Filter out bots and abnormal users to only measure real-life humans.
• Build loyalty: Measure the impact on returning visitors. Look at longer-term effects, even months after the decision making.
• Meaningful metrics: See how much users spend, how long they stay on your site or how many times they buy.
• SEO: Find out the impact that A/B tests have on your organic traffic. Run SEO experiments to bring in more free traffic.

Don’t want to use a third party platform that you don’t control? Get an in-house solution without having to build it or maintain it yourself.

Democratize experimentation

Let your designers, engineers or complete product teams be in control of A/B testing. With the config API even Product Managers can make changes in experiments without development resources. Run tests across the entire infrastructure, from apps to websites to email to ML models and beyond.