The Database of Winning A/B Tests - Issue 218

A/B tests success rates, curated collection of proven A/B tests, and the importance of transparent experimentation.

Before we start, I want to share an exciting opportunity in New York: join Peloton's Product Analytics team as a Data Scientist! 📊📈

---

Have you ever wondered why companies spend time on A/B testing when thousands of other companies have already tested the same and know which shape, color, and type of CTA performs better?

Wouldn’t it be amazing to have a universal database or repository of all completed A/B tests, with documented learnings on what color, banner size, and paywall format performed best?

Well, there is one! Not one, many. And they are growing.

Today, let’s talk about: 

• Where you can access these learnings from other companies and where you can share your own (please do). 

• Why we keep testing and re-testing exactly the same things. Over and over again.

• What the test success rate is at other companies. 

• What the common winning stereotypes are (dark-screen mode, rounded buttons, sticky banners, etc.), and how accurate and trusted they are.

A/B tests repositories