A/B testing is a method of comparing two or more variants of a product feature, design, or experience to determine which performs better. It works by randomly assigning users to different groups, with each group seeing a different variant. By measuring key metrics like conversion rates, engagement, or revenue across these groups, teams can identify […]
This article explores how Yousician built a successful experimentation program, covering platform selection, analytics infrastructure, feature flagging practices, and maintaining the balance between optimization and innovation. Selecting your initial experimentation platform When starting an experimentation program, the temptation to build a custom solution can be strong, particularly for engineering-focused organizations. Yousician initially considered this […]
While the answer isn’t universal, it hinges on several critical factors including your organization’s size, testing maturity, technical capabilities, and business goals. Understanding when a platform becomes necessary versus when simpler solutions suffice can save both time and resources while ensuring you make data-driven decisions effectively. What A/B testing platforms actually do (beyond the obvious) […]
Initially, Wayfair’s approach to feature management echoed that of many organizations: build a proprietary, in-house feature flag system tightly coupled to its core codebase, in this case, a PHP monolith. This gave the engineering team the immediate ability to enable or disable features in production, decoupling deployment from release. For a time, this accelerated experimentation […]
Building a custom tool seems tempting at first. The requirements appear simple: you need a way to turn features on or off. For small teams, especially those running a monolithic codebase and releasing infrequently, a bespoke toggle system might work for a while. This journey almost always ends with the same realization: the core business […]
