How I Rearchitected A/B Testing at LINE

For the LY Corp tech blog, I wrote about one of the largest projects I've led at LINE. About eight months ago, I set the goal to make the software development operations at LINE NEWS significantly more efficient by changing the A/B testing mechanism and its surrounding architecture. First, I pitched the new architecture I designed to the development team, the SRE team, and the DevOps team. We extensively discussed how we could implement it.

At the same time, I consulted with the data science team to make sure our new system would effectively run A/B tests. How I executed the development part is written in the article. The results were so rewarding. The new system decreased the lead time from the start of the A/B test and the final release by 30% to 60% for most of our recent features.