My name is Vikrama Dhiman. I lead Mobility Products @ Gojek. Previously, I led product teams at Bharti SoftBank (Airtel Money, myAirtel, Wynk), Directi (BigRock), Zeta (Corporate Benefits and Gifting), WizIQ (eLearning) and MakeMyTrip (Travel/ Hotels). I was an Agile Coach with Cisco, Yodlee, Sapient, HP & Classmates.com. I am an avid reader.
Experiments at Scale | Reading Resources
I created this page to compile good resources I come across for Experimentation - infra, analysis, speed, culture and more. I hope it is useful for you too.
I have tried to categorize the videos, podcasts, articles and papers according to how I saw these resources.
Experimentation @ Scale
- How Booking.com increases the power of online experiments with CUPED
- How Booking.com A/B Tests Ten Novenonagintillion Versions of its Site
- Online Experiments at Booking.com - Podcast with Transcript
- Plan Out - A Framework for Online Field Experiments
- Facebook's A B Platform Interactive Analysis in Realtime - @Scale 2014 - Data (Video)
Culture of Experimentation
- [CRO Best Practices] Insights From eCommerce CRO Apex Predators: Booking.com
- The Role of Experimentations at Booking.com
- Experiments at AirBnB
- Democratising Online Controlled Experiments at Booking.com by Lukas Vermeer - Video at Google Conversions 2017
Advanced Experimentation (Technical)
- Bayesian optimization for A/B testing
- Constrained Bayesian Optimization with Noisy Experiments
- How Airbnb Uses Data Science to Improve Their Product and Marketing
- Overlapping Experiment Infrastructure: More, Better, Faster Experimentation
- Controlled experiments on the web: survey and practical guide
- The Anatomy of a Large-Scale Online Experimentation Platform
- Building an Intelligent Experimentation Platform with Uber Engineering
- It’s All A/Bout Testing: The Netflix Experimentation Platform
- Stanford Seminar: Peeking at A/B Tests - Why It Matters and What to Do About It (Video - ~1 hour)
Resources by other people