Choosing the Right Metrics for A/B Testing | Success Metric, Driver Metric, Guardrail Metric

In this video, we will have a deep dive into the fundamentals of metrics in A/B Testing. By the end of the video, you will have a solid understanding of the common types of metrics and tips of applying them in real-world A/B testing applications. Some ideas are inspired by the book Trustworthy online controlled experiments, a practical guide to A/B testing. I'm sure this video will be extremely helpful for both interview preparation and day-to-day work as a DS.

Blog post by Rob and me:
https://towardsdatascience.com/the-ultimate-guide-to-cracking-business-case-interviews-for-data-scientists-part-1-cb768c37edf4

Part 1 of the tutorial:
https://www.youtube.com/watch?v=VpTlNRUcIDo

Part 2 of the tutorial:
https://www.youtube.com/watch?v=VuKIN9S8Ivs

Timestamps:
0:00 Intro
1:13 Goal Metric
3:13 Driver Metric
4:42 Guardrail Metric
6:14 Application of Metrics
8:17 Metrics for experiments

Видео Choosing the Right Metrics for A/B Testing | Success Metric, Driver Metric, Guardrail Metric канала Data Interview Pro