Supercharge A/B testing w/automated causal inference |Community Workshop on Microsoft's Causal Tools
An A/B test consists of splitting the customers into a test and a control group, and choosing a large enough sample size to observe the average treatment effect (ATE) we are interested in, in spite of all the other factors driving outcome variance. With causal inference models, we can do better than that, by estimating the effect conditional on customer features (CATE), thus turning customer variability from noise to be averaged over to a valuable source of segmentation, and potentially requiring smaller sample sizes as a result. Unfortunately, there are many different models available for estimating CATE, with many parameters to tune and very different performance. In this talk, we will present our auto-causality library, which combines the three marvelous packages from Microsoft – DoWhy, EconML, and FLAML – to do fully automated selection and tuning of causal models based on out-of-sample performance, just like any other AutoML package does. We will describe the projects inside Wise currently starting to apply it, and present rather striking results on comparative model performance and out-of-sample segmentation on Wise CRM data.
Causality and Machine Learning Group: https://www.microsoft.com/en-us/research/group/causal-inference/
Event page: https://www.microsoft.com/en-us/research/event/community-workshop-on-dowhy-econml/agenda/
Видео Supercharge A/B testing w/automated causal inference |Community Workshop on Microsoft's Causal Tools канала Microsoft Research
Causality and Machine Learning Group: https://www.microsoft.com/en-us/research/group/causal-inference/
Event page: https://www.microsoft.com/en-us/research/event/community-workshop-on-dowhy-econml/agenda/
Видео Supercharge A/B testing w/automated causal inference |Community Workshop on Microsoft's Causal Tools канала Microsoft Research
Показать
Комментарии отсутствуют
Информация о видео
Другие видео канала
The Intern Experience at Microsoft Research CambridgeBattling Tuberculosis Using Microsoft TechnologyFast and Flexible Multi-Task Classification Using Conditional Neural Adaptive ProcessesData Visualization Reaches New Heights with LayerscapeFaculty Summit 2018 IntroductionMicrosoft Pix - Take Better Photos of People, AutomaticallyImprovements on Higher Order Ambisonics ReproductionCambridge lab overview with Chris BishopGet free cloud computing time and storage on Microsoft AzureUnlocking Real world solutions with AI – Chris BishopHow interns at our New England Lab impact research at MicrosoftAI Institute "Geometry of Deep Learning" 2019 [Workshop] Day 1 | Session 2De-Identifying Healthcare Data for ResearchIntelligent cloud computing lifts villages out of water povertyHow Microsoft and Novartis created Assess MS (short version)How OSIsoft and Deschutes Brewery used Microsoft Security Risk DetectionChronoZoom curriculum and technologyRecent Advances in Image Captioning, Image-Text Retrieval and…Using machine learning and AI to reduce hospital readmissionsIROS 2020 - Mixed Reality and Robotics Tutorial - Demo 1: InteractionCamera-based non-contact health sensing