Directions in ML: "Neural architecture search: Coming of age"
Neural Architecture Search (NAS) is a very promising but still young field. I will start this talk by discussing various works aiming to build a scientific community around NAS, including benchmarks, best practices, and open source frameworks. Then, I will discuss several exciting directions for the field: (1) a broad range of possible speedup techniques for NAS; (2) joint NAS + hyperparameter optimization in Auto-PyTorch to allow off-the-shelf AutoML; and (3) the extended problem definition of neural ensemble search (NES) that searches for a set of complementary architectures rather than a single one as in NAS.
Slides for this talk are available: https://www.automl.org/talks
Frank Hutter is a Full Professor for Machine Learning at the Computer Science Department of the University of Freiburg (Germany), as well as Chief Expert AutoML at the Bosch Center for Artificial Intelligence. Frank holds a PhD from the University of British Columbia (2009) and a MSc from TU Darmstadt (2004). He received the 2010 CAIAC doctoral dissertation award for the best thesis in AI in Canada, and with his coauthors, several best paper awards and prizes in international competitions on machine learning, SAT solving, and AI planning. He is the recipient of a 2013 Emmy Noether Fellowship, a 2016 ERC Starting Grant, a 2018 Google Faculty Research Award, and a 2020 ERC PoC Award. He is also a Fellow of ELLIS and Program Chair at ECML 2020.
In the field of AutoML, Frank co-founded the ICML workshop series on AutoML in 2014 and has co-organized it every year since, co-authored the prominent AutoML tools Auto-WEKA and Auto-sklearn, won the first two AutoML challenges with his team, co-authored the first book on AutoML, worked extensively on efficient hyperparameter optimization and neural architecture search, and gave a NeurIPS 2018 tutorial with over 3000 attendees.
Learn more about the 2020-2021 Directions in ML: AutoML and Automating Algorithms virtual speaker series: https://aka.ms/diml
Видео Directions in ML: "Neural architecture search: Coming of age" канала Microsoft Research
Slides for this talk are available: https://www.automl.org/talks
Frank Hutter is a Full Professor for Machine Learning at the Computer Science Department of the University of Freiburg (Germany), as well as Chief Expert AutoML at the Bosch Center for Artificial Intelligence. Frank holds a PhD from the University of British Columbia (2009) and a MSc from TU Darmstadt (2004). He received the 2010 CAIAC doctoral dissertation award for the best thesis in AI in Canada, and with his coauthors, several best paper awards and prizes in international competitions on machine learning, SAT solving, and AI planning. He is the recipient of a 2013 Emmy Noether Fellowship, a 2016 ERC Starting Grant, a 2018 Google Faculty Research Award, and a 2020 ERC PoC Award. He is also a Fellow of ELLIS and Program Chair at ECML 2020.
In the field of AutoML, Frank co-founded the ICML workshop series on AutoML in 2014 and has co-organized it every year since, co-authored the prominent AutoML tools Auto-WEKA and Auto-sklearn, won the first two AutoML challenges with his team, co-authored the first book on AutoML, worked extensively on efficient hyperparameter optimization and neural architecture search, and gave a NeurIPS 2018 tutorial with over 3000 attendees.
Learn more about the 2020-2021 Directions in ML: AutoML and Automating Algorithms virtual speaker series: https://aka.ms/diml
Видео Directions in ML: "Neural architecture search: Coming of age" канала Microsoft Research
Показать
Комментарии отсутствуют
Информация о видео
Другие видео канала
The Intern Experience at Microsoft Research CambridgeDirections in ML: Taking Advantage of Randomness in Expensive Optimization ProblemsBattling Tuberculosis Using Microsoft TechnologyFast and Flexible Multi-Task Classification Using Conditional Neural Adaptive ProcessesDesign and Evaluation of Effective, Interactive, and Interpretable Machine LearningKeynote: Systems Research - Fueling Future DisruptionsData Visualization Reaches New Heights with LayerscapeProvably efficient reinforcement learning with Dr. Akshay Krishnamurthy | PodcastFaculty Summit 2018 IntroductionStructured light: seeing less to see more in optical microscopyAugmenting Visualization Tools with Automated Design & RecommendationGeek Heresy: Rescuing Social Change from the Cult of TechnologyModels as Code: Differentiable Programming with ZygoteAI-Powered Speech TranslationImprovements on Higher Order Ambisonics ReproductionPlatform for Situated Intelligence Workshop | Day 1Cambridge lab overview with Chris BishopGet free cloud computing time and storage on Microsoft AzureAI Institute "Geometry of Deep Learning" 2019 [Workshop] Day 1 | Session 2De-Identifying Healthcare Data for ResearchSmall Deep Neural Networks - Their Advantages, and Their Design