Virginia Smith - A General Framework for Communication-Efficient Distributed... - MLconf SF 2016
Presentation slides: http://www.slideshare.net/SessionsEvents/virginia-smith-researcher-uc-berkeley-at-mlconf-sf-2016
A General Framework for Communication-Efficient Distributed Optimization: Communication remains the most significant bottleneck in the performance of distributed optimization algorithms for large-scale machine learning. In light of this, we propose a general framework, CoCoA, that uses local computation in a primal-dual setting to dramatically reduce the amount of necessary communication. Our framework enjoys strong convergence guarantees and exhibits state-of-the-art empirical performance in the distributed setting. We demonstrate this performance with extensive experiments in Apache Spark, achieving speedups of up to 50x compared to leading distributed methods on common machine learning objectives.
Видео Virginia Smith - A General Framework for Communication-Efficient Distributed... - MLconf SF 2016 канала MLconf
A General Framework for Communication-Efficient Distributed Optimization: Communication remains the most significant bottleneck in the performance of distributed optimization algorithms for large-scale machine learning. In light of this, we propose a general framework, CoCoA, that uses local computation in a primal-dual setting to dramatically reduce the amount of necessary communication. Our framework enjoys strong convergence guarantees and exhibits state-of-the-art empirical performance in the distributed setting. We demonstrate this performance with extensive experiments in Apache Spark, achieving speedups of up to 50x compared to leading distributed methods on common machine learning objectives.
Видео Virginia Smith - A General Framework for Communication-Efficient Distributed... - MLconf SF 2016 канала MLconf
Показать
Комментарии отсутствуют
Информация о видео
Другие видео канала
![Dr. June Andrews, Principal Data Scientist, Wise.io, From GE Digital](https://i.ytimg.com/vi/8rQ9g03yJ8E/default.jpg)
![Building Machine Learning Models with Strict Privacy Boundaries](https://i.ytimg.com/vi/HIKpXVc1mpo/default.jpg)
![Anima Anadkumar, Principal Scientist, Amazon Web Services, Endowed Professor, CalTech](https://i.ytimg.com/vi/RRy-3VXA0nw/default.jpg)
![Manipulating and Measuring Model Interpretability](https://i.ytimg.com/vi/hHAW1ug2qlE/default.jpg)
![Jennifer Marsman, Principal Developer Evangelist, Microsoft @ MLconf NYC](https://i.ytimg.com/vi/T8FaWkqzK0A/default.jpg)
![MLconf Online 2020: DevOps for Data Science With Kubernetes by Sophie Watson](https://i.ytimg.com/vi/9TqHilvnUuM/default.jpg)
![Sven Kreiss, Lead Data Scientist, Wildcard @ MLconf ATL](https://i.ytimg.com/vi/09kpP-w4DLI/default.jpg)
![Jeremy Stanley, EVP/Data Scientist, Sailthru @ MLconf NYC](https://i.ytimg.com/vi/vEemVVLGo6E/default.jpg)
![Sanjeev Satheesh, The Story of End to End Models in Deep Learning at The AI Conference 2017](https://i.ytimg.com/vi/h3Y3Gohn1HI/default.jpg)
![MLconf Online 2020: Data Science is Key to Achieving Energy Access in Africa Madeleine Gleave](https://i.ytimg.com/vi/i9FXqOeFpwY/default.jpg)
![Subutai Ahmad, VP of Research, Numenta @ MLconf SF](https://i.ytimg.com/vi/SxtsCrTHz-4/default.jpg)
![Justin Basilico, Senior Researcher Engineer in Recommendation Systems, Netlix @ MLconf ATL](https://i.ytimg.com/vi/doWgbo-c9sM/default.jpg)
![Sergei Vassilvitskii, Research Scientist, Google @ MLconf NYC](https://i.ytimg.com/vi/rtXeauFFCE4/default.jpg)
![MLconf Online 2020: Mathematical Approaches to Clustering by Joseph Ross](https://i.ytimg.com/vi/ziZ2JfXDAd4/default.jpg)
![Byron Galbraith, Chief Data Scientist, Talla, NYC 2017](https://i.ytimg.com/vi/IHCtfiI8llA/default.jpg)
![MLconf NYC 2022: How to Detect and Interpret Data Drift in Production by Emeli Dral of Evidently AI](https://i.ytimg.com/vi/FnVi_-eq4yE/default.jpg)
![Optimized Image Classification on the Cheap](https://i.ytimg.com/vi/P5rU5LJfV5A/default.jpg)
![Carlos Guestrin, CEO of Dato Inc. @ MLconf SEA](https://i.ytimg.com/vi/gjSC5ZjLnII/default.jpg)
![Johann Schleier Smith, Co Founder and CTO, ifwe @ MLconf SF](https://i.ytimg.com/vi/t6eAdPof9yQ/default.jpg)
![Using a Bayesian Neural Network in the Detection of Exoplanets](https://i.ytimg.com/vi/u42czORKkt8/default.jpg)