Deep Learning on Apache Spark w/ BigDL, Sergey V Ermolin , 20170626
Sergey V Ermolin, Technical Program Manager Spark Analytics, Big Data Technologies
Intel Corp
Intel recently released BigDL, an open source distributed deep Learning framework for Apache Spark. It brings native support for deep learning functionalities to Spark, provides orders of magnitude speedup than out-of-box open source DL frameworks (e.g., Caffe/Torch/TensorFlow) with respect to single node Xeon performance, and efficiently scales out deep learning workloads based on the Spark architecture. In addition, it also allows data scientists to perform distributed deep learning analysis on big data using the familiar tools including python, notebook, etc. In this talk, we will give an introduction to BigDL, show how big data users and data scientist can leverage BigDL for their deep learning (such as image recognition, object detection, NLP, etc.). BigDL users can analyze large amounts of data in a distributed fashion, which allows them to use their big data (e.g., Apache Hadoop and Spark) cluster as the unified data analytics platform for data storage, data processing and mining, feature engineering, traditional (non-deep) machine learning, and deep learning workloads.
Sergey Ermolin is a valley’s veteran with a passion for machine learning and artificial intelligence. His interest in neural networks goes back to 1996 when he used them to predict aging behavior of quartz crystals and cesium atomic clocks made by Hewlett-Packard at its Santa Clara campus. Sergey is currently a member of Big Data Technologies team at Intel, working on Apache Spark projects. Sergey holds MSEE from Stanford and BS in Physics and Mechanical Engineering from Cal State University, Sacramento
http://www.meetup.com/SF-Bay-ACM/
http://www.sfbayacm.org/
Видео Deep Learning on Apache Spark w/ BigDL, Sergey V Ermolin , 20170626 канала San Francisco Bay ACM
Intel Corp
Intel recently released BigDL, an open source distributed deep Learning framework for Apache Spark. It brings native support for deep learning functionalities to Spark, provides orders of magnitude speedup than out-of-box open source DL frameworks (e.g., Caffe/Torch/TensorFlow) with respect to single node Xeon performance, and efficiently scales out deep learning workloads based on the Spark architecture. In addition, it also allows data scientists to perform distributed deep learning analysis on big data using the familiar tools including python, notebook, etc. In this talk, we will give an introduction to BigDL, show how big data users and data scientist can leverage BigDL for their deep learning (such as image recognition, object detection, NLP, etc.). BigDL users can analyze large amounts of data in a distributed fashion, which allows them to use their big data (e.g., Apache Hadoop and Spark) cluster as the unified data analytics platform for data storage, data processing and mining, feature engineering, traditional (non-deep) machine learning, and deep learning workloads.
Sergey Ermolin is a valley’s veteran with a passion for machine learning and artificial intelligence. His interest in neural networks goes back to 1996 when he used them to predict aging behavior of quartz crystals and cesium atomic clocks made by Hewlett-Packard at its Santa Clara campus. Sergey is currently a member of Big Data Technologies team at Intel, working on Apache Spark projects. Sergey holds MSEE from Stanford and BS in Physics and Mechanical Engineering from Cal State University, Sacramento
http://www.meetup.com/SF-Bay-ACM/
http://www.sfbayacm.org/
Видео Deep Learning on Apache Spark w/ BigDL, Sergey V Ermolin , 20170626 канала San Francisco Bay ACM
Показать
Комментарии отсутствуют
Информация о видео
Другие видео канала
Faster Data Science+Best Practices for AI-enabled applications, Ian Swanson&Rama Akkiraju 20180827A Smarter Process for Sensing the Information Space - Scott Spangler , IBM 20101122CHOMP Mobile App Search, by Cathy Edwards, 2011-11-28COVID-19 Conundrum: Critical Insights on Cloud Security Posture of Enterprises, Matt ChiodiProvable Privacy Guarantee, and, Smart Navigation to Aid Glaucoma PatientsNanobody Optimization via Machine LearningEmerging AI Applications & Infrastructure Systems, Dr. Wen-mei W. Hwu,20190522Enterprise AI: The most untapped opportunity for novel and impactful AI work2024 Engineers' Week Banquet and Hall of Fame CeremonyTaming Latency Variability and Scaling Deep Learning, by Jeff Dean, Google, 20131016ACM Data Mining Camp at eBay on October 15 2011 (Promo video)A new neural network for optimal time series processingHeuristic Design of Experiments with Meta-Gradient Search of Model by Greg Makowski 20110228A Big Data Solution using JSONiq, by Dr. Matthias Brantner 20130826Panel: Practical Realities of ConsultingScalable Recommender/Advertising Systems, Speaker Joaquin A. Delgado, PhD. 20130923Technology Applications for Seismic Events, Jennifer Strauss 20140917A Primer on the Major Topics in AI Law and PolicyWhen Science Meets Data: Three Stories from the Field,Speaker: Neel Sundaresan, eBAY, 20130325Knowledge Graph Extraction from Unstructured Data and Semantic Role Labeling