A Tale of 3 Deep Learning Frameworks: TensorFlow, Keras, & PyTorch with Jules Damji & Brooke Wenig
The explosion of data volume in the years to come challenge the idea of a centralized cloud infrastructure which handles all business needs. Edge computing comes to rescue by pushing the needs of computation and data analysis at the edge of the network, thus avoiding data exchange when makes sense. One of the areas where data exchange could impose a big overhead is scoring ML models especially where data to score are files like images eg. in a computer vision application. Another concern in some applications, is that of keeping data as private as possible and this is where keeping things local makes sense. In this talk we will discuss current needs and recent advances in model serving, like newly introduced formats for pushing models at the edge nodes eg. mobile phones and how a unified model serving architecture could cover current and future needs for both data scientists and data engineers. This architecture is based among others, on training models in a distributed fashion with TensorFlow and leveraging Spark for cleaning data before training (eg. using TensorFlow connector). Finally we will describe a microservice based approach for scoring models back at the cloud infrastructure side (where bandwidth can be high) eg. using TensorFlow serving and updating models remotely with a pull model approach for edge devices. We will talk also about implementing the proposed architecture and how that might look on a modern deployment environment eg. Kubernetes.
About: Databricks provides a unified data analytics platform, powered by Apache Spark™, that accelerates innovation by unifying data science, engineering and business.
Read more here: https://databricks.com/product/unified-data-analytics-platform
Connect with us:
Website: https://databricks.com
Facebook: https://www.facebook.com/databricksinc
Twitter: https://twitter.com/databricks
LinkedIn: https://www.linkedin.com/company/databricks
Instagram: https://www.instagram.com/databricksinc/ Databricks is proud to announce that Gartner has named us a Leader in both the 2021 Magic Quadrant for Cloud Database Management Systems and the 2021 Magic Quadrant for Data Science and Machine Learning Platforms. Download the reports here. https://databricks.com/databricks-named-leader-by-gartner
Видео A Tale of 3 Deep Learning Frameworks: TensorFlow, Keras, & PyTorch with Jules Damji & Brooke Wenig канала Databricks
About: Databricks provides a unified data analytics platform, powered by Apache Spark™, that accelerates innovation by unifying data science, engineering and business.
Read more here: https://databricks.com/product/unified-data-analytics-platform
Connect with us:
Website: https://databricks.com
Facebook: https://www.facebook.com/databricksinc
Twitter: https://twitter.com/databricks
LinkedIn: https://www.linkedin.com/company/databricks
Instagram: https://www.instagram.com/databricksinc/ Databricks is proud to announce that Gartner has named us a Leader in both the 2021 Magic Quadrant for Cloud Database Management Systems and the 2021 Magic Quadrant for Data Science and Machine Learning Platforms. Download the reports here. https://databricks.com/databricks-named-leader-by-gartner
Видео A Tale of 3 Deep Learning Frameworks: TensorFlow, Keras, & PyTorch with Jules Damji & Brooke Wenig канала Databricks
Показать
Комментарии отсутствуют
Информация о видео
Другие видео канала
Comcast makes home entertainment accessible to everyone with voice, data and AINBA Analytics | Data Brew | Season 4 Episode 2Data+AI Summit 2022 HighlightsMedia and Entertainment Experience at Data + AI Summit 2022Demo Video: Connect to Power BI Desktop from DatabricksRecap of Announcements at Data + AI Summit 2024 with Ali Ghodsi, Co-Founder and CEO, DatabricksLLM Module 3 - Multi-stage Reasoning | 3.7.1 Notebook Demo Part 1Power to the (SQL) People: Python UDFs in DBSQLProtecting PII/PHI Data in Data Lake via Column Level EncryptionGrab leverages data + AI to create economic opportunities in Southeast AsiaWehkamp excites shoppers with a better online experience with MLSpline: Central Data-Lineage Tracking, Not Only For SparkHow To Make Apache Spark on Kubernetes Run Reliably on Spot InstancesApache Arrow Flight SQL: High Performance, Simplicity, and Interoperability for Data TransfersLakehouse ML on Databricks DemoExploring Lakehouse for RetailEvolving Data Governance With Unity Catalog Presented by Matei Zaharia at Data + AI Summit 2024Introducing Databricks on Google CloudApplied Predictive Maintenance in Aviation: Without Sensor DataLLM Module 0 - Introduction | 0.3 PrimerDelta Sharing - A New Paradigm for Secure Data Sharing and Data Collaboration on Lakehouse