Data Mesh in Practice: How Europe’s Leading Online Platform for Fashion Goes Beyond the Data Lake
The Data Lake paradigm is often considered the scalable successor of the more curated Data Warehouse approach when it comes to democratization of data. However, many who went out to build a centralized Data Lake came out with a data swamp of unclear responsibilities, a lack of data ownership, and sub-par data availability.
At Zalando – europe’s biggest online platform for fashion – we realized that accessibility and availability at scale can only be guaranteed when moving more responsibilities to those who pick up the data and have the respective domain knowledge – the data owners – while keeping only data governance and metadata information central. Such a decentralized and domain focused approach has recently been coined a Data Mesh. The Data Mesh paradigm promotes the concept of Data Products which go beyond sharing of files and towards guarantees of quality and acknowledgement of data ownership. This talk will take you on a journey of how we went from a centralized Data Lake to embrace a distributed Data Mesh architecture backed by Spark and build on Delta Lake, and will outline the ongoing efforts to make creation of data products as simple as applying a template.
About:
Databricks provides a unified data analytics platform, powered by Apache Spark™, that accelerates innovation by unifying data science, engineering and business.
Read more here: https://databricks.com/product/unified-data-analytics-platform
See all the previous Summit sessions: https://databricks.com/sparkaisummit/north-america/sessions
Connect with us:
Website: https://databricks.com
Facebook: https://www.facebook.com/databricksinc
Twitter: https://twitter.com/databricks
LinkedIn: https://www.linkedin.com/company/databricks/
Instagram: https://www.instagram.com/databricksinc/ Databricks is proud to announce that Gartner has named us a Leader in both the 2021 Magic Quadrant for Cloud Database Management Systems and the 2021 Magic Quadrant for Data Science and Machine Learning Platforms. Download the reports here. https://databricks.com/databricks-named-leader-by-gartner
Видео Data Mesh in Practice: How Europe’s Leading Online Platform for Fashion Goes Beyond the Data Lake канала Databricks
At Zalando – europe’s biggest online platform for fashion – we realized that accessibility and availability at scale can only be guaranteed when moving more responsibilities to those who pick up the data and have the respective domain knowledge – the data owners – while keeping only data governance and metadata information central. Such a decentralized and domain focused approach has recently been coined a Data Mesh. The Data Mesh paradigm promotes the concept of Data Products which go beyond sharing of files and towards guarantees of quality and acknowledgement of data ownership. This talk will take you on a journey of how we went from a centralized Data Lake to embrace a distributed Data Mesh architecture backed by Spark and build on Delta Lake, and will outline the ongoing efforts to make creation of data products as simple as applying a template.
About:
Databricks provides a unified data analytics platform, powered by Apache Spark™, that accelerates innovation by unifying data science, engineering and business.
Read more here: https://databricks.com/product/unified-data-analytics-platform
See all the previous Summit sessions: https://databricks.com/sparkaisummit/north-america/sessions
Connect with us:
Website: https://databricks.com
Facebook: https://www.facebook.com/databricksinc
Twitter: https://twitter.com/databricks
LinkedIn: https://www.linkedin.com/company/databricks/
Instagram: https://www.instagram.com/databricksinc/ Databricks is proud to announce that Gartner has named us a Leader in both the 2021 Magic Quadrant for Cloud Database Management Systems and the 2021 Magic Quadrant for Data Science and Machine Learning Platforms. Download the reports here. https://databricks.com/databricks-named-leader-by-gartner
Видео Data Mesh in Practice: How Europe’s Leading Online Platform for Fashion Goes Beyond the Data Lake канала Databricks
Показать
Комментарии отсутствуют
Информация о видео
Другие видео канала
![Comcast makes home entertainment accessible to everyone with voice, data and AI](https://i.ytimg.com/vi/1UZi-EJQaFQ/default.jpg)
![NBA Analytics | Data Brew | Season 4 Episode 2](https://i.ytimg.com/vi/-rQi9_gNvUk/default.jpg)
![Data+AI Summit 2022 Highlights](https://i.ytimg.com/vi/9xt8GuywrBo/default.jpg)
![Media and Entertainment Experience at Data + AI Summit 2022](https://i.ytimg.com/vi/Hmr9rE3I6uI/default.jpg)
![Demo Video: Connect to Power BI Desktop from Databricks](https://i.ytimg.com/vi/EcKqQV0rCnQ/default.jpg)
![LLM Module 3 - Multi-stage Reasoning | 3.7.1 Notebook Demo Part 1](https://i.ytimg.com/vi/PJcGkI1m9jQ/default.jpg)
![Power to the (SQL) People: Python UDFs in DBSQL](https://i.ytimg.com/vi/lotaSmKE8r0/default.jpg)
![LLM Module 0 - Introduction | 0.4 Language Models](https://i.ytimg.com/vi/n69wohzQSeM/default.jpg)
![LLM Module 1 - Applications with LLMs | 1.6 Prompts](https://i.ytimg.com/vi/9hSuKpP0EjU/default.jpg)
![Protecting PII/PHI Data in Data Lake via Column Level Encryption](https://i.ytimg.com/vi/6_X_0D6kmVs/default.jpg)
![LLM Module 2 - Embeddings, Vector Databases, and Search | 2.6 Best Practices](https://i.ytimg.com/vi/3H5UC2c0Dyc/default.jpg)
![Grab leverages data + AI to create economic opportunities in Southeast Asia](https://i.ytimg.com/vi/CrH5Bb4kjLQ/default.jpg)
![Wehkamp excites shoppers with a better online experience with ML](https://i.ytimg.com/vi/tl4vgOyDFcA/default.jpg)
![Spline: Central Data-Lineage Tracking, Not Only For Spark](https://i.ytimg.com/vi/Bz_Ml6pNH2E/default.jpg)
![How To Make Apache Spark on Kubernetes Run Reliably on Spot Instances](https://i.ytimg.com/vi/te9PaxKIabA/default.jpg)
![More Context, Less Chaos: How Atlan and Unity Catalog Power Column-Level Lineage and Active Metadata](https://i.ytimg.com/vi/oZToY6NK6nE/default.jpg)
![Apache Arrow Flight SQL: High Performance, Simplicity, and Interoperability for Data Transfers](https://i.ytimg.com/vi/OLsXlKb_XRQ/default.jpg)
![Lakehouse ML on Databricks Demo](https://i.ytimg.com/vi/1TPu-uOLglI/default.jpg)
![Exploring Lakehouse for Retail](https://i.ytimg.com/vi/_G6Oh5MtkR0/default.jpg)
![Introducing Databricks on Google Cloud](https://i.ytimg.com/vi/uBOkJbO_WSk/default.jpg)