Data Mesh in Practice - Arif Wider & Max Schultze - NDC Oslo
Data Mesh in Practice - How Europe’s Biggest Online Fashion Retailer Goes Beyond the Data Lake
The Data Lake paradigm is often considered the scalable successor of the more curated Data Warehouse approach when it comes to democratization of data. However, many who went out to build a centralized Data Lake came out with a data swamp of unclear responsibilities, a lack of data ownership, and sub-par data availability.
At Zalando - europe’s biggest online fashion retailer - we realised that accessibility and availability at scale can only be guaranteed when moving more responsibilities to those who pick up the data and have the respective domain knowledge - the data owners - while keeping only data governance and metadata information central. Such a decentralized and domain focused approach has recently been coined a Data Mesh.
The Data Mesh paradigm promotes the concept of Data Products which go beyond sharing of files and towards guarantees of quality and acknowledgement of data ownership.
This talk will take you on a journey of how we went from a centralized Data Lake to embrace a distributed Data Mesh architecture and will outline the ongoing efforts to make creation of data products as simple as applying a template.
Видео Data Mesh in Practice - Arif Wider & Max Schultze - NDC Oslo канала NDC Conferences
The Data Lake paradigm is often considered the scalable successor of the more curated Data Warehouse approach when it comes to democratization of data. However, many who went out to build a centralized Data Lake came out with a data swamp of unclear responsibilities, a lack of data ownership, and sub-par data availability.
At Zalando - europe’s biggest online fashion retailer - we realised that accessibility and availability at scale can only be guaranteed when moving more responsibilities to those who pick up the data and have the respective domain knowledge - the data owners - while keeping only data governance and metadata information central. Such a decentralized and domain focused approach has recently been coined a Data Mesh.
The Data Mesh paradigm promotes the concept of Data Products which go beyond sharing of files and towards guarantees of quality and acknowledgement of data ownership.
This talk will take you on a journey of how we went from a centralized Data Lake to embrace a distributed Data Mesh architecture and will outline the ongoing efforts to make creation of data products as simple as applying a template.
Видео Data Mesh in Practice - Arif Wider & Max Schultze - NDC Oslo канала NDC Conferences
Показать
Комментарии отсутствуют
Информация о видео
Другие видео канала
Data Mesh and Lakehouse - Matei Zaharia, DatabricksWhat Is Data Mesh, and How Does it Work? ft. Zhamak DehghaniDomain-Driven Design: Hidden Lessons from the Big Blue Book - Nick TuneInterview with Robert Gentz (CEO, Zalando) #TOA15Istio Service Mesh ExplainedNetflix Data Mesh: Composable Data Processing - Justin CunninghamData Lake vs Data WarehouseWhat Is Kubernetes? | All Kubernetes Concepts Explained in 9 Minutes | KodeKloud01 Zhamak Dehghani Introducing Data Mesh A Paradigm Shift In Analytical Data Management ArchitectureCloud Data Warehouse Benchmark Redshift vs Snowflake vs BigQuery | FivetranTop Trends in Data & AI for 2021: data mesh | AiimiWhat is a Data Lake?Company Culture and Values at ZalandoWrite Your First WASM Module using RustData Mesh Paradigm Shift in Data Platform Architecture - Arif Wider - DDD Europe 2020The difference between Databases, Data Lakes, Data Warehouses, and Data MartsPondering Distributed Data Lakes IdeaThe Art of Discovering Bounded Contexts by Nick TuneMastering Chaos - A Netflix Guide to Microservices