Data Mesh and Lakehouse - Matei Zaharia, Databricks
Data mesh is an emerging data management architecture that makes it easier for organizations to collaborate. At the same time, in the technology layer beneath it, a new class of data management systems have been gaining traction: lakehouse systems that combine the capabilities of data warehouses and data lakes, bringing high performance query processing and governance to large-scale data stored in open formats. These systems, such as Delta Lake and Apache Hudi, are letting organizations simplify their data architectures by not having to manage separate data warehouses that load subsets of their data to achieve governance or performance. In addition, through new open source projects like Delta Sharing, these systems can directly support data mesh architectures not just within the same technology platform, but across clouds and vendors. I’ll talk about some of the recent work to support these patterns in the Delta Lake open source project and how data mesh and lakehouse systems can combine to create dramatically simpler data architectures.
Видео Data Mesh and Lakehouse - Matei Zaharia, Databricks канала Thoughtworks
Видео Data Mesh and Lakehouse - Matei Zaharia, Databricks канала Thoughtworks
Показать
Комментарии отсутствуют
Информация о видео
Другие видео канала
![Making privacy a first-class citizen in data science — Thoughtworks Technology Podcast](https://i.ytimg.com/vi/aPNTtcS4r-Y/default.jpg)
![ThoughtWorks Live Australia 2016](https://i.ytimg.com/vi/GJomCvYLLd4/default.jpg)
![Beyond Fitting Models: How to Build Successful AI-driven Products (in Thai) - Virot Chiraphadhanakul](https://i.ytimg.com/vi/oho1RmkR6Fw/default.jpg)
![TW Webinar | I'm a Technologist, Not a Female Technologist](https://i.ytimg.com/vi/B6ARYkw8qpc/default.jpg)
![Service Mesh is a pipeline’s best friend - Patrick McFadden - XConf North America 2022](https://i.ytimg.com/vi/CoMFtj3F3Fc/default.jpg)
![Towards Vehicle DevOps – Michael Fait at Automotive Europe 2023](https://i.ytimg.com/vi/UDwf4CP690M/default.jpg)
![AI-augmented decision making – Jonne Heikkinen – MIT CDOIQ Symposium](https://i.ytimg.com/vi/x7uO9lijXDE/default.jpg)
![The weaponization of complexity — Thoughtworks Technology Podcast](https://i.ytimg.com/vi/0nkVs86ac0E/default.jpg)
![Telus Digital - Enterprise evolution at startup speed](https://i.ytimg.com/vi/juWN47T3TGs/default.jpg)
![Authenticity & Mission | ParadigmShift 2016](https://i.ytimg.com/vi/Icx2d5i4MLM/default.jpg)
![Reviving the art of software design — Pam Rucinque & Andy Marks — XConf Australia 2022](https://i.ytimg.com/vi/FHr6UXkketA/default.jpg)
![Evolutionary Design Systems – Giamir Buoncristiani – XConf Europe 2022](https://i.ytimg.com/vi/c5k7fYyjIH8/default.jpg)
![Get ready for XConf Europe 2023 in Amsterdam!](https://i.ytimg.com/vi/BTXP68ZcIOg/default.jpg)
![ThoughtWorks Live UK April 2019 Highlights](https://i.ytimg.com/vi/fvQyf0S3wcE/default.jpg)
![Evolving Business Models: The Platform Economy - Kevin Flynn](https://i.ytimg.com/vi/UYSUvcub81o/default.jpg)
![XConf Thailand 2022 highlights](https://i.ytimg.com/vi/PDK3xBQUsxE/default.jpg)
![Gary O'Brien – 5 Key Threats to Becoming a Responsive Organisation | TW Live Australia 2016](https://i.ytimg.com/vi/1jXHD2rnrLM/default.jpg)
![Technology Radar volume 27 preview western webinar](https://i.ytimg.com/vi/Tko_P32X_zY/default.jpg)
![Misconceptions about digital disruption | ParadigmShift 2015](https://i.ytimg.com/vi/Qs8UttgmUDQ/default.jpg)
![Thoughtworks Deutschland](https://i.ytimg.com/vi/ScXFHHUIX9E/default.jpg)
![One beginner’s guide to XR world building - Stephanie Wang](https://i.ytimg.com/vi/BD0B7AmloyA/default.jpg)