Advancing Spark - Data Lakehouse Star Schemas with Dynamic Partition Pruning!
Hot on the heels of last week's Spark & AI Summit announcement, Simon is digging into the new features of Spark 3.0. In this episode, we're looking at Dynamic Partition Pruning, which should dramatically speed up queries over partitioned data!
Not sure about partitioning? Don't know why you should care? Watch now!
Don't forget to like & subscribe for more sparky goodness, and check out the Advancing Analytics blog for more content! https://www.advancinganalytics.co.uk/blog
Видео Advancing Spark - Data Lakehouse Star Schemas with Dynamic Partition Pruning! канала Advancing Analytics
Not sure about partitioning? Don't know why you should care? Watch now!
Don't forget to like & subscribe for more sparky goodness, and check out the Advancing Analytics blog for more content! https://www.advancinganalytics.co.uk/blog
Видео Advancing Spark - Data Lakehouse Star Schemas with Dynamic Partition Pruning! канала Advancing Analytics
Показать
Комментарии отсутствуют
Информация о видео
Другие видео канала
Spark AI Summit Announcements - Delta Engine, Koalas, Hyperspace & More!Azure Synapse Analytics: A Data Lakehouse by James SerraAzure Synapse Analytics - Introduction to Azure PurviewDynamic Partition Pruning | Spark Performance TuningPartitioningRealizing the Vision of the Data Lakehouse | Ali Ghodsi | Keynote Spark + AI Summit 2020Optimizing Apache Spark SQL Joins: Spark Summit East talk by Vida HaDynamic Partition Pruning in Apache Spark Bogdan Ghit Databricks -Juliusz Sompolski (Databricks)Hash Partitioning vs Range Partitioning | Spark Interview questionsSpark 3.0 Features | Dynamic Partition Pruning (DPP) | Avoid Scanning Irrelevant DataAdvancing Spark - Advanced Visuals in Databricks SQL AnalyticsColumbia Migrates from Legacy Data Warehouse to an Open Data Platform with Delta LakeAzure Synapse Analytics - Getting Data & OrchestrationSpark Session vs Spark Context | Spark InternalsInstant Model Serving with MLFlow in DatabricksAdvancing Spark - Databricks Runtime 7 4 with Constraints, Usage, Rollbacks & More!Advancing Spark - Databricks Delta StreamingAzure Synapse Analytics - Power BI Integration & PerformanceAdvancing Spark - Crazy Performance with Spark 3 Adaptive Query ExecutionAdvancing Spark - Data & AI Summit 2020 Roundup