Implementing SCD Type 2 | Apache Spark | Databricks Delta [Part 1 of 2]

The first part of the 2 part videos on implementing the Slowly Changing Dimensions (SCD Type 2), where we keep the changes over a dimension field in Data Warehouse.
We'll be using Apache Spark with Databricks Delta. In this first part, we'll cover the basics of SCD, its types and importance.

Part 2 of the video
https://youtu.be/cJqRe4mSpLc

Google Drive link for the slides and the source code
https://drive.google.com/drive/folders/1kMpFviJn1KV1BZcent9Bva8F1ik82Fwx?usp=sharing

Info on SCD
https://www.datawarehouse4u.info/SCD-Slowly-Changing-Dimensions.html

Implementing merge in SCD type 2 using Databricks Delta
https://docs.databricks.com/_static/notebooks/merge-in-scd-type-2.html

Видео Implementing SCD Type 2 | Apache Spark | Databricks Delta [Part 1 of 2] канала Amit Ranjan