Загрузка страницы

dbt + Airflow = ❤ ; An open source project that integrates dbt and Airflow

In this video, we will learn how to run dbt-core jobs in airflow using an open source project.

▬▬▬▬▬▬ Links 🔗 ▬▬▬▬▬▬
► Project : https://github.com/AnandDedha/dbt-airflow-demo
► How to run the project locally : https://github.com/AnandDedha/dbt-airflow-demo/blob/main/docs/how_to_run_this_project.md
► Official Documentation - https://gmyrianthous.github.io/dbt-airflow/
► How to contribute to this open source project - https://github.com/gmyrianthous/dbt-airflow/blob/main/docs/contributing.md
▬▬▬▬▬▬ T I M E S T A M P S ⏰ ▬▬▬▬▬▬
00:00 Getting Started
02:51 Project Architecture
07:53 Project folder Structure
11:15 Docker file and docker compose
20:43 Running Docker Container to set up the project
34:11 Airflow Dags
51:54 How to integrate BigQuery into this project

#dbt
#databuildtool
#apacheairflow
#airflow

dbt
data build tool
apache airflow
airflow
dbt (data build tool)

Thank you so much for watching and supporting our channel. If you like what we're doing and want to see more, consider supporting us on Buy Me a Coffee. Your donations will go directly towards improving our content and keeping us motivated to bring you the best videos possible. Every coffee counts! ☕️

👉 Support us here: https://buymeacoffee.com/datatechdeq

Thank you for being such an amazing community. We couldn't do this without you! 🎥✨

Contact me : datatechdemo2@gmail.com

Видео dbt + Airflow = ❤ ; An open source project that integrates dbt and Airflow канала Data Tech
Показать
Комментарии отсутствуют
Введите заголовок:

Введите адрес ссылки:

Введите адрес видео с YouTube:

Зарегистрируйтесь или войдите с
Информация о видео
22 апреля 2024 г. 5:47:21
00:53:59
Другие видео канала
11. Data Engineering on MS Azure DP 203 (Data Processing) - Incremental Data Loads (Part B)11. Data Engineering on MS Azure DP 203 (Data Processing) - Incremental Data Loads (Part B)AWS S3 Tutorial (Part 3) - How  to set up Access Control on S3 ? IAM Policies & Bucket Policies.AWS S3 Tutorial (Part 3) - How to set up Access Control on S3 ? IAM Policies & Bucket Policies.DP- 203 Exam Experience & overviewDP- 203 Exam Experience & overviewAWS data engineering architecture setup with just 2 clicks| AWS ETL Infrastructure complete setupAWS data engineering architecture setup with just 2 clicks| AWS ETL Infrastructure complete setup7 (Part - A) . Data Engineering on MS Azure DP 203 (Design & implement Storage) - Partitioning7 (Part - A) . Data Engineering on MS Azure DP 203 (Design & implement Storage) - Partitioning11. Data Engineering on MS Azure DP 203 (Data Processing) - Incremental Data Loads (Part A)11. Data Engineering on MS Azure DP 203 (Data Processing) - Incremental Data Loads (Part A)AWS S3 Tutorial (Part 4) -  Amazon S3  Versioning & ReplicationAWS S3 Tutorial (Part 4) - Amazon S3 Versioning & Replication1. Introduction to GCP Cloud Storage for Data Engineering1. Introduction to GCP Cloud Storage for Data EngineeringDynamoDB Local and Global Secondary Indexes: Improve Query Performance and FlexibilityDynamoDB Local and Global Secondary Indexes: Improve Query Performance and FlexibilityAWS S3 Tutorial (Part 6) - AWS Hands on Lab Amazon S3 - Object LockAWS S3 Tutorial (Part 6) - AWS Hands on Lab Amazon S3 - Object Lock7 (Part - B). Data Engineering on MS Azure DP 203 (Design & implement Storage) - Partitioning7 (Part - B). Data Engineering on MS Azure DP 203 (Design & implement Storage) - PartitioningAzure Stream Analytics with SynapseAzure Stream Analytics with Synapsedbt(Data Build Tool) macros crash course: Zero to Hero | Jinja role in dbt | Third-party macrosdbt(Data Build Tool) macros crash course: Zero to Hero | Jinja role in dbt | Third-party macrosApache Kafka tutorial for beginners using food delivery apps such as UberEats or SwiggyApache Kafka tutorial for beginners using food delivery apps such as UberEats or Swiggy17. Data Engineering on MS Azure DP 203 - Auditing for Azure SQL Database & Azure Synapse Analytics17. Data Engineering on MS Azure DP 203 - Auditing for Azure SQL Database & Azure Synapse AnalyticsIntroduction to AWS DynamoDB | Beginners guide for AWS DynamoDBIntroduction to AWS DynamoDB | Beginners guide for AWS DynamoDBSimplified step-by-step process for beginners to understand how AWS Lambda triggers work with eventsSimplified step-by-step process for beginners to understand how AWS Lambda triggers work with eventsEnd-To-End Data Engineering Project in AWS | Build complete Data Pipeline in AWS within 25 minsEnd-To-End Data Engineering Project in AWS | Build complete Data Pipeline in AWS within 25 minsAmazon/AWS VPC (Virtual Private Cloud) Basics | AWS VPC Tutorial for Beginners/Non -Network FolksAmazon/AWS VPC (Virtual Private Cloud) Basics | AWS VPC Tutorial for Beginners/Non -Network Folks4. Working with Apache Spark Dataframe4. Working with Apache Spark Dataframe
Яндекс.Метрика