dbt + Airflow = ❤ ; An open source project that integrates dbt and Airflow
In this video, we will learn how to run dbt-core jobs in airflow using an open source project.
▬▬▬▬▬▬ Links 🔗 ▬▬▬▬▬▬
► Project : https://github.com/AnandDedha/dbt-airflow-demo
► How to run the project locally : https://github.com/AnandDedha/dbt-airflow-demo/blob/main/docs/how_to_run_this_project.md
► Official Documentation - https://gmyrianthous.github.io/dbt-airflow/
► How to contribute to this open source project - https://github.com/gmyrianthous/dbt-airflow/blob/main/docs/contributing.md
▬▬▬▬▬▬ T I M E S T A M P S ⏰ ▬▬▬▬▬▬
00:00 Getting Started
02:51 Project Architecture
07:53 Project folder Structure
11:15 Docker file and docker compose
20:43 Running Docker Container to set up the project
34:11 Airflow Dags
51:54 How to integrate BigQuery into this project
#dbt
#databuildtool
#apacheairflow
#airflow
dbt
data build tool
apache airflow
airflow
dbt (data build tool)
Thank you so much for watching and supporting our channel. If you like what we're doing and want to see more, consider supporting us on Buy Me a Coffee. Your donations will go directly towards improving our content and keeping us motivated to bring you the best videos possible. Every coffee counts! ☕️
👉 Support us here: https://buymeacoffee.com/datatechdeq
Thank you for being such an amazing community. We couldn't do this without you! 🎥✨
Contact me : datatechdemo2@gmail.com
Видео dbt + Airflow = ❤ ; An open source project that integrates dbt and Airflow канала Data Tech
▬▬▬▬▬▬ Links 🔗 ▬▬▬▬▬▬
► Project : https://github.com/AnandDedha/dbt-airflow-demo
► How to run the project locally : https://github.com/AnandDedha/dbt-airflow-demo/blob/main/docs/how_to_run_this_project.md
► Official Documentation - https://gmyrianthous.github.io/dbt-airflow/
► How to contribute to this open source project - https://github.com/gmyrianthous/dbt-airflow/blob/main/docs/contributing.md
▬▬▬▬▬▬ T I M E S T A M P S ⏰ ▬▬▬▬▬▬
00:00 Getting Started
02:51 Project Architecture
07:53 Project folder Structure
11:15 Docker file and docker compose
20:43 Running Docker Container to set up the project
34:11 Airflow Dags
51:54 How to integrate BigQuery into this project
#dbt
#databuildtool
#apacheairflow
#airflow
dbt
data build tool
apache airflow
airflow
dbt (data build tool)
Thank you so much for watching and supporting our channel. If you like what we're doing and want to see more, consider supporting us on Buy Me a Coffee. Your donations will go directly towards improving our content and keeping us motivated to bring you the best videos possible. Every coffee counts! ☕️
👉 Support us here: https://buymeacoffee.com/datatechdeq
Thank you for being such an amazing community. We couldn't do this without you! 🎥✨
Contact me : datatechdemo2@gmail.com
Видео dbt + Airflow = ❤ ; An open source project that integrates dbt and Airflow канала Data Tech
Показать
Комментарии отсутствуют
Информация о видео
Другие видео канала
![11. Data Engineering on MS Azure DP 203 (Data Processing) - Incremental Data Loads (Part B)](https://i.ytimg.com/vi/lyQV4fFZ21E/default.jpg)
![AWS S3 Tutorial (Part 3) - How to set up Access Control on S3 ? IAM Policies & Bucket Policies.](https://i.ytimg.com/vi/EVWCarYSpNs/default.jpg)
![DP- 203 Exam Experience & overview](https://i.ytimg.com/vi/-FUMomndiLo/default.jpg)
![AWS data engineering architecture setup with just 2 clicks| AWS ETL Infrastructure complete setup](https://i.ytimg.com/vi/aHSU1m86K5U/default.jpg)
![7 (Part - A) . Data Engineering on MS Azure DP 203 (Design & implement Storage) - Partitioning](https://i.ytimg.com/vi/AVj7rgbeiVo/default.jpg)
![11. Data Engineering on MS Azure DP 203 (Data Processing) - Incremental Data Loads (Part A)](https://i.ytimg.com/vi/1pYbC4TXIII/default.jpg)
![AWS S3 Tutorial (Part 4) - Amazon S3 Versioning & Replication](https://i.ytimg.com/vi/M7N-nPtIw8E/default.jpg)
![1. Introduction to GCP Cloud Storage for Data Engineering](https://i.ytimg.com/vi/esjIfGQd5t4/default.jpg)
![DynamoDB Local and Global Secondary Indexes: Improve Query Performance and Flexibility](https://i.ytimg.com/vi/WnCSXeXyHRc/default.jpg)
![AWS S3 Tutorial (Part 6) - AWS Hands on Lab Amazon S3 - Object Lock](https://i.ytimg.com/vi/dmGPUJjm_8Q/default.jpg)
![7 (Part - B). Data Engineering on MS Azure DP 203 (Design & implement Storage) - Partitioning](https://i.ytimg.com/vi/27GvBPoS19g/default.jpg)
![Azure Stream Analytics with Synapse](https://i.ytimg.com/vi/Js7osLzajpQ/default.jpg)
![dbt(Data Build Tool) macros crash course: Zero to Hero | Jinja role in dbt | Third-party macros](https://i.ytimg.com/vi/i38--1pNDUw/default.jpg)
![Apache Kafka tutorial for beginners using food delivery apps such as UberEats or Swiggy](https://i.ytimg.com/vi/_rkIRXxq-P8/default.jpg)
![17. Data Engineering on MS Azure DP 203 - Auditing for Azure SQL Database & Azure Synapse Analytics](https://i.ytimg.com/vi/DOscnYInXiw/default.jpg)
![Introduction to AWS DynamoDB | Beginners guide for AWS DynamoDB](https://i.ytimg.com/vi/a6rVZKp8dsM/default.jpg)
![Simplified step-by-step process for beginners to understand how AWS Lambda triggers work with events](https://i.ytimg.com/vi/pK_QjZscO8w/default.jpg)
![End-To-End Data Engineering Project in AWS | Build complete Data Pipeline in AWS within 25 mins](https://i.ytimg.com/vi/6VJKR3sLTow/default.jpg)
![Amazon/AWS VPC (Virtual Private Cloud) Basics | AWS VPC Tutorial for Beginners/Non -Network Folks](https://i.ytimg.com/vi/RUseA5k8izg/default.jpg)
![4. Working with Apache Spark Dataframe](https://i.ytimg.com/vi/i8Bf0X0_M7k/default.jpg)