System Design - Run DBT workload on Cloud Composer 2
This video shows how to run DBT workload on Cloud Composer 2 including a diagram for the design as well as some code examples to help you get things up and running.
Useful information
- Cloud Composer 2 new features: https://www.youtube.com/watch?v=gi-uP_S2FEw
- Airflow K8 DBT Demo: https://github.com/rocketechgroup/airflow_k8_dbt_demo
- Compose 2 use K8 Operator: https://cloud.google.com/composer/docs/composer-2/use-kubernetes-pod-operator
- Workload Identity: https://cloud.google.com/kubernetes-engine/docs/how-to/workload-identity
Видео System Design - Run DBT workload on Cloud Composer 2 канала PracticalGCP
Useful information
- Cloud Composer 2 new features: https://www.youtube.com/watch?v=gi-uP_S2FEw
- Airflow K8 DBT Demo: https://github.com/rocketechgroup/airflow_k8_dbt_demo
- Compose 2 use K8 Operator: https://cloud.google.com/composer/docs/composer-2/use-kubernetes-pod-operator
- Workload Identity: https://cloud.google.com/kubernetes-engine/docs/how-to/workload-identity
Видео System Design - Run DBT workload on Cloud Composer 2 канала PracticalGCP
Показать
Комментарии отсутствуют
Информация о видео
Другие видео канала
Manage Access to Internal Apps on App Engine using IAPStreaming data from BigQuery to Datastore using DataflowPubSub Message Consumer on GKE AutopilotIs BigQuery Slot Autoscaling any good?Cloud PubSub Multi-Team DesignBigQuery Atomic OperationsBigQuery - Delta Tracking using DML MERGEPractical GCP - IntroductionDBT Core on Cloud Run JobA practical application leveraging Langchain and BigQuery Vector SearchRun Cloud Composer LocallyImprove Organisation Observability with Cloud Asset InventoryIntroduction to BigQueryNear real-time CDC using DataStreamCI/CD with CloudBuildScaling development teams with Cloud WorkstationsIntroduction to Cloud ComposerBigQuery Cost OptimisationServerless distributed processing with BigFramesTeam Leadership in Technology