DBT Core on Cloud Run Job

I'm thrilled to share my latest video: "DBT Core on Cloud Run Job" This tutorial is tailored for those looking to streamline their data transformation workflows in a serverless environment using Google Cloud's powerful service, Cloud Run. Whether you're a seasoned professional or just starting, this video has valuable insights for everyone.

🔹 What's Inside?

- A step-by-step guide on setting up and running DBT Core on Cloud Run, a serverless platform that allows you to run containers in the Google Cloud environment.
- Key differences between DBT Core and DBT Cloud and how you can leverage both to enhance your cloud ecosystem.
- Practical tips on configuration, testing using SDK, and executing synchronous or asynchronous tasks.

🔹 Why Watch?

- Simplicity and Speed: Learn how to easily set up a serverless solution with a very fast start time on Cloud Run.
- Flexibility: Discover how to trigger jobs right from the console and run processes for up to 24 hours.
- Independence and Control: Gain insights into easy config entrypoint overrides and managing your projects independently.

This video is not just about learning; it's about transforming the way you handle data modeling and transformation in the cloud. Perfect for those who appreciate clear, concise, and practical approaches to complex systems.

Let's connect and discuss more on optimising data processes! Feel free to share your thoughts and feedback in the comments below or direct message me.

* 01:06 - DBT Cloud vs DBT Core
* 07:08 - The two ways I shared so far - Cloud Composer
* 08:14 - The two ways I shared so far - Cloud Batch
* 09:05 - Why Cloud Run Job might be the best
* 15:03 - Code walk through
* 24:29 - Demo
* 34:30 - Summary

Useful links
- Slides: https://docs.google.com/presentation/d/1a6IA1T8nWilb6hZ17rC0ZfSeFM6DlWi5LDDS2EX1Dls/edit?resourcekey=0-iYUXP8GGRA6TGgMCKgeYGA#slide=id.g62fc528f49_1_72
- Code: https://github.com/rocketechgroup/dbt-on-cloud-run
- Cloud Run Python SDK examples: https://github.com/googleapis/google-cloud-python/tree/main/packages/google-cloud-run/samples/generated_samples
- RunJobRequest Overrides docs: https://cloud.google.com/python/docs/reference/run/latest/google.cloud.run_v2.types.RunJobRequest.Overrides

Видео DBT Core on Cloud Run Job канала PracticalGCP