Загрузка страницы

Managed Airflow Instance with Google Cloud Composer | Product Spotlight | Google Cloud Platform

In the first product spotlight video, we are covering Google Cloud Composer, a fully managed Airflow service.

Composer provides a highly available and scalable Airflow installation with awesome monitoring and logging out of the box.

Composer leverages lot of other Google Cloud Services such as Google Kubernetes Engine, Google App Engine, Google Cloud Storage, Cloud PubSub and more.

___________________________________________________________________

Cloud Composer Versions : https://cloud.google.com/composer/docs/concepts/versioning/composer-versioning-overview

Sample DAG : https://gist.github.com/kaysush/85f568f1ef2484efe3f19588392c8d3b

___________________________________________________________________

I regularly blog and post on my other social media channels as well, so do make sure to follow me there as well.

Medium ► https://lnkd.in/dPu9iKi
GitHub ► https://github.com/kaysush
LinkedIn ► https://lnkd.in/d5AtTna
YouTube ► https://lnkd.in/dt-XAWY

#GoogleCloudPlatform #GoogleComposer #Airflow

Видео Managed Airflow Instance with Google Cloud Composer | Product Spotlight | Google Cloud Platform канала Sushil Kumar
Показать
Комментарии отсутствуют
Введите заголовок:

Введите адрес ссылки:

Введите адрес видео с YouTube:

Зарегистрируйтесь или войдите с
Информация о видео
1 октября 2021 г. 19:59:46
00:23:55
Другие видео канала
Introduction | Cloud Functions | Google Cloud SeriesIntroduction | Cloud Functions | Google Cloud SeriesGoogle Cloud Storage | Product Spotlight | Google Cloud PlatformGoogle Cloud Storage | Product Spotlight | Google Cloud Platform2 - Deploying first service on Cloud Run | Learning Cloud Run | Google Cloud Series2 - Deploying first service on Cloud Run | Learning Cloud Run | Google Cloud Series2.3 - Submit Dataproc job via gcloud | Apache Spark on Dataproc | Google Cloud Series2.3 - Submit Dataproc job via gcloud | Apache Spark on Dataproc | Google Cloud Series4.4 - Preemptible Secondary Workers | Apache Spark on Dataproc | Google Cloud Series4.4 - Preemptible Secondary Workers | Apache Spark on Dataproc | Google Cloud Series4.5 - Local SSDs for rescue | Apache Spark on Dataproc | Google Cloud Series4.5 - Local SSDs for rescue | Apache Spark on Dataproc | Google Cloud Series1 - Introduction | Learning Cloud Run | Google Cloud Series1 - Introduction | Learning Cloud Run | Google Cloud SeriesCreating First Function | Cloud Functions | Google Cloud SeriesCreating First Function | Cloud Functions | Google Cloud Series2.5 - Deleting the cluster and its implication | Apache Spark on Dataproc | Google Cloud Series2.5 - Deleting the cluster and its implication | Apache Spark on Dataproc | Google Cloud Series5.1 - Jupyter on Dataproc | Apache Spark on Dataproc | Google Cloud Series5.1 - Jupyter on Dataproc | Apache Spark on Dataproc | Google Cloud Series3.2 - Externalize Hive Meta-store with Cloud SQL | Apache Spark on Dataproc | Google Cloud Series3.2 - Externalize Hive Meta-store with Cloud SQL | Apache Spark on Dataproc | Google Cloud Series5.2 - Airflow-Dataproc Integration | Apache Spark on Dataproc | Google Cloud Series5.2 - Airflow-Dataproc Integration | Apache Spark on Dataproc | Google Cloud Series1.1 - Introduction |  Apache Spark on Dataproc | Google Cloud Series1.1 - Introduction | Apache Spark on Dataproc | Google Cloud Series1.3 - Setting up machine for development | Apache Spark on Dataproc | Google Cloud Series1.3 - Setting up machine for development | Apache Spark on Dataproc | Google Cloud Series2.1 - Create the first Dataproc Cluster | Apache Spark on Dataproc | Google Cloud Series2.1 - Create the first Dataproc Cluster | Apache Spark on Dataproc | Google Cloud Series2.4 - Submit Dataproc job via SSH | Apache Spark on Dataproc | Google Cloud Series2.4 - Submit Dataproc job via SSH | Apache Spark on Dataproc | Google Cloud SeriesThe Problem of Cold Start | Cloud Functions | Google Cloud SeriesThe Problem of Cold Start | Cloud Functions | Google Cloud Series4.6 - Autoscaling Clusters | Aapche Spark on Dataproc | Google Cloud Series4.6 - Autoscaling Clusters | Aapche Spark on Dataproc | Google Cloud Series1.2 -  Setting up trial GCP Account | Apache Spark on Dataproc | Google Cloud Series1.2 - Setting up trial GCP Account | Apache Spark on Dataproc | Google Cloud SeriesFunction Triggers | Cloud Functions | Google Cloud SeriesFunction Triggers | Cloud Functions | Google Cloud Series3.1 - Storing Data in GCS Bucket | Apache Spark on Dataproc | Google Cloud Series3.1 - Storing Data in GCS Bucket | Apache Spark on Dataproc | Google Cloud Series
Яндекс.Метрика