Developing a Data Pipeline on Google Cloud

Timestamp:
00:00 Introduction
01:14 Agenda
01:43 Why Do We Need Data Pipeline?
02:30 What Are Options on Cloud?
06:40 Option 1: Low-cost & Severless Option
07:56 Option 2: Big Data Solution
09:50 Option 3: Cloud Composer (Airflow)
11:27 Why Apache Airflow?
14:56 Demo Time
21:23 Key Takeaways
22:46 Q1 How do you handle with error automation?

La Kopi @ Developers Space is a monthly open mic night for the developer community to learn, connect, and be inspired by each other. Every month, a tech theme is selected and developers submit their topics to be shared with the community.

Name: Kamolphan (Fon) Liwprasert (Machine Learning Engineer, Sertis)
Topic: Developing a Data Pipeline on Google Cloud
Link to Demo Code: https://bit.ly/airflow_gcp_demo

We will be exploring data pipeline options for analytics or machine learning projects on Google Cloud Platform. We will also see different options to develop a data pipeline and how to choose between options. Lastly, Fon will be introducing Apache Airflow, as well as a demo to show how it can be used.

Be our next La Kopi Speaker → https://goo.gle/openmic​

For more updates on upcoming events, follow us on social media:
✉️ Newsletter → https://goo.gle/devspace-news
👤 Facebook → https://www.facebook.com/DevSpaceSG/
🐦 Twitter → https://twitter.com/DevSpaceSG
🔴 Meetup →https://www.meetup.com/developer-space/

Видео Developing a Data Pipeline on Google Cloud канала Google Developers Space