Загрузка страницы

Airflow for Beginners - Run Spotify ETL Job in 15 minutes!

In this long-awaited Airflow for Beginners video I'm showing you how to install Airflow from scratch, and how to schedule your first ETL job in Airflow!

We will run the Spotify ETL job that we created in my Data Engineering Course for Beginners. But if you have your own code to schedule in Airflow - feel free to use it instead!

In this Airflow tutorial I just wanted to get you started with Airflow, because I know that configuring Airflow can be non-trivial. I won't be going in-depth into all Airflow's features, so hopefully this tutorial will be as beginners friendly as it can get!

I'll show you how to fix some installation errors, how to set up your project folders, how to edit Airflow config file and where it sits, and how to write your first DAG file!

Get ready for a ride!

Oh, but grab some useful links first:

-github code repo: https://github.com/karolina-sowinska/free-data-engineering-course-for-beginners
-Airflow quick start guide: https://airflow.apache.org/docs/stable/start.html
-Spotify access token: https://developer.spotify.com/console/get-recently-played/

Don't forget to subscribe if you're new here, more content is coming!
:)

Find me on Instagram:
@karo_sowinska

Видео Airflow for Beginners - Run Spotify ETL Job in 15 minutes! канала Karolina Sowinska
Показать
Комментарии отсутствуют
Введите заголовок:

Введите адрес ссылки:

Введите адрес видео с YouTube:

Зарегистрируйтесь или войдите с
Информация о видео
12 ноября 2020 г. 23:00:09
00:16:38
Яндекс.Метрика