Data Engineering Course for Beginners - #1 EXTRACT
This is the first part of the Free Data Engineering Course for Beginners that I've decided to create for you! Over the course of the four videos, we are going to cover the entire ETL process (extract, transform, load), and at the end we are also going to talk about job scheduling.
In this course you will build your first data feed (or data pipeline) using Spotify API. This feed will run daily, and it will download the data about the songs that you listened to during a day, and save that data in a SQLite database on your local machine.
In this video we are going to cover the Extract stage of the ETL process, which means that we will be learning how to download data from a data vendor (Spotify in this case). Along the way I will also explain many basic data engineering concepts such as data formats (csv, json, XML...), API vs FTP methods of downloading data and the difference between compressed and uncompressed data.
Follow this link to generate your Spotify API token:
https://developer.spotify.com/console/get-recently-played/
Find the code with this data engineering project on GitHub:
https://github.com/karolina-sowinska/free-data-engineering-course-for-beginners/blob/master/main.py
Music:
What Now - Golden Age Radio
Connect with me on Instagram:
@karo_sowinska
Please let me know your feedback in the comments, so that we can make this one of the most useful data engineering courses for beginners on YouTube!
Видео Data Engineering Course for Beginners - #1 EXTRACT канала Karolina Sowinska
In this course you will build your first data feed (or data pipeline) using Spotify API. This feed will run daily, and it will download the data about the songs that you listened to during a day, and save that data in a SQLite database on your local machine.
In this video we are going to cover the Extract stage of the ETL process, which means that we will be learning how to download data from a data vendor (Spotify in this case). Along the way I will also explain many basic data engineering concepts such as data formats (csv, json, XML...), API vs FTP methods of downloading data and the difference between compressed and uncompressed data.
Follow this link to generate your Spotify API token:
https://developer.spotify.com/console/get-recently-played/
Find the code with this data engineering project on GitHub:
https://github.com/karolina-sowinska/free-data-engineering-course-for-beginners/blob/master/main.py
Music:
What Now - Golden Age Radio
Connect with me on Instagram:
@karo_sowinska
Please let me know your feedback in the comments, so that we can make this one of the most useful data engineering courses for beginners on YouTube!
Видео Data Engineering Course for Beginners - #1 EXTRACT канала Karolina Sowinska
Показать
Комментарии отсутствуют
Информация о видео
Другие видео канала
Data Engineering Course For Beginners - #2 TRANSFORMData Engineering Course For Beginners - #3 LOADWhat is ETL | What is Data Warehouse | OLTP vs OLAPWhat do DATA ENGINEERS do? Is data engineering a good career choice in 2020?Landing an ENTRY-LEVEL job in Machine Learning | Attack the ML job market LIKE A SNIPERData Engineering Principles - Build frameworks not pipelines - Gatis SejaAirflow for Beginners - Run Spotify ETL Job in 15 minutes!What is Data Pipeline | How to design Data Pipeline ? - ETL vs Data pipelineFuture of Data EngineeringBeginner Data Engineering ProjectFunctional Data Engineering - A Set of Best Practices | LyftAmazon Data Engineer - Must to Have Skill Sets || Beginners || Experienced || Interviews 🔥How To Get a Job in MACHINE LEARNING without a DEGREE | 7 Best TipsHow to Become a Data EngineerRob Story | Data Engineering Architecture at SimpleSkills You Need As A Data EngineerData Engineer vs Data ScientistHow I Would Learn Data Science (If I Had to Start Over)Software Engineering or Machine Learning: What's a better career?Can You Become a Data Scientist?