SQL Best Practices - Designing An ETL - Part 1
Data engineering has many facets. One of the most common projects a data engineer takes on is developing an ETL pipeline from an operational DB to a data warehouse. Our team wanted to cover the overarching design of an ETL.
What are the typical principal components, stages, considerations, etc?
We started this by first writing Creating An ETL Part 1(more to come)
and we and now have worked on a video that is below that walks through the process. We wanted to discuss why each stage is important and what occurs when data goes from raw to stage, why do we need a raw database and so on.
Data engineering is a complex discipline that partners automation, programming, system design, databases, and analytics in order to ensure that analysts, data scientists and end-users have access to clean data.
This all starts with the basic ETL design.
We are practicing up for a webinar that we will be hosting on ETL development with Python and SQL. The webinar itself will be much more technical and dive much deeper into each component described in the video. However, we wanted to see how using the whiteboard was like in case we need it.
If you would like to sign up for the free webinar we will be hosting it on February 23rd at 10 AM PT. Feel free to sign up below!
https://goo.gl/forms/jZzVbCuklWBSFVi52
If you have other questions please do contact us.
http://www.acheronanalytics.com/contact.html
Видео SQL Best Practices - Designing An ETL - Part 1 канала Seattle Data Guy
What are the typical principal components, stages, considerations, etc?
We started this by first writing Creating An ETL Part 1(more to come)
and we and now have worked on a video that is below that walks through the process. We wanted to discuss why each stage is important and what occurs when data goes from raw to stage, why do we need a raw database and so on.
Data engineering is a complex discipline that partners automation, programming, system design, databases, and analytics in order to ensure that analysts, data scientists and end-users have access to clean data.
This all starts with the basic ETL design.
We are practicing up for a webinar that we will be hosting on ETL development with Python and SQL. The webinar itself will be much more technical and dive much deeper into each component described in the video. However, we wanted to see how using the whiteboard was like in case we need it.
If you would like to sign up for the free webinar we will be hosting it on February 23rd at 10 AM PT. Feel free to sign up below!
https://goo.gl/forms/jZzVbCuklWBSFVi52
If you have other questions please do contact us.
http://www.acheronanalytics.com/contact.html
Видео SQL Best Practices - Designing An ETL - Part 1 канала Seattle Data Guy
Показать
Комментарии отсутствуют
Информация о видео
Другие видео канала
ETL Testing interview questions and Answers | ETL Testing Interview PreparationWhat is Data Pipeline | How to design Data Pipeline ? - ETL vs Data pipelineSQL Stored Procedures - What They Are, Best Practices, Security, and More...Functional Data Engineering - A Set of Best Practices | LyftETL Architecture In-Depth - Dimensional Modelling 101Best Online Courses For Data Engineers #dataengineerWhat is ETL | What is Data Warehouse | OLTP vs OLAPDatabase Design TutorialETL Is Dead, Long Live Streams: real-time streams w/ Apache KafkaWhat is ETL | Extract, Transform and Load | Hadoop Tutorial for Beginners | Hadoop [Part 2]IQ15: 6 SQL Query Interview Questions5 SQL Concepts You Need To Know Before Your Next Data Science Or Data Engineering InterviewSaama TechTalk - Best Practices for ETL DesignData Engineering Principles - Build frameworks not pipelines - Gatis SejaLearn SQL in 1 Hour - SQL Basics for BeginnersHow I Prepared For My FAANG Interviews (As A Data Engineer)SSIS Tutorial For Beginners | SQL Server Integration Services (SSIS) | MSBI Training Video | EdurekaPreparing For A Data Engineering Interview: How To Design A Data Warehouse For.A Food Delivery AppCreate an ETL Package with SSIS | SQL Server Integration Services | SSIS Tutorial3 - ETL Tutorial | Extract Transform and Load