Building reuseable and trustworthy ELT pipelines (A templated approach)
Nehil Jain
To improve automation of data pipelines, I propose a universal approach to ELT pipeline that optimizes for data integrity, extensibility, and speed to delivery. The workflow is built using open source tools and standards like Apache Airflow, Singer, Great Expectations, and DBT.
Видео Building reuseable and trustworthy ELT pipelines (A templated approach) канала Apache Airflow
To improve automation of data pipelines, I propose a universal approach to ELT pipeline that optimizes for data integrity, extensibility, and speed to delivery. The workflow is built using open source tools and standards like Apache Airflow, Singer, Great Expectations, and DBT.
Видео Building reuseable and trustworthy ELT pipelines (A templated approach) канала Apache Airflow
Показать
Комментарии отсутствуют
Информация о видео
Другие видео канала
Production Docker image for Apache Airflow
Keynote: Airflow then and now
Big Data Architecture Patterns
From cron to Airflow on Kubernetes: A startup story
Teun van Dijk. Discourse and Knowledge
Improving Airflow's user experience
ELT with Azure SQL Data Warehouse and Polybase
Pipelines on pipelines: Agile CI/CD workflows for Airflow DAGs
Building a Data Pipeline with Distributed Systems
Scheduler as a service - Apache Airflow at EA Digital Platform
Realtime Analytics for Big Data: A Facebook Case Study
Monitor Kubernetes in 10 minutes
Continuous Delivery with Jenkins Workflow and Docker Explained
Airflow at Société Générale : An open source orchestration solution in a banking environment
Achieving Airflow Observability
Airflow as an elastic ETL tool
Informatica powercenter interview preparation | Informatica powercenter interview questions
Top 5 Mistakes When Writing Spark Applications
Keynote: Future of Airflow
Building Realtime Data Pipelines with Kafka Connect and Spark Streaming