Testing Airflow workflows - ensuring your DAGs work before going into production
Bas Harenslak
How do you ensure your workflows work before deploying to production? In this talk I’ll go over various ways to assure your code works as intended - both on a task and a DAG level.
Видео Testing Airflow workflows - ensuring your DAGs work before going into production канала Apache Airflow
How do you ensure your workflows work before deploying to production? In this talk I’ll go over various ways to assure your code works as intended - both on a task and a DAG level.
Видео Testing Airflow workflows - ensuring your DAGs work before going into production канала Apache Airflow
Показать
Комментарии отсутствуют
Информация о видео
Другие видео канала
Keynote: How large companies use Airflow for ML and ETL pipelines
Airflow in Practice Stop Worrying Start Loving DAGs - Sarah Schattschneider
Building reuseable and trustworthy ELT pipelines (A templated approach)
Dockerfile Best Practices
Life Lessons From 100-Year-Olds
Airflow CI/CD: Github to Cloud Composer (safely)
Airflow DAG: Coding your first DAG for Beginners
Airflow XCom for Beginners - All you have to know in 10 mins
Production Docker image for Apache Airflow
Airflow on Kubernetes: Containerizing your workflows
Airflow on Kubernetes: Dynamic Workflows Simplified - Daniel Imberman, Bloomberg & Barni Seetharaman
🌈Apache Airflow for beginners
Mercedes S65 AMG Coil Pack Removal (M275 engine)
Achieving Airflow observability with Databand
Airflow: Automating ETLs for a Data Warehouse, Natarajan Chakrapani, SF Python July 2018
AIP-31: Airflow functional DAG definition
Running Apache Airflow with the KubernetesExecutor on a multi-node Kubernetes cluster locally
Lessons learned form Kafka in production (Tim Berglund, Confluent)
What's coming in Airflow 2.0?
What exactly is this TFX thing? (TensorFlow Extended)