Running Apache Airflow Reliably with Kubernetes | Astronomer

Get the slides: https://www.datacouncil.ai/talks/running-airflow-reliably-with-kubernetes
ABOUT THE TALK

Astronomer is a data engineering platform that collects, processes and unifies an organization’s data so that they can get straight to analytics and data science. Initially, Astronomer built their pipeline on top of AWS-managed services to get moving quickly, but ran into some limitations down the road.

In this talk, Astronomer outlines their transition to open source software like Mesos, Docker, Kafka, Airflow, Spark and more. They will review the challenges they faced along the way, and the solutions that most excite them for the future.

ABOUT THE SPEAKER

Greg is a co-founder and CTO of Astronomer. Astronomer's mission is to make it simple for anyone to leverage the power of Apache Airflow. Previously Greg has co-founded several other technology startups and a software and design consultancy.

ABOUT DATA COUNCIL:
Data Council (https://www.datacouncil.ai/) is a community and conference series that provides data professionals with the learning and networking opportunities they need to grow their careers. Make sure to subscribe to our channel for more videos, including DC_THURS, our series of live online interviews with leading data professionals from top open source projects and startups.

FOLLOW DATA COUNCIL:
Twitter: https://twitter.com/DataCouncilAI
LinkedIn: https://www.linkedin.com/company/datacouncil-ai
Facebook: https://www.facebook.com/datacouncilai
Eventbrite: https://www.eventbrite.com/o/data-council-30357384520

Видео Running Apache Airflow Reliably with Kubernetes | Astronomer канала Data Council