Building Scalable Data Pipelines with Argo Workflows | super{summit} 2022

This session will be an overview of how we use argo workflows to build elastically scaling data pipelines at spectrum labs. We will demonstrate how we have built a framework that allows us to deploy scalable spark applications with only a few lines of code. Join us to understand how leveraging argo's container-native engine allows us to build on our existing kubernetes investment and simplify our development stack. *** super{summit} 2022 in Denver, CO super{set}'s annual conference for the builders across the hive super{set} is a startup studio that founds and builds data-driven software companies superset.com superset.com/summit

Видео Building Scalable Data Pipelines with Argo Workflows | super{summit} 2022 автора Квантовая Логика