Creating our Own Kubernetes & Docker to Run Our Data Infrastructure | Modal
ABOUT THE TALK:
In this talk, Erik Bernhardsson will share how Modal starts 1000s of large containers in seconds, and what they had to do under the surface to build this. This includes a custom file system written in Rust, their own container runtime, and their own container image builder. This talk will give you an idea of how containers work along with some of the low-level Linux details underneath. We'll also talk about many infrastructure tools hold data teams back, and why they deserve faster and better tools.
ABOUT THE SPEAKER:
Erik Bernhardsson is the founder and CEO of Modal, which is an infrastructure provider for data teams. Before Modal, Erik was the CTO at Better for six years, and previously spent seven years at Spotify, building the music recommendation system and running data teams.
ABOUT DATA COUNCIL:
Data Council (https://www.datacouncil.ai/) is a community and conference series that provides data professionals with the learning and networking opportunities they need to grow their careers.
Make sure to subscribe to our channel for the most up-to-date talks from technical professionals on data related topics including data infrastructure, data engineering, ML systems, analytics and AI from top startups and tech companies.
FOLLOW DATA COUNCIL:
Twitter: https://twitter.com/DataCouncilAI
LinkedIn: https://www.linkedin.com/company/datacouncil-ai/
Видео Creating our Own Kubernetes & Docker to Run Our Data Infrastructure | Modal канала Data Council
In this talk, Erik Bernhardsson will share how Modal starts 1000s of large containers in seconds, and what they had to do under the surface to build this. This includes a custom file system written in Rust, their own container runtime, and their own container image builder. This talk will give you an idea of how containers work along with some of the low-level Linux details underneath. We'll also talk about many infrastructure tools hold data teams back, and why they deserve faster and better tools.
ABOUT THE SPEAKER:
Erik Bernhardsson is the founder and CEO of Modal, which is an infrastructure provider for data teams. Before Modal, Erik was the CTO at Better for six years, and previously spent seven years at Spotify, building the music recommendation system and running data teams.
ABOUT DATA COUNCIL:
Data Council (https://www.datacouncil.ai/) is a community and conference series that provides data professionals with the learning and networking opportunities they need to grow their careers.
Make sure to subscribe to our channel for the most up-to-date talks from technical professionals on data related topics including data infrastructure, data engineering, ML systems, analytics and AI from top startups and tech companies.
FOLLOW DATA COUNCIL:
Twitter: https://twitter.com/DataCouncilAI
LinkedIn: https://www.linkedin.com/company/datacouncil-ai/
Видео Creating our Own Kubernetes & Docker to Run Our Data Infrastructure | Modal канала Data Council
Показать
Комментарии отсутствуют
Информация о видео
Другие видео канала
DC_THURS : dbt w/ Drew BaninDevOps for Machine Learning & Other Half Truths Processes & Tools for the ML Lifecycle | DataRobotData Discovery Getting More From Your MetadataTechnical Founders PanelFeed The Alligators With the Lights On: How Data Engineers Can See Who Really Uses Data | StemmaArchitecting a Low-Latency Schemaless SQL Engine | RocksetBuilding High Performance Recommender Systems with Feature Stores | TectonOffice Hours with Stitch Fix Data PlatformDC_THURS on TrinoEnterprise Data Science Comes of Age | AnacondaUsing Machine Learning and Observability Together to Reduce Incident Impact | DigitalOceanMaking Friends with Generative Models | TonicThe Right Way to Track Mobile DataDC_THURS on Feature EngineeringScaling Uber's Metric System from Elasticsearch to Pinot | UberRikai: A New Data Format for Analytics on Unstructured Data at ScaleDC_THURS on DataHub w/ Shirshanka Das (Acryl Data)The Road to Exceptional Data CorrectnessBuilding an ML Experimentation Platform for Easy Reproducibility | TreeverseHow Vercel Builds Dozens of Metrics from One Heterogenous TableDC_THURS w/ Patrick Thompson, CEO of Iteratively