When to Move from Batch to Streaming and how to do it without hiring an entirely new team | Bytewax
ABOUT THE TALK:
With more and more demand for data pipelines and applications to go real-time it can get overwhelming. This talk demystifies the when, why, and how of moving from batch processing to real-time/stream processing. We will look at arguments for and against stream processing, common architectures, common pitfalls, and open source tools used.
ABOUT THE SPEAKER:
Zander Matheson is the founder and CEO of Bytewax, an open source software company focused on enabling more developers to work with streaming data. Before starting Bytewax he worked on data infrastructure and data science at GitHub and Heroku.
ABOUT DATA COUNCIL:
Data Council (https://www.datacouncil.ai/) is a community and conference series that provides data professionals with the learning and networking opportunities they need to grow their careers.
Make sure to subscribe to our channel for the most up-to-date talks from technical professionals on data related topics including data infrastructure, data engineering, ML systems, analytics and AI from top startups and tech companies.
FOLLOW DATA COUNCIL:
Twitter: https://twitter.com/DataCouncilAI
LinkedIn: https://www.linkedin.com/company/datacouncil-ai/
Видео When to Move from Batch to Streaming and how to do it without hiring an entirely new team | Bytewax канала Data Council
With more and more demand for data pipelines and applications to go real-time it can get overwhelming. This talk demystifies the when, why, and how of moving from batch processing to real-time/stream processing. We will look at arguments for and against stream processing, common architectures, common pitfalls, and open source tools used.
ABOUT THE SPEAKER:
Zander Matheson is the founder and CEO of Bytewax, an open source software company focused on enabling more developers to work with streaming data. Before starting Bytewax he worked on data infrastructure and data science at GitHub and Heroku.
ABOUT DATA COUNCIL:
Data Council (https://www.datacouncil.ai/) is a community and conference series that provides data professionals with the learning and networking opportunities they need to grow their careers.
Make sure to subscribe to our channel for the most up-to-date talks from technical professionals on data related topics including data infrastructure, data engineering, ML systems, analytics and AI from top startups and tech companies.
FOLLOW DATA COUNCIL:
Twitter: https://twitter.com/DataCouncilAI
LinkedIn: https://www.linkedin.com/company/datacouncil-ai/
Видео When to Move from Batch to Streaming and how to do it without hiring an entirely new team | Bytewax канала Data Council
Показать
Комментарии отсутствуют
Информация о видео
Другие видео канала
Hot or Not: Latest Trends & Buzzwords in DataThe Road to Exceptional Data CorrectnessHow to End the Long tail of Most Data Requests | NarratorWhat I Don't Want to Exist in the Data World in 5 Years | Seattle Data GuyData Contracts in the Modern Data Stack | WhatnotIncident Management for Data People | BigeyeAutomatically Fix Data Issues & Label Errors in Most ML Datasets | CleanlabContinuous Data Pipeline for Real time Benchmarking & Data Set Augmentation | TeleskopeData Product Success: Aligning with Data's Core Purpose | EnteraData Products Aren't Just for Data Teams! LightdashInnovating on Software Development | Fast AIHierarchical Forecasting in Python | NixtlaThe Story of DevRel at Snowflake - How We Got Here | SnowflakeAI The Future is NowHow to Be a 10x Analyst | HyperqueryWhat it Takes to Support the World's Most Popular Open Source Communities | NumFOCUSHow Vercel Builds Dozens of Metrics from One Heterogenous TableGenerative AI for Search | TonitaFrom 1 to IPO: Growing the Data Team and Data Culture at GitLabDesigning & Building Metric Trees