Depop: Real-Time Data Ingestion and Analysis
Learn more about This Is My Architecture at - https://amzn.to/2W84xSU.
Watch this video to learn how Depop built a data ingestion pipeline and analysis system to handle events from their ecommerce marketplace site. We discuss how the Depop team iterated on their initial architecture to take advantage of a flexible data lake pattern using Lambda, S3, Glue, and Athena. To allow Glue to create a different schema for each data type, they created a separate Kinesis stream for each record or event type.
Host: Toby Knight, Manager, Solutions Architecture
Customer: Alexej Tessaro, Lead Platform Engineer
Subscribe:
More AWS videos http://bit.ly/2O3zS75
More AWS events videos http://bit.ly/316g9t4
#AWS
Видео Depop: Real-Time Data Ingestion and Analysis канала Amazon Web Services
Watch this video to learn how Depop built a data ingestion pipeline and analysis system to handle events from their ecommerce marketplace site. We discuss how the Depop team iterated on their initial architecture to take advantage of a flexible data lake pattern using Lambda, S3, Glue, and Athena. To allow Glue to create a different schema for each data type, they created a separate Kinesis stream for each record or event type.
Host: Toby Knight, Manager, Solutions Architecture
Customer: Alexej Tessaro, Lead Platform Engineer
Subscribe:
More AWS videos http://bit.ly/2O3zS75
More AWS events videos http://bit.ly/316g9t4
#AWS
Видео Depop: Real-Time Data Ingestion and Analysis канала Amazon Web Services
Показать
Комментарии отсутствуют
Информация о видео
Другие видео канала
Nordstrom: Event-Sourced Serverless ArchitecturesViber: Massive Data Lakes on AWSData Engineering Principles - Build frameworks not pipelines - Gatis SejaAuth0: Multi-Region High-Availability Architecture that Scales to 1.5B+ Logins a MonthPayU: Scaling E-commerce Flash Sales using Amazon AuroraIBS: Mission Critical Microservices on AWSPeak AI: From Data Ingestion to Deploying Models - Building an End to End AI PlatformAmazon Prime Video: Advertising Analytics at Scale for Live EventsEdmunds: Event-Driven, Serverless, and Cost-Effective Enterprise Message BusData Pipeline Frameworks: The Dream and the Reality | BeeswaxOLX Group: Running a Robust Real-Time Messaging PlatformEvent-based Architecture and Implementations with Kafka and Atom • Eberhard Wolff • GOTO 2018Confusion in the Land of the Serverless • Sam Newman • GOTO 2018AWS re:Invent 2018: Architecture Patterns for Multi-Region Active-Active Applications (ARC209-R2)Knorex: Scaling from Millions to Billions with Serverless AnalyticsRob Story | Data Engineering Architecture at SimpleScaling Event Sourcing for Netflix DownloadsBanking in the Cloud: 10 Lessons Learned