Music Recommendations at Scale With Cloud Bigtable (Cloud Next '19)
Spotify serves personalized music recommendations to hundreds of millions of happy customers worldwide, and powers a lot of this infrastructure with Google Cloud Bigtable. In this talk, we'll go into detail about how Cloud Bigtable allows us to deliver recommendations at scale, roll out experiments quickly, and ingest terabytes every day via Cloud Dataflow. We'll discuss a number of challenges we overcame when designing our recommendations infrastructure on top of Cloud Bigtable, including tips about how to design a good schema, how to avoid latency when ingesting new data, and effective caching strategies to scale to tens of millions of data points per second.
We'll also discuss a number of challenges we overcame when architecting our recommendations infrastructure on top of Cloud Bigtable, including tips about how to design a good key space, how to avoid latency when ingesting new data, and how we built caching into every layer of our stack to scale to tens of millions of data points per second.
Build with Google Cloud → https://bit.ly/2WN8356
Watch more:
Next '19 Architecture Sessions here → https://bit.ly/Next19Architecture
Next ‘19 All Sessions playlist → https://bit.ly/Next19AllSessions
Subscribe to the GCP Channel → https://bit.ly/GCloudPlatform
Speaker(s): Peter Sobot
Session ID: ARC205
product:Cloud Bigtable, Cloud Dataflow; event: Google Cloud Next 2019; re_ty: Publish; product: Cloud - Databases - Cloud Bigtable; fullname: Peter Sobot;
Видео Music Recommendations at Scale With Cloud Bigtable (Cloud Next '19) канала Google Cloud Tech
We'll also discuss a number of challenges we overcame when architecting our recommendations infrastructure on top of Cloud Bigtable, including tips about how to design a good key space, how to avoid latency when ingesting new data, and how we built caching into every layer of our stack to scale to tens of millions of data points per second.
Build with Google Cloud → https://bit.ly/2WN8356
Watch more:
Next '19 Architecture Sessions here → https://bit.ly/Next19Architecture
Next ‘19 All Sessions playlist → https://bit.ly/Next19AllSessions
Subscribe to the GCP Channel → https://bit.ly/GCloudPlatform
Speaker(s): Peter Sobot
Session ID: ARC205
product:Cloud Bigtable, Cloud Dataflow; event: Google Cloud Next 2019; re_ty: Publish; product: Cloud - Databases - Cloud Bigtable; fullname: Peter Sobot;
Видео Music Recommendations at Scale With Cloud Bigtable (Cloud Next '19) канала Google Cloud Tech
Показать
Комментарии отсутствуют
Информация о видео
Другие видео канала
Moving from Cassandra to Auto-Scaling Bigtable at Spotify (Cloud Next '19)Bigtable: A Distributed Storage System for Structured Data - CECS 629 Spring 2020Bigtable Vs BigQuery - Professional Cloud Architect | Google Cloud ExamSpanner, Firestore, and Bigtable: Connecting the Dots (Cloud Next '19)Shopify's Architecture to handle 80K RPS Celebrity Sales • Simon Eskildsen • GOTO 2017Spotify: Personalising the Listening Experience - Mounia LalmasHow Spotify Distills Terabytes of Raw Data into Meaningful Music Recommendations | SpotifyModern Data Warehousing with BigQuery (Cloud Next '19)VP of Personalization Oskar Stål Talks the Future of ML at TransformXGoogle File System - Paper that inspired HadoopBigtable in action (Google Cloud Next '17)Jakub Mačina - Real-time personalized recommendations using embeddingsML Ops Best Practices on Google Cloud (Cloud Next '19)What is Cloud Bigtable?MLOps for non-DevOps folks, a.k.a. “I have a model, now what?! - Hannes Hapke - ML4ALL 201930. Designing Row keys for Bigtable with Exam Practice (Lesson 06 - NoSQL Databases Big table)Networking Configurations on Google CloudGoogle's GCA InterviewWhat is Google Bigtable | Cloud Bigtable Architecture | Google Cloud Platform Training | Edureka