How Twitter Is Migrating 300 PB of Hadoop Data to GCP (Cloud Next '19)
Twitter has been migrating their complex Hadoop workload to Google Cloud. In this session, we deep dive into how Twitter's components use Cloud Storage Connector and describe our initial usage, features we implemented, and how Google helped us build those features in open source. We describe how Cloud Storage fits into our ecosystems and the experience and features which have helped us. We'll also talk about unique challenges we discovered in data management at scale.
Migrating Hadoop to GCP → http://bit.ly/2KbS1Ap
Watch more:
Next '19 Storage Sessions here → https://bit.ly/Next19Storage
Next ‘19 All Sessions playlist → https://bit.ly/Next19AllSessions
Subscribe to the GCP Channel → https://bit.ly/GCloudPlatform
Moderator: Sameer Farooqui
Panelists: Vrushali Channapattan, Joep Rottinghuis, Lohit VijayaRenu
Session ID: STO201
product: Cloud - General; fullname: Vrushali Channapattan, Joep Rottinghuis, Lohit VijayaRenu; event: Google Cloud Next 2019;
Видео How Twitter Is Migrating 300 PB of Hadoop Data to GCP (Cloud Next '19) канала Google Cloud Tech
Migrating Hadoop to GCP → http://bit.ly/2KbS1Ap
Watch more:
Next '19 Storage Sessions here → https://bit.ly/Next19Storage
Next ‘19 All Sessions playlist → https://bit.ly/Next19AllSessions
Subscribe to the GCP Channel → https://bit.ly/GCloudPlatform
Moderator: Sameer Farooqui
Panelists: Vrushali Channapattan, Joep Rottinghuis, Lohit VijayaRenu
Session ID: STO201
product: Cloud - General; fullname: Vrushali Channapattan, Joep Rottinghuis, Lohit VijayaRenu; event: Google Cloud Next 2019;
Видео How Twitter Is Migrating 300 PB of Hadoop Data to GCP (Cloud Next '19) канала Google Cloud Tech
Показать
Комментарии отсутствуют
Информация о видео
Другие видео канала
Migrating On-Premises Hadoop Infrastructure to Google Cloud Platform (Cloud Next '18)What is Big Data and Hadoop?COBOL Modernization Using Azure Serverless Computing and DevOpsTwitter's GCP Architecture for Its Petabyte-Scale Data Storage in GCS (Cloud Next '19)Cloud Load Balancing Deep Dive and Best Practices (Cloud Next '19)Migrating Data to AWS: Understanding Your Options - AWS Online Tech TalksMeet the Authors – Go Language (Cloud Next '19)Google Cloud Platform on a shoestring budget (Google I/O '18)Using Kubernetes, Spinnaker and Istio to Manage a Multi-cloud Environment (Cloud Next '18)Google Cloud: Data Protection and Regulatory Compliance (Cloud Next ‘19 UK)How Customers Are Migrating Hadoop to Google Cloud Platform (Cloud Next '19)Data Catalog for data discovery and metadata managementMigrating from a Monolith to Microservices (Cloud Next '19)Best Practices for Migrating Big Data Workloads to AWS - AWS Online Tech TalksRethinking VMsHow Retailers Prepare for Black Friday on Google Cloud Platform (Cloud Next '19)Cloud Dataproc’s Newest Features (Cloud Next '19)Migrating a Big Data Environment to the Cloud, The Untold Story (Cloud Next '19)Think Big, Think Global (Cloud Next '19)Kickstarting your migration to Google Cloud (5 Steps)