Beam Summit 2023 | Parallelizing Skewed Hbase Regions using Splittable Dofn - Prathap Reddy
During HBase to Cloud BigTable Migrations, HBase snapshots will be imported to Cloud Bigtable. Each Snapshot contains several HBase regions and certain HBase regions can be quite large due to skewed data.
In this presentation along with code snippets and benchmark test results, we showcase how to parallelize a skewed HBase Regions using Splittable DoFn and reduce pipeline runtime.
Видео Beam Summit 2023 | Parallelizing Skewed Hbase Regions using Splittable Dofn - Prathap Reddy канала Apache Beam
In this presentation along with code snippets and benchmark test results, we showcase how to parallelize a skewed HBase Regions using Splittable DoFn and reduce pipeline runtime.
Видео Beam Summit 2023 | Parallelizing Skewed Hbase Regions using Splittable Dofn - Prathap Reddy канала Apache Beam
Комментарии отсутствуют
Информация о видео
1 августа 2023 г. 5:14:36
00:21:39
Другие видео канала
Beam Summit 2023 | How to balance power and control when using Dataflow with an OLTP SQL Database
Apache Beam Needs You - Getting started with open source contributions (Beam Summit Europe 2019)
Cost optimization of Dataflow pipelines - Beam Summit 2024
Beam College 2023 | Getting started with Dataflow templates
Using the Mm FLaNK Stack for Edge AI (Flink, NiFi, Kafka, Kudu)
NEXMark-Beam: Your best companion for testing and benchmarking new core stream processing libraries
Beam Summit 2023 | Design considerations to operate a stateful streaming pipeline as a service
Apache Beam meetup Bay Area: Python Streaming Pipelines with Beam on Flink by Thomas Weise
Creating art with Bigtable's monitoring tools
Beam Summit 2022 - Apache Beam backend for open source Scalding
MLOps with TensorFlow Extended and Apache Beam
Beam Summit 2023 | How to write an IO for Beam - John Casey
Beam Summit 2021 - Fault Tolerant Integration of Apache Beam With Relational Database
Beam College 2023 | Part 4: From speech to classifier
Stream processing for the masses with Beam, Python and Flink
Four Apache Technologies Combined for Fun and Profit
Apache Beam meet up London 6: detecting fraud @ Revolut + tech deep dive
Beam and Geocoding
Video Analytics for Football games @ SportTotal.tv (Beam Summit Europe 2019)
Keynote - State of the Python SDK (Beam Summit Europe 2019)
