Big Data Realtime Analytics | CDC | Maxwell | Part 3 of 3

In this last part of 3-part video, we'll go into the implementation of Maxwell. We'll ensure our Mysql has appropriate configurations and then understand the content configuration file read by maxwell. In the hands on we'll see how maxwell performs CDC and exposes metrics.

Part 2: https://youtu.be/p2Fv01a6WNY
Part 3: https://youtu.be/7Bljf-Br3yw

Google drive: https://drive.google.com/drive/folders/1Z3zXYTRGJBJ_BnLPD-oD4b3ocgvaMfPd?usp=sharing

In our production system, we use:
1. Custom patches on top of open source maxwell for automatic schema registration, mysql server switches, handling json and custom timestamp field
2. Packer and Terraform for Infrastructure as Code (IaC)
3. Prometheus and Grafana for metric collection, dashboard and alerting

Edit: At 08:54 and 09:06, maxwell database has been mis-spelt as maxwell directory

Видео Big Data Realtime Analytics | CDC | Maxwell | Part 3 of 3 канала Amit Ranjan