GDG San Diego - Practical Datastream: CloudSQL to BigQuery Change Data Capture on Google Cloud

San Diego Google Developer Group meeting: Wed, Aug 18, 6:00 PM (PDT)
http://gdg.community.dev/gdg-san-diego/

Topic: Practical Datastream: CloudSQL to BigQuery Change Data Capture on Google Cloud

About this event
Datastream from Google is a serverless change data capture and replication service. This allows organizations to replicate data across multiple databases, storage systems and is especially useful for replicating OLTP data in MySQL into an OLAP database such as BigQuery. This talk will walk through setting up connection profiles, streams and touch on some useful debugging for when things don't go as planned.


What happens when data in one database, such as an Online Transaction Processing (OLTP) database running on MySQL has a change that needs to be reflected in an Online Analytics Processing (OLAP) database?

How do you capture that change of data?

With a Change Data Capture process of course!

The Datastream product from Google does just this, and has support for Oracle and MySQL sources, with more to come as the product matures. Currently the only supported target is Cloud Storage, but by using BigQuery's External table support we can view this changed data in BigQuery. But things are prone to breaking, so we'll also review some troubleshooting methods for sorting out what went wrong where.

We will review each service and outline the common use cases and strengths. A passing familiarity with SQL is encouraged but not required.
Presenter: Travis Depuy, SADA Systems, Senior Cloud Engineer

Travis Depuy is a Senior Cloud Engineer at SADA Systems, Google Cloud's Reseller Partner of the Year 3 years running. Travis loves setting up and tearing down all the things with Terraform and using the awesome toolset in GCP to solve problems and streamline operations. In his free time, Travis finds balance in the slower pace of Taichi and Yoga. www.linkedin.com/in/travis-depuy-cloud-engineer

GDG San Diego http://gdg.community.dev/gdg-san-diego/

Видео GDG San Diego - Practical Datastream: CloudSQL to BigQuery Change Data Capture on Google Cloud канала GDG Cloud San Diego