Real-Time ETL (ELT) with Kafka connect; change data capture from mysql to sql server.
This video demonstrates the power of kafka connect; using built-in connectors to perform incremental load (CDC). It shows how to extract and load data with Kafka Connect,Confluent Platform.
It showcases how to pull data (source) from a mysql into Kafka, and to push data (sink) from a Kafka topic to a sql server.
GitHub link for connector and mysql code:
https://github.com/hnawaz100/kafka
Confluent kafka download:
https://www.confluent.io/download/plans
Confluent kafka installation:
https://www.youtube.com/watch?v=zwSTaqAjsOw
Kafka connect mysql source example:
https://www.youtube.com/watch?v=3IH_C36uBio
Learning Journal kafka overview:
https://www.youtube.com/watch?v=gg-VwXSRnmg&list=PLkz1SCf5iB4enAR00Z46JwY9GGkaS2NON
Kafka connect deep dive - JDBC source connector:
https://www.confluent.io/blog/kafka-connect-deep-dive-jdbc-source-connector
Видео Real-Time ETL (ELT) with Kafka connect; change data capture from mysql to sql server. канала Haq Nawaz
It showcases how to pull data (source) from a mysql into Kafka, and to push data (sink) from a Kafka topic to a sql server.
GitHub link for connector and mysql code:
https://github.com/hnawaz100/kafka
Confluent kafka download:
https://www.confluent.io/download/plans
Confluent kafka installation:
https://www.youtube.com/watch?v=zwSTaqAjsOw
Kafka connect mysql source example:
https://www.youtube.com/watch?v=3IH_C36uBio
Learning Journal kafka overview:
https://www.youtube.com/watch?v=gg-VwXSRnmg&list=PLkz1SCf5iB4enAR00Z46JwY9GGkaS2NON
Kafka connect deep dive - JDBC source connector:
https://www.confluent.io/blog/kafka-connect-deep-dive-jdbc-source-connector
Видео Real-Time ETL (ELT) with Kafka connect; change data capture from mysql to sql server. канала Haq Nawaz
Показать
Комментарии отсутствуют
Информация о видео
Другие видео канала
![ETL Is Dead, Long Live Streams: real-time streams w/ Apache Kafka](https://i.ytimg.com/vi/I32hmY4diFY/default.jpg)
![From Zero to Hero with Kafka Connect by Robin Moffatt](https://i.ytimg.com/vi/Jkcp28ki82k/default.jpg)
![SSIS Incremental load with SQL Server Change Data Capture (CDC)](https://i.ytimg.com/vi/FJSvKgfXgtk/default.jpg)
![Building data pipelines with Kafka and PostgreSQL](https://i.ytimg.com/vi/Ca3TlklRhfs/default.jpg)
![Streaming Database Changes with Debezium by Gunnar Morling](https://i.ytimg.com/vi/IOZ2Um6e430/default.jpg)
![Modern Data Architectures with Kafka and Cassandra | DataStax Accelerate 2019](https://i.ytimg.com/vi/fuT1Ryez_WU/default.jpg)
![SQL Server interview questions and answers :-What is CDC( Change data capture ) ?](https://i.ytimg.com/vi/wSQ1GXEwAUQ/default.jpg)
![Apache Kafka vs. Integration Middleware (MQ, ETL, ESB) - Friends, Enemies or Frenemies?](https://i.ytimg.com/vi/6yG2myKcMQE/default.jpg)
![Kafka Tutorial - Core Concepts](https://i.ytimg.com/vi/udnX21__SuU/default.jpg)
![Installing a JDBC driver for the Kafka Connect JDBC connector](https://i.ytimg.com/vi/vI_L9irU9Pc/default.jpg)
![Oracle and Kafka Build a Scalable ETL Solution](https://i.ytimg.com/vi/dOnzikYnQ4g/default.jpg)
![Processing Streaming Data with KSQL - Tim Berglund](https://i.ytimg.com/vi/LM-aQQQes4Q/default.jpg)
![What is Kafka Connect?](https://i.ytimg.com/vi/IHQsKHYXOp0/default.jpg)
![Practical Change Data Streaming Use Cases with Apache Kafka & Debezium](https://i.ytimg.com/vi/Lqv-q2VWNQM/default.jpg)
![Apache Kafka in 5 minutes](https://i.ytimg.com/vi/PzPXRmVHMxI/default.jpg)
![Integrating Oracle and Kafka](https://i.ytimg.com/vi/LAoepZTapMM/default.jpg)
![Real-Time ETL with Kafka streams; Transformations in ETL via kafka streams. Part 1 of 2.](https://i.ytimg.com/vi/0-Se57DKJdA/default.jpg)
![SQL Server training and interview question:-What is index and how does it make your search faster ?.](https://i.ytimg.com/vi/rtmeNwn4mEg/default.jpg)
![Apache Kafka Connect Architecture | Kafka Connect Core Concepts | Learn Kafka Connector Framework](https://i.ytimg.com/vi/ocI64_CkSlw/default.jpg)
![SQL Server interview question :- What is use of Coalesce and ISNULL ( SQL Server training)?](https://i.ytimg.com/vi/vi_GdJn1evI/default.jpg)