Go Kafka: How To Manually Commit Offsets The Right Way. Database Idempotency.

🔔 SUBSCRIBE for more content like this 👇: https://www.youtube.com/@kcode_tech?sub_confirmation=1

-------

In this advanced Kafka tutorial, we implement manual offset management in Go to achieve exactly-once message processing! Learn how to build a fault-tolerant Kafka consumer using the High Water Mark strategy, manual offset commits, and idempotent database operations.

00:00 Intro
00:59 Visual Problem Statement
04:45 Init Kafka Setup Overview
06:51 Updating Kafka Consumer
10:13 DB setup with SQLX
17:13 Exactly-once implementation
23:30 Kafka Manual Offset Commit
32:45 Testing exactly-once delivery
-------
📂 FULL SERIES:
1. Kafka Producer & Consumer: https://youtu.be/mVDdspGv8qE
2. Consumer offsets commit: https://youtu.be/rvB6Az0ppSg
3. Consumer Partitions && scaling: https://youtu.be/Q1jz4_oKnWs
4. Outbox Pattern with Kafka: https://youtu.be/ujeFmq5trik
5. Inbox Pattern with Kafka: https://youtu.be/7T2kmNGhPvs
6. CDC with Debezium Kafka: https://youtu.be/VQC-lkEve7M

📂 Kafka Playlist:
https://www.youtube.com/watch?v=7T2kmNGhPvs&list=PL4bixvmCNNoHXFjpoI4xGrvbTQU0M_tG6

📂 Debezium Live Streams:
https://www.youtube.com/watch?v=RS8m5Df2cyg&list=PL4bixvmCNNoER80Lzrxe82l8M2pjJlqQn

📂 Folder Structure Rework Live Streams:
https://www.youtube.com/playlist?list=PL4bixvmCNNoFqb3zYZGpt16aVAgK-wTeo
-------

🔗 Useful Links:
GitHub Repository: https://github.com/k-code-yt/golang-yt-examples/tree/kafka-exac-once-in-memory
Confluent Kafka Go Client: https://github.com/confluentinc/confluent-kafka-go
Apache Kafka Docs: https://kafka.apache.org/documentation/

📱 Social media links:
- Twitch: https://www.twitch.tv/kcode_tech

#kcode #go #golang #kafka #exactlyonce #offset #concurrency #distributed #systems #messaging #idempotency #database #transactions #sync #mutex #programming #tutorial #advanced

Видео Go Kafka: How To Manually Commit Offsets The Right Way. Database Idempotency. канала Kcode