Architecture patterns for distributed, hybrid, edge and global Apache Kafka deployments
Multi-cluster and cross-data center deployments of Apache Kafka have become the norm rather than an exception. This session gives an overview of several scenarios that may require multi-cluster solutions and discusses real-world examples with their specific requirements and trade-offs, including disaster recovery, aggregation for analytics, cloud migration, mission-critical stretched deployments and global Kafka.
Key takeaways:
- In many scenarios, one Kafka cluster is not enough. Understand different architectures and alternatives for multi-cluster deployments.
- Zero data loss and high availability are two key requirements. Understand how to realize this, including trade-offs.
- Learn about features and limitations of Kafka for multi cluster deployments- Global Kafka and mission-critical multi-cluster deployments with zero data loss and high availability became the normal, not an exception.
- Learn about architectures like stretched cluster, hybrid integration and fully-managed serverless Kafka in the cloud (using Confluent Cloud), and tools like MirrorMaker 2, Confluent Replicator, Multi-Region Clusters (MRP), Global Kafka, and more.
Slides: https://www.slideshare.net/KaiWaehner/architecture-patterns-for-distributed-hybrid-edge-and-global-apache-kafka-deployments
More information around Apache Kafka and its ecosystem: h
ttps://www.kai-waehner.de
Connect to me on LinkedIn: https://www.linkedin.com/in/megachucky/
Видео Architecture patterns for distributed, hybrid, edge and global Apache Kafka deployments канала Kai Wähner
Key takeaways:
- In many scenarios, one Kafka cluster is not enough. Understand different architectures and alternatives for multi-cluster deployments.
- Zero data loss and high availability are two key requirements. Understand how to realize this, including trade-offs.
- Learn about features and limitations of Kafka for multi cluster deployments- Global Kafka and mission-critical multi-cluster deployments with zero data loss and high availability became the normal, not an exception.
- Learn about architectures like stretched cluster, hybrid integration and fully-managed serverless Kafka in the cloud (using Confluent Cloud), and tools like MirrorMaker 2, Confluent Replicator, Multi-Region Clusters (MRP), Global Kafka, and more.
Slides: https://www.slideshare.net/KaiWaehner/architecture-patterns-for-distributed-hybrid-edge-and-global-apache-kafka-deployments
More information around Apache Kafka and its ecosystem: h
ttps://www.kai-waehner.de
Connect to me on LinkedIn: https://www.linkedin.com/in/megachucky/
Видео Architecture patterns for distributed, hybrid, edge and global Apache Kafka deployments канала Kai Wähner
Показать
Комментарии отсутствуют
Информация о видео
Другие видео канала
Smart City with Event Streaming and Apache KafkaApache Kafka in the Automotive IndustryProject Flogo Live Demo (Ultra-Lightweight Open Source IoT Integration)How to Apply Machine Learning (R, Apache Spark, H2O.ai) To Real Time Streaming AnalyticsThe Shift Left ArchitectureAugmented Reality Demo with Apache KafkaIoT Project Flogo - How to Build an Apache Kafka Connector / AdapterApp Modernization and Hybrid Cloud Architectures with Apache KafkaData Warehouse vs Visual Real Time Analytics / Live DatamartFlogo - Intro to Golang-powered Open Source IoT Integration Framework (Gophercon)Apache Kafka for Oil & Gas, Smart Grid, and Energy UtilitiesKSQL - the Apache Kafka Streaming SQL Engine - Live Demo using Delimited, JSON and Avro dataGenAI Demo with Apache Kafka, Flink, LangChain, OpenAIApache Kafka in the Insurance IndustryApache Kafka for Predictive Maintenance in Industrial IoT / Industry 4.0Streaming Analytics Comparison of Open Source Frameworks, Products, Cloud ServicesBlockchain - The Next Big Thing for MiddlewareMachine Learning with Apache Kafka without another Data LakeEvent Streaming and Apache Kafka in the Telecommunications Industry (Whiteboard)Blockchain + Streaming Analytics with Ethereum and TIBCO StreamBase