Apache Kafka and KSQL in Action : Let’s Build a Streaming Data Pipeline! by Robin Moffatt
Have you ever thought that you needed to be a programmer to do stream processing and build streaming data pipelines? Think again! Apache Kafka is a distributed, scalable, and fault-tolerant streaming platform, providing low-latency pub-sub messaging coupled with native storage and stream processing capabilities. Integrating Kafka with RDBMS, NoSQL, and object stores is simple with Kafka Connect, which is part of Apache Kafka. KSQL is a SQL streaming engine for Apache Kafka, and makes it possible to build stream processing applications at scale, written using a familiar SQL interface.
In this talk we’ll explain the architectural reasoning for Apache Kafka and the benefits of real-time integration, and we’ll build a streaming data pipeline using nothing but our bare hands, Kafka Connect, and KSQL.
Gasp as we filter events in real time! Be amazed at how we can enrich streams of data with data from RDBMS! Be astonished at the power of streaming aggregates for anomaly detection!
Видео Apache Kafka and KSQL in Action : Let’s Build a Streaming Data Pipeline! by Robin Moffatt канала Devoxx
In this talk we’ll explain the architectural reasoning for Apache Kafka and the benefits of real-time integration, and we’ll build a streaming data pipeline using nothing but our bare hands, Kafka Connect, and KSQL.
Gasp as we filter events in real time! Be amazed at how we can enrich streams of data with data from RDBMS! Be astonished at the power of streaming aggregates for anomaly detection!
Видео Apache Kafka and KSQL in Action : Let’s Build a Streaming Data Pipeline! by Robin Moffatt канала Devoxx
Показать
Комментарии отсутствуют
Информация о видео
Другие видео канала
Values Driven DevelopmentMicroservices Data Patterns: CQRS & Event Sourcing by Edson YanagaProcessing Streaming Data with KSQL - Tim BerglundFrom Zero to Hero with Kafka Connect by Robin MoffattCreating event-driven microservices: the why, how and what by Andrew SchofieldData Pipeline Frameworks: The Dream and the Reality | BeeswaxPrivacy and smartphone apps: What data your phone may be giving away (CBC Marketplace)Opportunities and Pitfalls of Event-driven UtopiaA Deep Dive into Apache Kafka This is Event Streaming by Andrew Dunnings & Katherine StanleyApache Kafka and ksqlDB in Action: Let's Build a Streaming Data Pipeline!Building event-driven (Micro)Services with Apache Kafka by Guido SchmutzApache Kafka and KSQL in Action : Let’s Build a Streaming Data Pipeline! by Robin MoffattRunning Kafka in Kubernetes: a practical guide by Katherine StanleyStreaming Machine Learning with Apache Kafka and TensorFlowDemo: Build a Streaming Application with KSQLBuilding highly reliable data pipelines at Datadog | DatadogKafka Performance: Best Practices for Monitoring and ImprovingETL Is Dead, Long Live Streams: real-time streams w/ Apache KafkaLessons learned form Kafka in production (Tim Berglund, Confluent)Kafka on Kubernetes - From Evaluation to Production at Intuit - Shrinand Javadekar, Intuit