Se ha denunciado esta presentación.
Se está descargando tu SlideShare. ×

Building streaming applications using a managed Kafka service | DevNation Tech Talk

Building streaming applications using a managed Kafka service | DevNation Tech Talk

Descargar para leer sin conexión

Learn about Red Hat OpenShift Streams for Apache Kafka, a service that provides fully hosted and managed Kafka instances. This enables you to focus on building your real-time, data streaming applications while Red Hat takes care of your infrastructure. After this session you'll be familiar with the features of OpenShift Streams for Apache Kafka, the related CLI tooling, and understand how it can be integrated with applications running on OpenShift (or elsewhere!)

Learn about Red Hat OpenShift Streams for Apache Kafka, a service that provides fully hosted and managed Kafka instances. This enables you to focus on building your real-time, data streaming applications while Red Hat takes care of your infrastructure. After this session you'll be familiar with the features of OpenShift Streams for Apache Kafka, the related CLI tooling, and understand how it can be integrated with applications running on OpenShift (or elsewhere!)

Más Contenido Relacionado

Presentaciones para usted

Más de Red Hat Developers

Audiolibros relacionados

Gratis con una prueba de 30 días de Scribd

Ver todo

Building streaming applications using a managed Kafka service | DevNation Tech Talk

  1. 1. CONFIDENTIAL Designator An Introduction Red Hat OpenShift Streams for Apache Kafka Evan Shortiss Principal Technical Marketing Manager 1 @evanshortiss
  2. 2. CONFIDENTIAL Designator What we’ll be discussing today AGENDA 2 What is Apache Kafka? Apache Kafka Use Cases & Examples Red Hat OpenShift Streams for Apache Kafka Introduction Using OpenShift Streams with Quarkus and OpenShift Serverless
  3. 3. CONFIDENTIAL Designator 3 What is Apache Kafka?
  4. 4. CONFIDENTIAL designator 4 INTRODUCTION What is Apache Kafka? Source: https://kafka.apache.org/
  5. 5. CONFIDENTIAL designator ▸ The Admin API to manage and inspect topics, brokers, and other Kafka objects. ▸ The Producer API to publish (write) a stream of events to one or more Kafka topics. ▸ The Consumer API to subscribe to (read) one or more topics and to process the stream of events produced to them. ▸ The Kafka Streams API to implement stream processing applications and microservices. ▸ The Kafka Connect API to build and run reusable data import/export connectors that consume (read) or produce (write) streams of events from and to external systems and applications so they can integrate with Kafka. 5 INTRODUCTION What is Apache Kafka? Kafka APIs Source: https://kafka.apache.org/intro
  6. 6. CONFIDENTIAL designator 6 INTRODUCTION What is Apache Kafka? Architecture Broker A Broker B Broker C Consumers Topic: Clicks Topic: Purchases P1 P2 P3 P1 P2 P3 Producer Kafka Cluster
  7. 7. CONFIDENTIAL designator Kafka Cluster 7 INTRODUCTION What is Apache Kafka? Architecture Broker A Broker B Broker C Consumer Group Topic: Clicks Topic: Purchases P1 P2 P3 P1 P2 P3 Producer Group
  8. 8. CONFIDENTIAL designator ▸ Key: An identifier, e.g “jane@example.com” ▸ Value: The event data, e.g “Purchased 1 copy of The Shining” ▸ Timestamp 8 INTRODUCTION What is Apache Kafka? Event Structure Source: https://kafka.apache.org/intro Kafka uses a binary message protocol, this JSON is for illustrative purposes only.
  9. 9. CONFIDENTIAL Designator 9 Apache Kafka Use Cases
  10. 10. CONFIDENTIAL designator USE CASES 10 Kafka in use today Digital experiences Delivers real-time experiences with immediate access to information and response time Microservices applications Loosely couples microservices so development teams can remain agile Streaming ETL/CDC Modernize applications driven by batch data for real-time performance Real-time analytics Ingest data from multiple sources for better business insights Edge & hybrid scenarios Collect data from diverse and disparate devices and systems
  11. 11. CONFIDENTIAL designator 11 USE CASES Spotify uses Kafka & Debezium CDC for Real-time metrics
  12. 12. CONFIDENTIAL designator 12 USE CASES Uber uses Kafka for reliable retries in distributed systems
  13. 13. CONFIDENTIAL designator 13 USE CASES Scalable high-throughput payment networks
  14. 14. CONFIDENTIAL designator USE CASES 14 A practical example at Red Hat Summit 2021 Image Credit: Hasbro / Amazon Battleship-esque Game ▸ Fun board/tabletop game. ▸ Player vs. player. ▸ Choose your ship positions in secret. ▸ Declare both players are ready to play. ▸ Try to score hits/shots on opponent ships. ▸ Opponent must declare: ・ Hit ・ Miss ・ Sunk ▸ Winner declared when they sink all opponent ships.
  15. 15. CONFIDENTIAL designator USE CASES 15 A practical example at Red Hat Summit 2021 Wait for an opponent
  16. 16. CONFIDENTIAL designator USE CASES 16 A practical example at Red Hat Summit 2021 Position your ships
  17. 17. CONFIDENTIAL designator USE CASES 17 A practical example at Red Hat Summit 2021 Make shots (Red is a hit, white is a miss)
  18. 18. CONFIDENTIAL designator USE CASES 18 A practical example at Red Hat Summit 2021 Underlying event stream
  19. 19. CONFIDENTIAL designator USE CASES 19 A practical example at Red Hat Summit 2021 Real-time metrics and event processing
  20. 20. CONFIDENTIAL designator USE CASES 20 A practical example at Red Hat Summit 2021 Aggregation using the Kafka Streams API
  21. 21. CONFIDENTIAL designator USE CASES 21 A practical example at Red Hat Summit 2021 Aggregating events into a complete record, from multiple clusters
  22. 22. CONFIDENTIAL Designator 22 Why use Red Hat OpenShift Streams for Apache Kafka?
  23. 23. CONFIDENTIAL designator OPENSHIFT STREAMS FOR APACHE KAFKA Long names, short names... names! 23 Red Hat OpenShift Streams for Apache Kafka is the official name OpenShift Streams is the preferred shortened version of the product But….. often you’ll hear RHOSAK Managed Kafka Or just Kafka
  24. 24. CONFIDENTIAL designator 24 OPENSHIFT STREAMS FOR APACHE KAFKA Why Red Hat OpenShift Streams for Apache Kafka? Reduced Complexity Brokers Load Balancers VMs Applications Components Events
  25. 25. CONFIDENTIAL designator 25 OPENSHIFT STREAMS FOR APACHE KAFKA Why Red Hat OpenShift Streams for Apache Kafka? Reduced Complexity Brokers Load Balancers VMs Applications Components Events
  26. 26. CONFIDENTIAL designator OPENSHIFT STREAMS FOR APACHE KAFKA The value of Red Hat OpenShift Streams for Apache Kafka 26 Faster application velocity Unified experience across all clouds Kafka ecosystem for streams-based applications Begin developing immediately and continuously respond to change Seamlessly connects applications across public and private clouds Delivers a curated set of cloud services to simplify delivery of stream-based applications
  27. 27. CONFIDENTIAL Red Hat associate and NDA partner use only, No further distribution RED HAT MANAGEMENT 27 Hosted & managed service offering Red Hat cloud services are managed and operated by Red Hat’s Site Reliability Engineers ▸ SREs serve as the cloud provider account owner and cluster administrator owning the SLA ▸ Responsible for the 24x7 support for all managed and hosted environments ■ Including for building, installing, upgrading, managing and maintaining every cluster ▸ SRE teams are distributed across 3 regions: APAC, EMEA and Americas ▸ The team ensures open communications channels centralized around the dedicated customer portal Americas EMEA APAC
  28. 28. CONFIDENTIAL designator 28 OPENSHIFT STREAMS FOR APACHE KAFKA Red Hat’s commitment to Kafka-based products A history of innovation and success Red Hat brings Kafka to Kubernetes and launches Red Hat AMQ Streams (Red Hat Integration) Ecosystem to deliver event-driven solutions Customer success Kafka innovation since 2018
  29. 29. CONFIDENTIAL Designator 29 Getting Started with Red Hat OpenShift Streams for Apache Kafka
  30. 30. CONFIDENTIAL designator cloud.redhat.com Sign-in Red Hat Developer OPENSHIFT STREAMS FOR APACHE KAFKA 30 Streams for Apache Kafka Evaluations Spin-up a Kafka cluster User get access to Kafka UI Develop and deploy Kafka-based applications
  31. 31. CONFIDENTIAL designator Connect Cloud Service to your OpenShift cluster (CLI, OpenShift Console, RHOAS Operator) 31 Developer Workflow Create Cloud Service (RHOAS CLI, UI) Bind to your application (SBO, ODO, Quarkus, Node.js, OpenShift Console, ...) RHOAS OPENSHIFT STREAMS FOR APACHE KAFKA
  32. 32. CONFIDENTIAL designator 32 OPENSHIFT STREAMS FOR APACHE KAFKA Getting access to OpenShift Streams https://developers.redhat.com/products/rhosak/overview
  33. 33. CONFIDENTIAL designator 33 OPENSHIFT STREAMS FOR APACHE KAFKA Getting access to OpenShift DevSandox https://developers.redhat.com/developer-sandbox/get-started
  34. 34. CONFIDENTIAL designator 34 OPENSHIFT STREAMS FOR APACHE KAFKA Follow the Guides & Quickstarts
  35. 35. CONFIDENTIAL Designator Demo 35
  36. 36. CONFIDENTIAL Designator linkedin.com/showcase/red-hat-developer youtube - bit.ly/2YRIWTk facebook.com/redhatdeveloperprogram twitter.com/rhdevelopers Red Hat is the world’s leading provider of enterprise open source software solutions. Award-winning support, training, and consulting services make Red Hat a trusted adviser to the Fortune 500. Thank you 36

×