SlideShare una empresa de Scribd logo
1 de 73
Apache Kafka vs. Traditional Middleware
(MQ, ETL, ESB, iPaaS)
Friends, Enemies, or Frenemies?
Kai Waehner
Field CTO
kai.waehner@confluent.io
linkedin.com/in/kaiwaehner
@KaiWaehner
confluent.io
kai-waehner.de
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
Agreement:
Kafka is the de facto standard for …
• messaging at scale!
• decoupling of microservices!
• reliable, lightweight stream processing!
• real-time backbone for data mesh
Controversial discussion:
Apache Kafka vs. Traditional Middleware
Use Apache Kafka
as middleware!
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
Agenda
1. Traditional Middleware
2. Data Streaming Platform
3. Enemies
4. Friends
5. Frenemies
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
Agenda
1. Traditional Middleware
2. Data Streaming Platform
3. Enemies
4. Friends
5. Frenemies
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
Source A
Source B
Sink X
Sink Y
Connector A
REST / SOAP
Connector X
JMS
ETL / ESB
Product
XYZ
Dream
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
Passive Server
Source A
Source B
Sink X
Sink Y
Connector A
REST / SOAP
Connector X
JMS
ETL / ESB
Active Server
Messaging System
A
(Real Time)
Messaging System
B
(Big Data)
Database
(Important Data)
In-Memory Data
Grid
(Cache)
API Gateway
Stream Processing
Engine
Another
integration tool
(because one tool cannot
integrate everything, buy
more…)
Reality
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
Gartner Magic Quadrant for iPaaS
2021
(Enterprise Integration Platform as
a Service)
iPaaS as Game Changer?
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
Business Digitalization Trends are Driving the Need to Process Events at a
whole new Scale, Speed and Efficiency
The World has Changed
Mobile Cloud Microservices Internet of Things Machine Learning
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
#NoMQ #NoESB #NoETL #NoiPaaS can handle this well!
• Tight coupling
• Limited scale
• Zoo of components
?
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
Agenda
1. Traditional Middleware
2. Data Streaming Platform
3. Enemies
4. Friends
5. Frenemies
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
Source A
Source B
Sink X
Sink Y
Connector A
Java
Connector X
REST
Data
Streaming
Platform
Hmm…
Yet another one of
those magic boxes
in the middle, huh?
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
Events
What is an event?
Events
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
Events
A Sale An Invoice A Trade A Customer
Experience
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
Haven’t we seen all
this before?
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
Databases
Messaging
ETL / Data Integration
Data Warehouse
Why can’t I do this with my
existing data platforms?
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
Enterprise Data Platform Requirements Are Shifting
1 3 4
2
Scalable for
Transactional Data
Transient Raw data
Built for
Historical Data
Built for Real-
Time Events
Scalable for
ALL data
Persistent +
Durable
Enriched
data
● Value: Trigger real-
time workflows (i.e.
real-time order
management)
● Value: Scale across
the enterprise (i.e.
customer 360)
● Value: Build
mission-critical
apps with zero data
loss (i.e. instant
payments)
● Value: Add context &
situational awareness
(i.e. ride sharing ETA)
26
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
Only Data Streaming Has All 4 Requirements
Messaging
Databases
Data Streaming
Data Warehouse
BUILT FOR REAL-
TIME EVENTS
SCALABLE
FOR ALL DATA
PERSISTENT &
DURABLE
CAPABLE OF
ENRICHMENT
27
Good for transactional applications
Good for ultra low-latency, fire-and-forget use cases
Good for batch data integration
Good for historical analytics and reporting
Platform for Event-Driven Transformation
(Scalable Messaging + Real-Time Data Integration + Stream Processing)
ETL/Data Integration
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
A Data Streaming Platform
is the Underpinning of an Event-driven Architecture
Microservices
DBs
SaaS apps
Mobile
Customer 360
Real-time fraud
detection
Data warehouse
Producers
Consumers
Database
change
Microservices
events
SaaS
data
Customer
experiences
Streams of real time events
Streaming Apps
Streaming Apps Streaming Apps
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
Data in Motion across the Public and Private Sector
Real-time data
without context!
Possible with
simple messaging
solutions.
Real-time data
with context!
What does the
ride cost?
How long does the
driver need?
Data is correlated
in real time.
https://www.confluent.io/events/kafka-summit-europe-2021/development-of-dynamic-pricing-for-tours-using-real-time-data-feeds/
kai-waehner.de - @KaiWaehner - Data in Motion in the Public Sector
Customer timetable
Operational
timetable
Assignments
Railway station
knowledge
Dispositions
Train positions
Matching
Aggregation
Consolidation
Apache
Kafka
Analysis
Railway station
Trains
Mobile Apps
Employees
Deutsche Bahn AG | Reisendeninformation
RI-Plattform
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
RI-Platform @ Deutsche Bahn
Traveler Information with Single Point of Truth
3rd Party Integration with Google Maps
Real-time train schedule updates
Reach new people and expand business
https://railway-news.com/db-partners-with-google-maps-on-journey-planning/
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
STREAM
PROCESSING
Create and store
materialized views
Filter
Analyze in-flight
Time
C C
C
Data Streaming
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
TRADITIONAL
DATABASE
EVENT STREAM
PROCESSING
SELECT * FROM
DB_TABLE
CREATE TABLE T
AS SELECT * FROM
EVENT_STREAM
Active Query: Passive Data:
DB Table
Active Data: Passive Query:
Event Stream
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
Producing to Kafka
P
Time
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
Consuming from Kafka
P
Time
C2
Near
Real Time
C3
Real Time
C1
Batch
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
Distributed System with Replication and High Availability
Broker 1
Topic1
partition1
Broker 2 Broker 3 Broker 4
Topic1
partition1
Topic1
partition1
Leader Follower
Topic1
partition2
Topic1
partition2
Topic1
partition2
Topic1
partition3
Topic1
partition4
Topic1
partition3
Topic1
partition3
Topic1
partition4
Topic1
partition4
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
Distributed System with Replication and High Availability
read,
write
App
(Kafka Streams)
Kafka
(data)
More Apps
(KSQL, Connect, Python,
REST, “You-name-it”)
Bookings
Team
Fraud
Team
…
Mobile
Team
…
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
Apache Kafka (kafka.apache.org) includes
Kafka Connect and Kafka Streams
Kafka Streams
Your app
Sink
Source
Kafka
Connect
Kafka
Connect
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
ksqlDB
Continuous queries
on infinite streams
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
Agenda
• Traditional Middleware
• Data Streaming Platform
• Enemies
• Friends
• Frenemies
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
Source A
Source B
Sink X
Sink Y
Connector A
REST
Connector X
MQ
Integration
Layer
Middleware: Message Queue… ETL… ESB… iPaaS
Data Streaming Platform: Apache Kafka. (and some niche players)
Spoilt for Choice!
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
Business Digitalization Trends are Driving the Need to Process Events at a
whole new Scale, Speed and Efficiency
Why do you need an Data Streaming Platform?
Remember:
Mobile Cloud Microservices Internet of Things Machine Learning
The World has Changed!
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
== de facto standard API for OBJECT STORAGE
The market has already decided for Data Streaming…
== de facto standard API for Data Streaming
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
Apache Kafka at Scale at Tech Giants
> 7 trillion messages / day > 6 Petabytes / day
“You name it”
* Kafka Is not just used by tech giants
** Kafka is not just used for big data
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
Data Streaming Platform - Value per Use Case
Improve Customer
Experience (CX)
Increase
Revenue
(make money)
Business
Value
Decrease
Costs
(save money)
Core Business
Platform
Increase
Operational
Efficiency
Migrate to
Cloud
Mitigate Risk
(protect money)
Key Drivers
Strategic Objectives
(sample)
Fraud
Detection
IoT sensor
ingestion
Digital replatforming/
Mainframe Offload
Connected Car: Navigation & improved in-car
experience: Audi
Customer 360 Simplifying Omni-channel Retail at Scale: Target
Faster transactional processing /
analysis
incl. Machine Learning / AI
Mainframe Offload: RBC
Microservices
Architecture
Online Fraud Detection
Online Security
(syslog, log aggregation, Splunk
replacement)
Middleware replacement
Regulatory
Digital Transformation
Application Modernization: Multiple Examples
Website / Core Operations
(Central Nervous System)
The [Silicon Valley] Digital Natives; LinkedIn,
Netflix, Uber, Yelp...
Predictive Maintenance: Audi
Streaming Platform in a regulated environment
(e.g. Electronic Medical Records): Celmatix
Real-time app updates
Real Time Streaming Platform for Communications and
Beyond: Capital One
Developer Velocity - Building Stateful Financial
Applications with Kafka Streams: Funding Circle
Detect Fraud & Prevent Fraud in Real Time:
PayPal
Kafka as a Service - A Tale of Security and Multi-
Tenancy: Apple
Example Use Cases
$↑
$↓
$↔
Example Case Studies
(of many)
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
Data Streaming in the Finance and Insurance Industries
Check past Kafka Summit videos for details about the use cases:
https://kafka-summit.org/past-events/
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
STREAM
PROCESSING
CONNECTORS
Example Architecture for Data in Motion
ksqlDB
KStreams
Real-time decision making for claim processing and fraud detection
Dashboard
Oracle
DB
Oracle
CDC
CONNECTOR
Salesforce CDC
CONNECTOR
Salesforce
Source / Sink
CONNECTOR
Fraud Detection App
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
Global Data Streaming
Aggregate Small Footprint
Edge Deployments with
Replication (Aggregation)
Simplify Disaster Recovery
Operations with
Multi-Region Clusters
with RPO=0 and RTO=0
Stream Data Globally with
Replication and Cluster Linking
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
Why Apache Kafka instead of Traditional Middleware?
Data Streaming Platform
• But also the core is event-based
• Supports real time stream processing
• Fire-and-Forget, Publish / Subscribe, Request-Response / RPC, Batch, …
Single infrastructure
• Messaging, storage, processing
• Scalability and throughput can be increased dynamically
Reliability and zero downtime
• High availability
• Exactly-once semantics
• Rolling upgrades and dynamic configuration changes
• Backwards compatibility
Decoupling of clients
• Agile microservices
• Dumb pipes, smart endpoints
• Handling backpressure
No vendor lock-in
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
Why Apache Kafka instead of traditional middleware?
”Eat your own dog food!”
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
Enemies!
ESB MQ
Storage
Streaming
Engine
Messaging: Kafka Core
Storage: Kafka Core
Caching: Kafka Core
Real-Time, Batch: Kafka Clients
Integration: Kafka Connect
Stream Processing: Kafka Streams / KSQL
Request-Response: REST Proxy
”Eat your own dog food”
vs.
Enemy 1
Enemy 2
Enemy 3
Enemy 4
…. More components, clusters, technologies means more conflicts, incompatibility, operations burden!
Enemy 5
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
ETL / ESB
Kafka Broker X
Source A
Source B
Sink X
Sink Y
Kafka Connect
Python
Kafka Connect
Java
Kafka
Broker 1
Schema Registry
REST Proxy
Kafka Streams / KSQL
Monitoring Tool “Yet another Kafka
addon”
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
Don’t use your “ESB knowledge” with Kafka!
https://www.thoughtworks.com/radar/techniques/recreating-
esb-antipatterns-with-kafka
!
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
Kafka Connect
Kafka Cluster
CRM Integration
Domain-Driven Design for your Integration Layer
Legacy Integration
Custom
Application
ESB Connector
Java / KSQL /
Kafka Streams
Schema Registry
Data Streaming Platform
CRM Domain Legacy Domain Payment Domain
è Independent and loosely coupled, but scalable, highly available and reliable!
Data Governance
Security
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
Kafka Decouples Storage and Compute
Kafka
Java Client
Kafka Cluster
Monolith Cloud DWH
Snowflake Connector
Storage
Compute Compute
(+ non-Kafka Storage)
KSQL
App
KSQL
App
KSQL
App
Compute
Compute Compute
Schema Registry
Data Governance
Security
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
Cloud-native Kafka
for Business Continuity and Elastic Scale
63
Confluent Cloud
A fully managed, cloud-native service for Apache Kafka
Confluent Platform
A complete, enterprise-grade distribution of Apache Kafka
Cloud-native
Confluent for
Kubernetes
Ansible
Playbooks
Packages:
Docker, RPMs,
Tarball
Public Cloud Workloads On-Premise and Edge Workloads
On Kubernetes On VMs / Bare Metal
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
You
Manage
Provider
Managed
Self-managed IaaS Hosted Cloud Service Fully Managed SaaS
Scaling Scaling Scaling
Load balancing Load balancing Load balancing
Partition placement Partition placement Partition placement
Logical Storage Logical Storage Logical Storage
Broker settings Broker settings Broker settings
Zookeeper Zookeeper Zookeeper
Kafka patching Kafka patching Kafka patching
JVM JVM JVM
O/S O/S O/S
VMs VMs VMs
Servers Servers Servers
Provider
managed
features
Product
ease of use
Confluent Cloud
Other Kafka
Services
Apache Kafka
What is a fully-managed SaaS?
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
Case Study: Advance Auto Parts
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
Legacy infrastructure and architecture did not meet real-
time performance requirements [Before]
CRM
WMS
MDM
HRM Data Lake Finance
Legacy ITSM
DC MOBILE/WEB
STORE
(PoS)
DC
STORE
(PoS)
Branch (PoS)
ECOMM Catalog
OMS
Inventory
ON PREMISES
Merchandising
(Legacy)
CCDB
CTDB
HJ1
HJ2
JDA
?
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
Future-proof data architecture for real-time invoicing and
dynamic pricing [After]
CRM
WMS
MDM
HRM Finance
Legacy ITSM
DC MOBILE/WEB
STORE (PoS) DC
STORE (PoS) BRANCH (PoS)
?
Revenue (5)
Location (2)
Pricing (1)
Catalog
Customer (6)
Inventory (4)
Employee (7) Orders (8)
Data Lake
ECOMM Catalog
OMS
Inventory
ON PREMISES
Merchandising
(Legacy)
Products (3)
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
Agenda
• Traditional Middleware
• Data Streaming Platform
• Enemies
• Friends
• Frenemies
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
Partnerships, not Competitors…
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
Friends!
• Kafka Connect source / sink connectors
(JMS, IBM MQ, RabbitMQ, etc.)
• JMS Client
(Kafka-native JMS Implementation)
• ESB or ETL tools
with their own Kafka source / sink connectors
• Kafka’s Client APIs
(like Java, .NET, Go, Python, JavaScript)
• REST Proxy
• Etc.
Plenty of integration options between Kafka and traditional middleware
Traditional
Middleware
Apache
Kafka
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
Why friends?
Kafka is NOT THE ALLROUNDER for every single problem!
Maybe you don’t need a scalable, reliable, distributed system, but “just”:
• Synchronous Web Service (SOAP / WS* or REST) integration between
two endpoints
• Integration with legacy components (Cobol, Edifact, …)
• Point-to-point messaging with active / passive HA for (“a few”) messages
or for XA transactions
• Very specific messaging solution for “less than millisecond performance”
• Managed file transfer
• API Management
• “Real” BATCH Processing (Hadoop, Flink, Informatica, …)
X
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
Legacy integration and visual coding
à This is where the ESB / ETL tool shines!
• Visual coding for complex
graphical mappings
• Integration components for
complex legacy standard
software and protocols
• SAP BAPI / iDoc, Cobol, Edifact,
SOAP / WS*, etc.
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
Confluent Stream Designer for Kafka Data Streams
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
Agenda
• Traditional Middleware
• Data Streaming Platform
• Enemies
• Friends
• Frenemies
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
Big Bang fails for critical 24/7 deployments
No!
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
Some technologies never die… Cough…
Can we ever get away from all
legacy applications?
Probably not!
Cobol
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
Kafka and API Management
in the Enterprise Architecture
Orders Customers
Payments
Stock
REST
JMS
ESB
REST
CRM
Mainframe
SOAP
…
Kafka
Kafka
Kafka
Kafka
SOAP
API Management
HTTP
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
Frenemies?
How to integrate
the old and new world?
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
Strangler Design Pattern
https://paulhammant.com/2013/07/14/legacy-application-strangulation-case-studies/
https://martinfowler.com/bliki/StranglerFigApplication.html
“The most important reason
to consider a strangler fig
application over a cut-over
rewrite is reduced risk.”
Martin Fowler
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
Year 0: Direct Communication between Mainframe and App
Application
1) Direct Legacy Mainframe Communication to App
Date Amount
1/27/2017 $4.56
1/22/2017 $32.14
Core Banking ‘1970’
(Mainframe)
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
Year 1: Kafka for Decoupling between Mainframe and App
Application
1) Direct Legacy Mainframe Communication to App
2) Kafka for Decoupling between Mainframe and App
Date Amount
1/27/2017 $4.56
1/22/2017 $32.14
Core Banking ‘1970’
(Mainframe)
Mainframe Integration
- Change Data Capture (IIDC)
- Kafka Connect (JMS, MQ, JDBC)
- REST Proxy
- Kafka Client
- 3rd Party CDC Tool
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
Year 2 to 4: New Projects and Applications
Application
Microservices
Agile, Lightweight
(but Scalable, Robust)
Applications
Big Data Project (Elastic,
Spark,
AWS Services, …)
1) Direct Legacy Mainframe Communication to App
2) Kafka for Decoupling between Mainframe and App
3) New Projects and Applications
External
Solution
Date Amount
1/27/2017 $4.56
1/22/2017 $32.14
Core Banking ‘1970’
(Mainframe)
Mainframe Integration
- Change Data Capture (IIDC)
- Kafka Connect (JMS, MQ, JDBC)
- REST Proxy
- Kafka Client
- 3rd Party CDC Tool
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
Year 5: Mainframe Replacement
Application
Microservices
Agile, Lightweight
(but Scalable, Robust)
Applications
Big Data Project (Elastic,
Spark,
AWS Services, …)
1) Direct Legacy Mainframe Communication to App
2) Kafka for Decoupling between Mainframe and App
3) New Projects and Applications
4) Mainframe Replacement
External
Solution
Core Banking ‘2020’
(Modern Technology)
Date Amount
1/27/2017 $4.56
1/22/2017 $32.14
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
Confluent JMS 2.0 Bridge
https://www.confluent.io/confluent-accelerators/#jms-bridge
Why Confluent
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
The Rise of Data in Motion
2010
Apache Kafka
created at LinkedIn by
Confluent founders
2014
2020
80%
Fortune 100
Companies
trust and use
Apache Kafka
97
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
I N V E S T M E N T & T I M E
V
A
L
U
E
3
4
5
1
2
Data Streaming Maturity Model
Initial Awareness /
Pilot (1 Kafka
Cluster)
Start to Build
Pipeline / Deliver 1
New Outcome
(1 Kafka Cluster)
Mission-Critical
Deployment
(Stretched, Hybrid,
Multi-Region)
Build Contextual
Event-Driven Apps
(Stretched, Hybrid,
Multi-Region)
Central Nervous
System
(Global Kafka)
Product, Support, Training, Partners, Technical Account Management...
98
Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de
Car Engine Car Self-driving Car
Confluent completes Apache Kafka. Cloud-native. Everywhere.
Kai Waehner
Field CTO
kai.waehner@confluent.io
@KaiWaehner
kai-waehner.de
confluent.io
linkedin.com/in/kaiwaehner
Questions?
Feedback?
Let’s connect!

Más contenido relacionado

La actualidad más candente

Apache Kafka in the Insurance Industry
Apache Kafka in the Insurance IndustryApache Kafka in the Insurance Industry
Apache Kafka in the Insurance IndustryKai Wähner
 
Serverless Kafka and Spark in a Multi-Cloud Lakehouse Architecture
Serverless Kafka and Spark in a Multi-Cloud Lakehouse ArchitectureServerless Kafka and Spark in a Multi-Cloud Lakehouse Architecture
Serverless Kafka and Spark in a Multi-Cloud Lakehouse ArchitectureKai Wähner
 
Mainframe Integration, Offloading and Replacement with Apache Kafka
Mainframe Integration, Offloading and Replacement with Apache KafkaMainframe Integration, Offloading and Replacement with Apache Kafka
Mainframe Integration, Offloading and Replacement with Apache KafkaKai Wähner
 
Top 5 Event Streaming Use Cases for 2021 with Apache Kafka
Top 5 Event Streaming Use Cases for 2021 with Apache KafkaTop 5 Event Streaming Use Cases for 2021 with Apache Kafka
Top 5 Event Streaming Use Cases for 2021 with Apache KafkaKai Wähner
 
Introducing Confluent Cloud: Apache Kafka as a Service
Introducing Confluent Cloud: Apache Kafka as a Service Introducing Confluent Cloud: Apache Kafka as a Service
Introducing Confluent Cloud: Apache Kafka as a Service confluent
 
Apache Kafka in the Airline, Aviation and Travel Industry
Apache Kafka in the Airline, Aviation and Travel IndustryApache Kafka in the Airline, Aviation and Travel Industry
Apache Kafka in the Airline, Aviation and Travel IndustryKai Wähner
 
Kafka for Real-Time Replication between Edge and Hybrid Cloud
Kafka for Real-Time Replication between Edge and Hybrid CloudKafka for Real-Time Replication between Edge and Hybrid Cloud
Kafka for Real-Time Replication between Edge and Hybrid CloudKai Wähner
 
Kafka Tutorial - introduction to the Kafka streaming platform
Kafka Tutorial - introduction to the Kafka streaming platformKafka Tutorial - introduction to the Kafka streaming platform
Kafka Tutorial - introduction to the Kafka streaming platformJean-Paul Azar
 
Apache Kafka vs. Integration Middleware (MQ, ETL, ESB) - Friends, Enemies or ...
Apache Kafka vs. Integration Middleware (MQ, ETL, ESB) - Friends, Enemies or ...Apache Kafka vs. Integration Middleware (MQ, ETL, ESB) - Friends, Enemies or ...
Apache Kafka vs. Integration Middleware (MQ, ETL, ESB) - Friends, Enemies or ...confluent
 
Apache Kafka in Financial Services - Use Cases and Architectures
Apache Kafka in Financial Services - Use Cases and ArchitecturesApache Kafka in Financial Services - Use Cases and Architectures
Apache Kafka in Financial Services - Use Cases and ArchitecturesKai Wähner
 
Event Mesh: The architecture layer that will power your digital transformation
Event Mesh: The architecture layer that will power your digital transformationEvent Mesh: The architecture layer that will power your digital transformation
Event Mesh: The architecture layer that will power your digital transformationSAP Cloud Platform
 
Apache Kafka in the Public Sector (Government, National Security, Citizen Ser...
Apache Kafka in the Public Sector (Government, National Security, Citizen Ser...Apache Kafka in the Public Sector (Government, National Security, Citizen Ser...
Apache Kafka in the Public Sector (Government, National Security, Citizen Ser...Kai Wähner
 
ksqlDB: A Stream-Relational Database System
ksqlDB: A Stream-Relational Database SystemksqlDB: A Stream-Relational Database System
ksqlDB: A Stream-Relational Database Systemconfluent
 
Stream processing using Kafka
Stream processing using KafkaStream processing using Kafka
Stream processing using KafkaKnoldus Inc.
 
Data Warehouse vs. Data Lake vs. Data Streaming – Friends, Enemies, Frenemies?
Data Warehouse vs. Data Lake vs. Data Streaming – Friends, Enemies, Frenemies?Data Warehouse vs. Data Lake vs. Data Streaming – Friends, Enemies, Frenemies?
Data Warehouse vs. Data Lake vs. Data Streaming – Friends, Enemies, Frenemies?Kai Wähner
 
Dynamically Scaling Data Streams across Multiple Kafka Clusters with Zero Fli...
Dynamically Scaling Data Streams across Multiple Kafka Clusters with Zero Fli...Dynamically Scaling Data Streams across Multiple Kafka Clusters with Zero Fli...
Dynamically Scaling Data Streams across Multiple Kafka Clusters with Zero Fli...Flink Forward
 
Squirreling Away $640 Billion: How Stripe Leverages Flink for Change Data Cap...
Squirreling Away $640 Billion: How Stripe Leverages Flink for Change Data Cap...Squirreling Away $640 Billion: How Stripe Leverages Flink for Change Data Cap...
Squirreling Away $640 Billion: How Stripe Leverages Flink for Change Data Cap...Flink Forward
 
Streaming all over the world Real life use cases with Kafka Streams
Streaming all over the world  Real life use cases with Kafka StreamsStreaming all over the world  Real life use cases with Kafka Streams
Streaming all over the world Real life use cases with Kafka Streamsconfluent
 
Top use cases for 2022 with Data in Motion and Apache Kafka
Top use cases for 2022 with Data in Motion and Apache KafkaTop use cases for 2022 with Data in Motion and Apache Kafka
Top use cases for 2022 with Data in Motion and Apache Kafkaconfluent
 
Can Apache Kafka Replace a Database?
Can Apache Kafka Replace a Database?Can Apache Kafka Replace a Database?
Can Apache Kafka Replace a Database?Kai Wähner
 

La actualidad más candente (20)

Apache Kafka in the Insurance Industry
Apache Kafka in the Insurance IndustryApache Kafka in the Insurance Industry
Apache Kafka in the Insurance Industry
 
Serverless Kafka and Spark in a Multi-Cloud Lakehouse Architecture
Serverless Kafka and Spark in a Multi-Cloud Lakehouse ArchitectureServerless Kafka and Spark in a Multi-Cloud Lakehouse Architecture
Serverless Kafka and Spark in a Multi-Cloud Lakehouse Architecture
 
Mainframe Integration, Offloading and Replacement with Apache Kafka
Mainframe Integration, Offloading and Replacement with Apache KafkaMainframe Integration, Offloading and Replacement with Apache Kafka
Mainframe Integration, Offloading and Replacement with Apache Kafka
 
Top 5 Event Streaming Use Cases for 2021 with Apache Kafka
Top 5 Event Streaming Use Cases for 2021 with Apache KafkaTop 5 Event Streaming Use Cases for 2021 with Apache Kafka
Top 5 Event Streaming Use Cases for 2021 with Apache Kafka
 
Introducing Confluent Cloud: Apache Kafka as a Service
Introducing Confluent Cloud: Apache Kafka as a Service Introducing Confluent Cloud: Apache Kafka as a Service
Introducing Confluent Cloud: Apache Kafka as a Service
 
Apache Kafka in the Airline, Aviation and Travel Industry
Apache Kafka in the Airline, Aviation and Travel IndustryApache Kafka in the Airline, Aviation and Travel Industry
Apache Kafka in the Airline, Aviation and Travel Industry
 
Kafka for Real-Time Replication between Edge and Hybrid Cloud
Kafka for Real-Time Replication between Edge and Hybrid CloudKafka for Real-Time Replication between Edge and Hybrid Cloud
Kafka for Real-Time Replication between Edge and Hybrid Cloud
 
Kafka Tutorial - introduction to the Kafka streaming platform
Kafka Tutorial - introduction to the Kafka streaming platformKafka Tutorial - introduction to the Kafka streaming platform
Kafka Tutorial - introduction to the Kafka streaming platform
 
Apache Kafka vs. Integration Middleware (MQ, ETL, ESB) - Friends, Enemies or ...
Apache Kafka vs. Integration Middleware (MQ, ETL, ESB) - Friends, Enemies or ...Apache Kafka vs. Integration Middleware (MQ, ETL, ESB) - Friends, Enemies or ...
Apache Kafka vs. Integration Middleware (MQ, ETL, ESB) - Friends, Enemies or ...
 
Apache Kafka in Financial Services - Use Cases and Architectures
Apache Kafka in Financial Services - Use Cases and ArchitecturesApache Kafka in Financial Services - Use Cases and Architectures
Apache Kafka in Financial Services - Use Cases and Architectures
 
Event Mesh: The architecture layer that will power your digital transformation
Event Mesh: The architecture layer that will power your digital transformationEvent Mesh: The architecture layer that will power your digital transformation
Event Mesh: The architecture layer that will power your digital transformation
 
Apache Kafka in the Public Sector (Government, National Security, Citizen Ser...
Apache Kafka in the Public Sector (Government, National Security, Citizen Ser...Apache Kafka in the Public Sector (Government, National Security, Citizen Ser...
Apache Kafka in the Public Sector (Government, National Security, Citizen Ser...
 
ksqlDB: A Stream-Relational Database System
ksqlDB: A Stream-Relational Database SystemksqlDB: A Stream-Relational Database System
ksqlDB: A Stream-Relational Database System
 
Stream processing using Kafka
Stream processing using KafkaStream processing using Kafka
Stream processing using Kafka
 
Data Warehouse vs. Data Lake vs. Data Streaming – Friends, Enemies, Frenemies?
Data Warehouse vs. Data Lake vs. Data Streaming – Friends, Enemies, Frenemies?Data Warehouse vs. Data Lake vs. Data Streaming – Friends, Enemies, Frenemies?
Data Warehouse vs. Data Lake vs. Data Streaming – Friends, Enemies, Frenemies?
 
Dynamically Scaling Data Streams across Multiple Kafka Clusters with Zero Fli...
Dynamically Scaling Data Streams across Multiple Kafka Clusters with Zero Fli...Dynamically Scaling Data Streams across Multiple Kafka Clusters with Zero Fli...
Dynamically Scaling Data Streams across Multiple Kafka Clusters with Zero Fli...
 
Squirreling Away $640 Billion: How Stripe Leverages Flink for Change Data Cap...
Squirreling Away $640 Billion: How Stripe Leverages Flink for Change Data Cap...Squirreling Away $640 Billion: How Stripe Leverages Flink for Change Data Cap...
Squirreling Away $640 Billion: How Stripe Leverages Flink for Change Data Cap...
 
Streaming all over the world Real life use cases with Kafka Streams
Streaming all over the world  Real life use cases with Kafka StreamsStreaming all over the world  Real life use cases with Kafka Streams
Streaming all over the world Real life use cases with Kafka Streams
 
Top use cases for 2022 with Data in Motion and Apache Kafka
Top use cases for 2022 with Data in Motion and Apache KafkaTop use cases for 2022 with Data in Motion and Apache Kafka
Top use cases for 2022 with Data in Motion and Apache Kafka
 
Can Apache Kafka Replace a Database?
Can Apache Kafka Replace a Database?Can Apache Kafka Replace a Database?
Can Apache Kafka Replace a Database?
 

Similar a Apache Kafka vs. Cloud-native iPaaS Integration Platform Middleware

Can Apache Kafka Replace a Database? – The 2021 Update | Kai Waehner, Confluent
Can Apache Kafka Replace a Database? – The 2021 Update | Kai Waehner, ConfluentCan Apache Kafka Replace a Database? – The 2021 Update | Kai Waehner, Confluent
Can Apache Kafka Replace a Database? – The 2021 Update | Kai Waehner, ConfluentHostedbyConfluent
 
Apache Kafka and API Management / API Gateway – Friends, Enemies or Frenemies...
Apache Kafka and API Management / API Gateway – Friends, Enemies or Frenemies...Apache Kafka and API Management / API Gateway – Friends, Enemies or Frenemies...
Apache Kafka and API Management / API Gateway – Friends, Enemies or Frenemies...HostedbyConfluent
 
Supply Chain Optimization with Apache Kafka
Supply Chain Optimization with Apache KafkaSupply Chain Optimization with Apache Kafka
Supply Chain Optimization with Apache KafkaKai Wähner
 
Apache Kafka vs. Traditional Middleware (Kai Waehner, Confluent) Frankfurt 20...
Apache Kafka vs. Traditional Middleware (Kai Waehner, Confluent) Frankfurt 20...Apache Kafka vs. Traditional Middleware (Kai Waehner, Confluent) Frankfurt 20...
Apache Kafka vs. Traditional Middleware (Kai Waehner, Confluent) Frankfurt 20...confluent
 
Apache Kafka vs. Integration Middleware (MQ, ETL, ESB)
Apache Kafka vs. Integration Middleware (MQ, ETL, ESB)Apache Kafka vs. Integration Middleware (MQ, ETL, ESB)
Apache Kafka vs. Integration Middleware (MQ, ETL, ESB)Kai Wähner
 
Connected Vehicles and V2X with Apache Kafka
Connected Vehicles and V2X with Apache KafkaConnected Vehicles and V2X with Apache Kafka
Connected Vehicles and V2X with Apache KafkaKai Wähner
 
Mainframe Integration, Offloading and Replacement with Apache Kafka | Kai Wae...
Mainframe Integration, Offloading and Replacement with Apache Kafka | Kai Wae...Mainframe Integration, Offloading and Replacement with Apache Kafka | Kai Wae...
Mainframe Integration, Offloading and Replacement with Apache Kafka | Kai Wae...HostedbyConfluent
 
Kappa vs Lambda Architectures and Technology Comparison
Kappa vs Lambda Architectures and Technology ComparisonKappa vs Lambda Architectures and Technology Comparison
Kappa vs Lambda Architectures and Technology ComparisonKai Wähner
 
Apache kafka-a distributed streaming platform
Apache kafka-a distributed streaming platformApache kafka-a distributed streaming platform
Apache kafka-a distributed streaming platformconfluent
 
Apache Kafka - A Distributed Streaming Platform
Apache Kafka - A Distributed Streaming PlatformApache Kafka - A Distributed Streaming Platform
Apache Kafka - A Distributed Streaming PlatformPaolo Castagna
 
Streaming Machine Learning with Python, Jupyter, TensorFlow, Apache Kafka and...
Streaming Machine Learning with Python, Jupyter, TensorFlow, Apache Kafka and...Streaming Machine Learning with Python, Jupyter, TensorFlow, Apache Kafka and...
Streaming Machine Learning with Python, Jupyter, TensorFlow, Apache Kafka and...Kai Wähner
 
How to Leverage the Apache Kafka Ecosystem to Productionize Machine Learning ...
How to Leverage the Apache Kafka Ecosystem to Productionize Machine Learning ...How to Leverage the Apache Kafka Ecosystem to Productionize Machine Learning ...
How to Leverage the Apache Kafka Ecosystem to Productionize Machine Learning ...Codemotion
 
When NOT to Use Apache Kafka? With Kai Waehner | Current 2022
When NOT to Use Apache Kafka? With Kai Waehner | Current 2022When NOT to Use Apache Kafka? With Kai Waehner | Current 2022
When NOT to Use Apache Kafka? With Kai Waehner | Current 2022HostedbyConfluent
 
Confluent Kafka and KSQL: Streaming Data Pipelines Made Easy
Confluent Kafka and KSQL: Streaming Data Pipelines Made EasyConfluent Kafka and KSQL: Streaming Data Pipelines Made Easy
Confluent Kafka and KSQL: Streaming Data Pipelines Made EasyKairo Tavares
 
BBL KAPPA Lesfurets.com
BBL KAPPA Lesfurets.comBBL KAPPA Lesfurets.com
BBL KAPPA Lesfurets.comCedric Vidal
 
Service Mesh with Apache Kafka, Kubernetes, Envoy, Istio and Linkerd
Service Mesh with Apache Kafka, Kubernetes, Envoy, Istio and LinkerdService Mesh with Apache Kafka, Kubernetes, Envoy, Istio and Linkerd
Service Mesh with Apache Kafka, Kubernetes, Envoy, Istio and LinkerdKai Wähner
 
IoT and Event Streaming at Scale with Apache Kafka
IoT and Event Streaming at Scale with Apache KafkaIoT and Event Streaming at Scale with Apache Kafka
IoT and Event Streaming at Scale with Apache Kafkaconfluent
 
Deep Learning at Extreme Scale (in the Cloud) 
with the Apache Kafka Open Sou...
Deep Learning at Extreme Scale (in the Cloud) 
with the Apache Kafka Open Sou...Deep Learning at Extreme Scale (in the Cloud) 
with the Apache Kafka Open Sou...
Deep Learning at Extreme Scale (in the Cloud) 
with the Apache Kafka Open Sou...Kai Wähner
 
IoT Architectures for Apache Kafka and Event Streaming - Industry 4.0, Digita...
IoT Architectures for Apache Kafka and Event Streaming - Industry 4.0, Digita...IoT Architectures for Apache Kafka and Event Streaming - Industry 4.0, Digita...
IoT Architectures for Apache Kafka and Event Streaming - Industry 4.0, Digita...Kai Wähner
 
Unleashing Apache Kafka and TensorFlow in Hybrid Cloud Architectures
Unleashing Apache Kafka and TensorFlow in Hybrid Cloud ArchitecturesUnleashing Apache Kafka and TensorFlow in Hybrid Cloud Architectures
Unleashing Apache Kafka and TensorFlow in Hybrid Cloud ArchitecturesKai Wähner
 

Similar a Apache Kafka vs. Cloud-native iPaaS Integration Platform Middleware (20)

Can Apache Kafka Replace a Database? – The 2021 Update | Kai Waehner, Confluent
Can Apache Kafka Replace a Database? – The 2021 Update | Kai Waehner, ConfluentCan Apache Kafka Replace a Database? – The 2021 Update | Kai Waehner, Confluent
Can Apache Kafka Replace a Database? – The 2021 Update | Kai Waehner, Confluent
 
Apache Kafka and API Management / API Gateway – Friends, Enemies or Frenemies...
Apache Kafka and API Management / API Gateway – Friends, Enemies or Frenemies...Apache Kafka and API Management / API Gateway – Friends, Enemies or Frenemies...
Apache Kafka and API Management / API Gateway – Friends, Enemies or Frenemies...
 
Supply Chain Optimization with Apache Kafka
Supply Chain Optimization with Apache KafkaSupply Chain Optimization with Apache Kafka
Supply Chain Optimization with Apache Kafka
 
Apache Kafka vs. Traditional Middleware (Kai Waehner, Confluent) Frankfurt 20...
Apache Kafka vs. Traditional Middleware (Kai Waehner, Confluent) Frankfurt 20...Apache Kafka vs. Traditional Middleware (Kai Waehner, Confluent) Frankfurt 20...
Apache Kafka vs. Traditional Middleware (Kai Waehner, Confluent) Frankfurt 20...
 
Apache Kafka vs. Integration Middleware (MQ, ETL, ESB)
Apache Kafka vs. Integration Middleware (MQ, ETL, ESB)Apache Kafka vs. Integration Middleware (MQ, ETL, ESB)
Apache Kafka vs. Integration Middleware (MQ, ETL, ESB)
 
Connected Vehicles and V2X with Apache Kafka
Connected Vehicles and V2X with Apache KafkaConnected Vehicles and V2X with Apache Kafka
Connected Vehicles and V2X with Apache Kafka
 
Mainframe Integration, Offloading and Replacement with Apache Kafka | Kai Wae...
Mainframe Integration, Offloading and Replacement with Apache Kafka | Kai Wae...Mainframe Integration, Offloading and Replacement with Apache Kafka | Kai Wae...
Mainframe Integration, Offloading and Replacement with Apache Kafka | Kai Wae...
 
Kappa vs Lambda Architectures and Technology Comparison
Kappa vs Lambda Architectures and Technology ComparisonKappa vs Lambda Architectures and Technology Comparison
Kappa vs Lambda Architectures and Technology Comparison
 
Apache kafka-a distributed streaming platform
Apache kafka-a distributed streaming platformApache kafka-a distributed streaming platform
Apache kafka-a distributed streaming platform
 
Apache Kafka - A Distributed Streaming Platform
Apache Kafka - A Distributed Streaming PlatformApache Kafka - A Distributed Streaming Platform
Apache Kafka - A Distributed Streaming Platform
 
Streaming Machine Learning with Python, Jupyter, TensorFlow, Apache Kafka and...
Streaming Machine Learning with Python, Jupyter, TensorFlow, Apache Kafka and...Streaming Machine Learning with Python, Jupyter, TensorFlow, Apache Kafka and...
Streaming Machine Learning with Python, Jupyter, TensorFlow, Apache Kafka and...
 
How to Leverage the Apache Kafka Ecosystem to Productionize Machine Learning ...
How to Leverage the Apache Kafka Ecosystem to Productionize Machine Learning ...How to Leverage the Apache Kafka Ecosystem to Productionize Machine Learning ...
How to Leverage the Apache Kafka Ecosystem to Productionize Machine Learning ...
 
When NOT to Use Apache Kafka? With Kai Waehner | Current 2022
When NOT to Use Apache Kafka? With Kai Waehner | Current 2022When NOT to Use Apache Kafka? With Kai Waehner | Current 2022
When NOT to Use Apache Kafka? With Kai Waehner | Current 2022
 
Confluent Kafka and KSQL: Streaming Data Pipelines Made Easy
Confluent Kafka and KSQL: Streaming Data Pipelines Made EasyConfluent Kafka and KSQL: Streaming Data Pipelines Made Easy
Confluent Kafka and KSQL: Streaming Data Pipelines Made Easy
 
BBL KAPPA Lesfurets.com
BBL KAPPA Lesfurets.comBBL KAPPA Lesfurets.com
BBL KAPPA Lesfurets.com
 
Service Mesh with Apache Kafka, Kubernetes, Envoy, Istio and Linkerd
Service Mesh with Apache Kafka, Kubernetes, Envoy, Istio and LinkerdService Mesh with Apache Kafka, Kubernetes, Envoy, Istio and Linkerd
Service Mesh with Apache Kafka, Kubernetes, Envoy, Istio and Linkerd
 
IoT and Event Streaming at Scale with Apache Kafka
IoT and Event Streaming at Scale with Apache KafkaIoT and Event Streaming at Scale with Apache Kafka
IoT and Event Streaming at Scale with Apache Kafka
 
Deep Learning at Extreme Scale (in the Cloud) 
with the Apache Kafka Open Sou...
Deep Learning at Extreme Scale (in the Cloud) 
with the Apache Kafka Open Sou...Deep Learning at Extreme Scale (in the Cloud) 
with the Apache Kafka Open Sou...
Deep Learning at Extreme Scale (in the Cloud) 
with the Apache Kafka Open Sou...
 
IoT Architectures for Apache Kafka and Event Streaming - Industry 4.0, Digita...
IoT Architectures for Apache Kafka and Event Streaming - Industry 4.0, Digita...IoT Architectures for Apache Kafka and Event Streaming - Industry 4.0, Digita...
IoT Architectures for Apache Kafka and Event Streaming - Industry 4.0, Digita...
 
Unleashing Apache Kafka and TensorFlow in Hybrid Cloud Architectures
Unleashing Apache Kafka and TensorFlow in Hybrid Cloud ArchitecturesUnleashing Apache Kafka and TensorFlow in Hybrid Cloud Architectures
Unleashing Apache Kafka and TensorFlow in Hybrid Cloud Architectures
 

Más de Kai Wähner

Apache Kafka as Data Hub for Crypto, NFT, Metaverse (Beyond the Buzz!)
Apache Kafka as Data Hub for Crypto, NFT, Metaverse (Beyond the Buzz!)Apache Kafka as Data Hub for Crypto, NFT, Metaverse (Beyond the Buzz!)
Apache Kafka as Data Hub for Crypto, NFT, Metaverse (Beyond the Buzz!)Kai Wähner
 
Kafka for Live Commerce to Transform the Retail and Shopping Metaverse
Kafka for Live Commerce to Transform the Retail and Shopping MetaverseKafka for Live Commerce to Transform the Retail and Shopping Metaverse
Kafka for Live Commerce to Transform the Retail and Shopping MetaverseKai Wähner
 
Resilient Real-time Data Streaming across the Edge and Hybrid Cloud with Apac...
Resilient Real-time Data Streaming across the Edge and Hybrid Cloud with Apac...Resilient Real-time Data Streaming across the Edge and Hybrid Cloud with Apac...
Resilient Real-time Data Streaming across the Edge and Hybrid Cloud with Apac...Kai Wähner
 
Data Streaming with Apache Kafka in the Defence and Cybersecurity Industry
Data Streaming with Apache Kafka in the Defence and Cybersecurity IndustryData Streaming with Apache Kafka in the Defence and Cybersecurity Industry
Data Streaming with Apache Kafka in the Defence and Cybersecurity IndustryKai Wähner
 
Apache Kafka in the Healthcare Industry
Apache Kafka in the Healthcare IndustryApache Kafka in the Healthcare Industry
Apache Kafka in the Healthcare IndustryKai Wähner
 
Apache Kafka in the Healthcare Industry
Apache Kafka in the Healthcare IndustryApache Kafka in the Healthcare Industry
Apache Kafka in the Healthcare IndustryKai Wähner
 
Apache Kafka for Real-time Supply Chain in the Food and Retail Industry
Apache Kafka for Real-time Supply Chainin the Food and Retail IndustryApache Kafka for Real-time Supply Chainin the Food and Retail Industry
Apache Kafka for Real-time Supply Chain in the Food and Retail IndustryKai Wähner
 
Apache Kafka Landscape for Automotive and Manufacturing
Apache Kafka Landscape for Automotive and ManufacturingApache Kafka Landscape for Automotive and Manufacturing
Apache Kafka Landscape for Automotive and ManufacturingKai Wähner
 
Event Streaming CTO Roundtable for Cloud-native Kafka Architectures
Event Streaming CTO Roundtable for Cloud-native Kafka ArchitecturesEvent Streaming CTO Roundtable for Cloud-native Kafka Architectures
Event Streaming CTO Roundtable for Cloud-native Kafka ArchitecturesKai Wähner
 
Telco 4.0 - Payment and FinServ Integration for Data in Motion with 5G and Ap...
Telco 4.0 - Payment and FinServ Integration for Data in Motion with 5G and Ap...Telco 4.0 - Payment and FinServ Integration for Data in Motion with 5G and Ap...
Telco 4.0 - Payment and FinServ Integration for Data in Motion with 5G and Ap...Kai Wähner
 
Apache Kafka in the Transportation and Logistics
Apache Kafka in the Transportation and LogisticsApache Kafka in the Transportation and Logistics
Apache Kafka in the Transportation and LogisticsKai Wähner
 
Apache Kafka for Cybersecurity and SIEM / SOAR Modernization
Apache Kafka for Cybersecurity and SIEM / SOAR ModernizationApache Kafka for Cybersecurity and SIEM / SOAR Modernization
Apache Kafka for Cybersecurity and SIEM / SOAR ModernizationKai Wähner
 
Apache Kafka in the Automotive Industry (Connected Vehicles, Manufacturing 4....
Apache Kafka in the Automotive Industry (Connected Vehicles, Manufacturing 4....Apache Kafka in the Automotive Industry (Connected Vehicles, Manufacturing 4....
Apache Kafka in the Automotive Industry (Connected Vehicles, Manufacturing 4....Kai Wähner
 
Serverless Kafka on AWS as Part of a Cloud-native Data Lake Architecture
Serverless Kafka on AWS as Part of a Cloud-native Data Lake ArchitectureServerless Kafka on AWS as Part of a Cloud-native Data Lake Architecture
Serverless Kafka on AWS as Part of a Cloud-native Data Lake ArchitectureKai Wähner
 
IBM Cloud Pak for Integration with Confluent Platform powered by Apache Kafka
IBM Cloud Pak for Integration with Confluent Platform powered by Apache KafkaIBM Cloud Pak for Integration with Confluent Platform powered by Apache Kafka
IBM Cloud Pak for Integration with Confluent Platform powered by Apache KafkaKai Wähner
 
Apache Kafka and MQTT - Overview, Comparison, Use Cases, Architectures
Apache Kafka and MQTT - Overview, Comparison, Use Cases, ArchitecturesApache Kafka and MQTT - Overview, Comparison, Use Cases, Architectures
Apache Kafka and MQTT - Overview, Comparison, Use Cases, ArchitecturesKai Wähner
 
Apache Kafka for Automotive Industry, Mobility Services & Smart City
Apache Kafka for Automotive Industry, Mobility Services & Smart CityApache Kafka for Automotive Industry, Mobility Services & Smart City
Apache Kafka for Automotive Industry, Mobility Services & Smart CityKai Wähner
 

Más de Kai Wähner (17)

Apache Kafka as Data Hub for Crypto, NFT, Metaverse (Beyond the Buzz!)
Apache Kafka as Data Hub for Crypto, NFT, Metaverse (Beyond the Buzz!)Apache Kafka as Data Hub for Crypto, NFT, Metaverse (Beyond the Buzz!)
Apache Kafka as Data Hub for Crypto, NFT, Metaverse (Beyond the Buzz!)
 
Kafka for Live Commerce to Transform the Retail and Shopping Metaverse
Kafka for Live Commerce to Transform the Retail and Shopping MetaverseKafka for Live Commerce to Transform the Retail and Shopping Metaverse
Kafka for Live Commerce to Transform the Retail and Shopping Metaverse
 
Resilient Real-time Data Streaming across the Edge and Hybrid Cloud with Apac...
Resilient Real-time Data Streaming across the Edge and Hybrid Cloud with Apac...Resilient Real-time Data Streaming across the Edge and Hybrid Cloud with Apac...
Resilient Real-time Data Streaming across the Edge and Hybrid Cloud with Apac...
 
Data Streaming with Apache Kafka in the Defence and Cybersecurity Industry
Data Streaming with Apache Kafka in the Defence and Cybersecurity IndustryData Streaming with Apache Kafka in the Defence and Cybersecurity Industry
Data Streaming with Apache Kafka in the Defence and Cybersecurity Industry
 
Apache Kafka in the Healthcare Industry
Apache Kafka in the Healthcare IndustryApache Kafka in the Healthcare Industry
Apache Kafka in the Healthcare Industry
 
Apache Kafka in the Healthcare Industry
Apache Kafka in the Healthcare IndustryApache Kafka in the Healthcare Industry
Apache Kafka in the Healthcare Industry
 
Apache Kafka for Real-time Supply Chain in the Food and Retail Industry
Apache Kafka for Real-time Supply Chainin the Food and Retail IndustryApache Kafka for Real-time Supply Chainin the Food and Retail Industry
Apache Kafka for Real-time Supply Chain in the Food and Retail Industry
 
Apache Kafka Landscape for Automotive and Manufacturing
Apache Kafka Landscape for Automotive and ManufacturingApache Kafka Landscape for Automotive and Manufacturing
Apache Kafka Landscape for Automotive and Manufacturing
 
Event Streaming CTO Roundtable for Cloud-native Kafka Architectures
Event Streaming CTO Roundtable for Cloud-native Kafka ArchitecturesEvent Streaming CTO Roundtable for Cloud-native Kafka Architectures
Event Streaming CTO Roundtable for Cloud-native Kafka Architectures
 
Telco 4.0 - Payment and FinServ Integration for Data in Motion with 5G and Ap...
Telco 4.0 - Payment and FinServ Integration for Data in Motion with 5G and Ap...Telco 4.0 - Payment and FinServ Integration for Data in Motion with 5G and Ap...
Telco 4.0 - Payment and FinServ Integration for Data in Motion with 5G and Ap...
 
Apache Kafka in the Transportation and Logistics
Apache Kafka in the Transportation and LogisticsApache Kafka in the Transportation and Logistics
Apache Kafka in the Transportation and Logistics
 
Apache Kafka for Cybersecurity and SIEM / SOAR Modernization
Apache Kafka for Cybersecurity and SIEM / SOAR ModernizationApache Kafka for Cybersecurity and SIEM / SOAR Modernization
Apache Kafka for Cybersecurity and SIEM / SOAR Modernization
 
Apache Kafka in the Automotive Industry (Connected Vehicles, Manufacturing 4....
Apache Kafka in the Automotive Industry (Connected Vehicles, Manufacturing 4....Apache Kafka in the Automotive Industry (Connected Vehicles, Manufacturing 4....
Apache Kafka in the Automotive Industry (Connected Vehicles, Manufacturing 4....
 
Serverless Kafka on AWS as Part of a Cloud-native Data Lake Architecture
Serverless Kafka on AWS as Part of a Cloud-native Data Lake ArchitectureServerless Kafka on AWS as Part of a Cloud-native Data Lake Architecture
Serverless Kafka on AWS as Part of a Cloud-native Data Lake Architecture
 
IBM Cloud Pak for Integration with Confluent Platform powered by Apache Kafka
IBM Cloud Pak for Integration with Confluent Platform powered by Apache KafkaIBM Cloud Pak for Integration with Confluent Platform powered by Apache Kafka
IBM Cloud Pak for Integration with Confluent Platform powered by Apache Kafka
 
Apache Kafka and MQTT - Overview, Comparison, Use Cases, Architectures
Apache Kafka and MQTT - Overview, Comparison, Use Cases, ArchitecturesApache Kafka and MQTT - Overview, Comparison, Use Cases, Architectures
Apache Kafka and MQTT - Overview, Comparison, Use Cases, Architectures
 
Apache Kafka for Automotive Industry, Mobility Services & Smart City
Apache Kafka for Automotive Industry, Mobility Services & Smart CityApache Kafka for Automotive Industry, Mobility Services & Smart City
Apache Kafka for Automotive Industry, Mobility Services & Smart City
 

Último

How Does the Epitome of Spyware Differ from Other Malicious Software?
How Does the Epitome of Spyware Differ from Other Malicious Software?How Does the Epitome of Spyware Differ from Other Malicious Software?
How Does the Epitome of Spyware Differ from Other Malicious Software?AmeliaSmith90
 
20240319 Car Simulator Plan.pptx . Plan for a JavaScript Car Driving Simulator.
20240319 Car Simulator Plan.pptx . Plan for a JavaScript Car Driving Simulator.20240319 Car Simulator Plan.pptx . Plan for a JavaScript Car Driving Simulator.
20240319 Car Simulator Plan.pptx . Plan for a JavaScript Car Driving Simulator.Sharon Liu
 
Top Software Development Trends in 2024
Top Software Development Trends in  2024Top Software Development Trends in  2024
Top Software Development Trends in 2024Mind IT Systems
 
Kawika Technologies pvt ltd Software Development Company in Trivandrum
Kawika Technologies pvt ltd Software Development Company in TrivandrumKawika Technologies pvt ltd Software Development Company in Trivandrum
Kawika Technologies pvt ltd Software Development Company in TrivandrumKawika Technologies
 
Enterprise Document Management System - Qualityze Inc
Enterprise Document Management System - Qualityze IncEnterprise Document Management System - Qualityze Inc
Enterprise Document Management System - Qualityze Incrobinwilliams8624
 
Webinar_050417_LeClair12345666777889.ppt
Webinar_050417_LeClair12345666777889.pptWebinar_050417_LeClair12345666777889.ppt
Webinar_050417_LeClair12345666777889.pptkinjal48
 
Introduction-to-Software-Development-Outsourcing.pptx
Introduction-to-Software-Development-Outsourcing.pptxIntroduction-to-Software-Development-Outsourcing.pptx
Introduction-to-Software-Development-Outsourcing.pptxIntelliSource Technologies
 
Cybersecurity Challenges with Generative AI - for Good and Bad
Cybersecurity Challenges with Generative AI - for Good and BadCybersecurity Challenges with Generative AI - for Good and Bad
Cybersecurity Challenges with Generative AI - for Good and BadIvo Andreev
 
ARM Talk @ Rejekts - Will ARM be the new Mainstream in our Data Centers_.pdf
ARM Talk @ Rejekts - Will ARM be the new Mainstream in our Data Centers_.pdfARM Talk @ Rejekts - Will ARM be the new Mainstream in our Data Centers_.pdf
ARM Talk @ Rejekts - Will ARM be the new Mainstream in our Data Centers_.pdfTobias Schneck
 
Streamlining Your Application Builds with Cloud Native Buildpacks
Streamlining Your Application Builds  with Cloud Native BuildpacksStreamlining Your Application Builds  with Cloud Native Buildpacks
Streamlining Your Application Builds with Cloud Native BuildpacksVish Abrams
 
Fields in Java and Kotlin and what to expect.pptx
Fields in Java and Kotlin and what to expect.pptxFields in Java and Kotlin and what to expect.pptx
Fields in Java and Kotlin and what to expect.pptxJoão Esperancinha
 
IA Generativa y Grafos de Neo4j: RAG time
IA Generativa y Grafos de Neo4j: RAG timeIA Generativa y Grafos de Neo4j: RAG time
IA Generativa y Grafos de Neo4j: RAG timeNeo4j
 
OpenChain Webinar: Universal CVSS Calculator
OpenChain Webinar: Universal CVSS CalculatorOpenChain Webinar: Universal CVSS Calculator
OpenChain Webinar: Universal CVSS CalculatorShane Coughlan
 
Transforming PMO Success with AI - Discover OnePlan Strategic Portfolio Work ...
Transforming PMO Success with AI - Discover OnePlan Strategic Portfolio Work ...Transforming PMO Success with AI - Discover OnePlan Strategic Portfolio Work ...
Transforming PMO Success with AI - Discover OnePlan Strategic Portfolio Work ...OnePlan Solutions
 
eAuditor Audits & Inspections - conduct field inspections
eAuditor Audits & Inspections - conduct field inspectionseAuditor Audits & Inspections - conduct field inspections
eAuditor Audits & Inspections - conduct field inspectionsNirav Modi
 
Leveraging DxSherpa's Generative AI Services to Unlock Human-Machine Harmony
Leveraging DxSherpa's Generative AI Services to Unlock Human-Machine HarmonyLeveraging DxSherpa's Generative AI Services to Unlock Human-Machine Harmony
Leveraging DxSherpa's Generative AI Services to Unlock Human-Machine Harmonyelliciumsolutionspun
 
JS-Experts - Cybersecurity for Generative AI
JS-Experts - Cybersecurity for Generative AIJS-Experts - Cybersecurity for Generative AI
JS-Experts - Cybersecurity for Generative AIIvo Andreev
 
Watermarking in Source Code: Applications and Security Challenges
Watermarking in Source Code: Applications and Security ChallengesWatermarking in Source Code: Applications and Security Challenges
Watermarking in Source Code: Applications and Security ChallengesShyamsundar Das
 
Optimizing Business Potential: A Guide to Outsourcing Engineering Services in...
Optimizing Business Potential: A Guide to Outsourcing Engineering Services in...Optimizing Business Potential: A Guide to Outsourcing Engineering Services in...
Optimizing Business Potential: A Guide to Outsourcing Engineering Services in...Jaydeep Chhasatia
 

Último (20)

How Does the Epitome of Spyware Differ from Other Malicious Software?
How Does the Epitome of Spyware Differ from Other Malicious Software?How Does the Epitome of Spyware Differ from Other Malicious Software?
How Does the Epitome of Spyware Differ from Other Malicious Software?
 
20240319 Car Simulator Plan.pptx . Plan for a JavaScript Car Driving Simulator.
20240319 Car Simulator Plan.pptx . Plan for a JavaScript Car Driving Simulator.20240319 Car Simulator Plan.pptx . Plan for a JavaScript Car Driving Simulator.
20240319 Car Simulator Plan.pptx . Plan for a JavaScript Car Driving Simulator.
 
Top Software Development Trends in 2024
Top Software Development Trends in  2024Top Software Development Trends in  2024
Top Software Development Trends in 2024
 
Kawika Technologies pvt ltd Software Development Company in Trivandrum
Kawika Technologies pvt ltd Software Development Company in TrivandrumKawika Technologies pvt ltd Software Development Company in Trivandrum
Kawika Technologies pvt ltd Software Development Company in Trivandrum
 
Enterprise Document Management System - Qualityze Inc
Enterprise Document Management System - Qualityze IncEnterprise Document Management System - Qualityze Inc
Enterprise Document Management System - Qualityze Inc
 
Webinar_050417_LeClair12345666777889.ppt
Webinar_050417_LeClair12345666777889.pptWebinar_050417_LeClair12345666777889.ppt
Webinar_050417_LeClair12345666777889.ppt
 
Introduction-to-Software-Development-Outsourcing.pptx
Introduction-to-Software-Development-Outsourcing.pptxIntroduction-to-Software-Development-Outsourcing.pptx
Introduction-to-Software-Development-Outsourcing.pptx
 
Cybersecurity Challenges with Generative AI - for Good and Bad
Cybersecurity Challenges with Generative AI - for Good and BadCybersecurity Challenges with Generative AI - for Good and Bad
Cybersecurity Challenges with Generative AI - for Good and Bad
 
Salesforce AI Associate Certification.pptx
Salesforce AI Associate Certification.pptxSalesforce AI Associate Certification.pptx
Salesforce AI Associate Certification.pptx
 
ARM Talk @ Rejekts - Will ARM be the new Mainstream in our Data Centers_.pdf
ARM Talk @ Rejekts - Will ARM be the new Mainstream in our Data Centers_.pdfARM Talk @ Rejekts - Will ARM be the new Mainstream in our Data Centers_.pdf
ARM Talk @ Rejekts - Will ARM be the new Mainstream in our Data Centers_.pdf
 
Streamlining Your Application Builds with Cloud Native Buildpacks
Streamlining Your Application Builds  with Cloud Native BuildpacksStreamlining Your Application Builds  with Cloud Native Buildpacks
Streamlining Your Application Builds with Cloud Native Buildpacks
 
Fields in Java and Kotlin and what to expect.pptx
Fields in Java and Kotlin and what to expect.pptxFields in Java and Kotlin and what to expect.pptx
Fields in Java and Kotlin and what to expect.pptx
 
IA Generativa y Grafos de Neo4j: RAG time
IA Generativa y Grafos de Neo4j: RAG timeIA Generativa y Grafos de Neo4j: RAG time
IA Generativa y Grafos de Neo4j: RAG time
 
OpenChain Webinar: Universal CVSS Calculator
OpenChain Webinar: Universal CVSS CalculatorOpenChain Webinar: Universal CVSS Calculator
OpenChain Webinar: Universal CVSS Calculator
 
Transforming PMO Success with AI - Discover OnePlan Strategic Portfolio Work ...
Transforming PMO Success with AI - Discover OnePlan Strategic Portfolio Work ...Transforming PMO Success with AI - Discover OnePlan Strategic Portfolio Work ...
Transforming PMO Success with AI - Discover OnePlan Strategic Portfolio Work ...
 
eAuditor Audits & Inspections - conduct field inspections
eAuditor Audits & Inspections - conduct field inspectionseAuditor Audits & Inspections - conduct field inspections
eAuditor Audits & Inspections - conduct field inspections
 
Leveraging DxSherpa's Generative AI Services to Unlock Human-Machine Harmony
Leveraging DxSherpa's Generative AI Services to Unlock Human-Machine HarmonyLeveraging DxSherpa's Generative AI Services to Unlock Human-Machine Harmony
Leveraging DxSherpa's Generative AI Services to Unlock Human-Machine Harmony
 
JS-Experts - Cybersecurity for Generative AI
JS-Experts - Cybersecurity for Generative AIJS-Experts - Cybersecurity for Generative AI
JS-Experts - Cybersecurity for Generative AI
 
Watermarking in Source Code: Applications and Security Challenges
Watermarking in Source Code: Applications and Security ChallengesWatermarking in Source Code: Applications and Security Challenges
Watermarking in Source Code: Applications and Security Challenges
 
Optimizing Business Potential: A Guide to Outsourcing Engineering Services in...
Optimizing Business Potential: A Guide to Outsourcing Engineering Services in...Optimizing Business Potential: A Guide to Outsourcing Engineering Services in...
Optimizing Business Potential: A Guide to Outsourcing Engineering Services in...
 

Apache Kafka vs. Cloud-native iPaaS Integration Platform Middleware

  • 1. Apache Kafka vs. Traditional Middleware (MQ, ETL, ESB, iPaaS) Friends, Enemies, or Frenemies? Kai Waehner Field CTO kai.waehner@confluent.io linkedin.com/in/kaiwaehner @KaiWaehner confluent.io kai-waehner.de
  • 2. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de Agreement: Kafka is the de facto standard for … • messaging at scale! • decoupling of microservices! • reliable, lightweight stream processing! • real-time backbone for data mesh Controversial discussion: Apache Kafka vs. Traditional Middleware Use Apache Kafka as middleware!
  • 3. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de Agenda 1. Traditional Middleware 2. Data Streaming Platform 3. Enemies 4. Friends 5. Frenemies
  • 4. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de Agenda 1. Traditional Middleware 2. Data Streaming Platform 3. Enemies 4. Friends 5. Frenemies
  • 5. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de Source A Source B Sink X Sink Y Connector A REST / SOAP Connector X JMS ETL / ESB Product XYZ Dream
  • 6. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de Passive Server Source A Source B Sink X Sink Y Connector A REST / SOAP Connector X JMS ETL / ESB Active Server Messaging System A (Real Time) Messaging System B (Big Data) Database (Important Data) In-Memory Data Grid (Cache) API Gateway Stream Processing Engine Another integration tool (because one tool cannot integrate everything, buy more…) Reality
  • 7. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de Gartner Magic Quadrant for iPaaS 2021 (Enterprise Integration Platform as a Service) iPaaS as Game Changer?
  • 8. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de Business Digitalization Trends are Driving the Need to Process Events at a whole new Scale, Speed and Efficiency The World has Changed Mobile Cloud Microservices Internet of Things Machine Learning
  • 9. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de #NoMQ #NoESB #NoETL #NoiPaaS can handle this well! • Tight coupling • Limited scale • Zoo of components ?
  • 10. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de Agenda 1. Traditional Middleware 2. Data Streaming Platform 3. Enemies 4. Friends 5. Frenemies
  • 11. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de Source A Source B Sink X Sink Y Connector A Java Connector X REST Data Streaming Platform Hmm… Yet another one of those magic boxes in the middle, huh?
  • 12. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de Events What is an event?
  • 14. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de Events A Sale An Invoice A Trade A Customer Experience
  • 15. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de Haven’t we seen all this before?
  • 16. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de Databases Messaging ETL / Data Integration Data Warehouse Why can’t I do this with my existing data platforms?
  • 17. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de Enterprise Data Platform Requirements Are Shifting 1 3 4 2 Scalable for Transactional Data Transient Raw data Built for Historical Data Built for Real- Time Events Scalable for ALL data Persistent + Durable Enriched data ● Value: Trigger real- time workflows (i.e. real-time order management) ● Value: Scale across the enterprise (i.e. customer 360) ● Value: Build mission-critical apps with zero data loss (i.e. instant payments) ● Value: Add context & situational awareness (i.e. ride sharing ETA) 26
  • 18. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de Only Data Streaming Has All 4 Requirements Messaging Databases Data Streaming Data Warehouse BUILT FOR REAL- TIME EVENTS SCALABLE FOR ALL DATA PERSISTENT & DURABLE CAPABLE OF ENRICHMENT 27 Good for transactional applications Good for ultra low-latency, fire-and-forget use cases Good for batch data integration Good for historical analytics and reporting Platform for Event-Driven Transformation (Scalable Messaging + Real-Time Data Integration + Stream Processing) ETL/Data Integration
  • 19. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de A Data Streaming Platform is the Underpinning of an Event-driven Architecture Microservices DBs SaaS apps Mobile Customer 360 Real-time fraud detection Data warehouse Producers Consumers Database change Microservices events SaaS data Customer experiences Streams of real time events Streaming Apps Streaming Apps Streaming Apps
  • 20. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de Data in Motion across the Public and Private Sector Real-time data without context! Possible with simple messaging solutions. Real-time data with context! What does the ride cost? How long does the driver need? Data is correlated in real time. https://www.confluent.io/events/kafka-summit-europe-2021/development-of-dynamic-pricing-for-tours-using-real-time-data-feeds/
  • 21. kai-waehner.de - @KaiWaehner - Data in Motion in the Public Sector Customer timetable Operational timetable Assignments Railway station knowledge Dispositions Train positions Matching Aggregation Consolidation Apache Kafka Analysis Railway station Trains Mobile Apps Employees Deutsche Bahn AG | Reisendeninformation RI-Plattform
  • 22. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de RI-Platform @ Deutsche Bahn Traveler Information with Single Point of Truth 3rd Party Integration with Google Maps Real-time train schedule updates Reach new people and expand business https://railway-news.com/db-partners-with-google-maps-on-journey-planning/
  • 23. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de STREAM PROCESSING Create and store materialized views Filter Analyze in-flight Time C C C Data Streaming
  • 24. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de TRADITIONAL DATABASE EVENT STREAM PROCESSING SELECT * FROM DB_TABLE CREATE TABLE T AS SELECT * FROM EVENT_STREAM Active Query: Passive Data: DB Table Active Data: Passive Query: Event Stream
  • 25. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de Producing to Kafka P Time
  • 26. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de Consuming from Kafka P Time C2 Near Real Time C3 Real Time C1 Batch
  • 27. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de Distributed System with Replication and High Availability Broker 1 Topic1 partition1 Broker 2 Broker 3 Broker 4 Topic1 partition1 Topic1 partition1 Leader Follower Topic1 partition2 Topic1 partition2 Topic1 partition2 Topic1 partition3 Topic1 partition4 Topic1 partition3 Topic1 partition3 Topic1 partition4 Topic1 partition4
  • 28. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de Distributed System with Replication and High Availability read, write App (Kafka Streams) Kafka (data) More Apps (KSQL, Connect, Python, REST, “You-name-it”) Bookings Team Fraud Team … Mobile Team …
  • 29. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de Apache Kafka (kafka.apache.org) includes Kafka Connect and Kafka Streams Kafka Streams Your app Sink Source Kafka Connect Kafka Connect
  • 30. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de ksqlDB Continuous queries on infinite streams
  • 31. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de Agenda • Traditional Middleware • Data Streaming Platform • Enemies • Friends • Frenemies
  • 32. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de Source A Source B Sink X Sink Y Connector A REST Connector X MQ Integration Layer Middleware: Message Queue… ETL… ESB… iPaaS Data Streaming Platform: Apache Kafka. (and some niche players) Spoilt for Choice!
  • 33. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de Business Digitalization Trends are Driving the Need to Process Events at a whole new Scale, Speed and Efficiency Why do you need an Data Streaming Platform? Remember: Mobile Cloud Microservices Internet of Things Machine Learning The World has Changed!
  • 34. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de == de facto standard API for OBJECT STORAGE The market has already decided for Data Streaming… == de facto standard API for Data Streaming
  • 35. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de Apache Kafka at Scale at Tech Giants > 7 trillion messages / day > 6 Petabytes / day “You name it” * Kafka Is not just used by tech giants ** Kafka is not just used for big data
  • 36. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de Data Streaming Platform - Value per Use Case Improve Customer Experience (CX) Increase Revenue (make money) Business Value Decrease Costs (save money) Core Business Platform Increase Operational Efficiency Migrate to Cloud Mitigate Risk (protect money) Key Drivers Strategic Objectives (sample) Fraud Detection IoT sensor ingestion Digital replatforming/ Mainframe Offload Connected Car: Navigation & improved in-car experience: Audi Customer 360 Simplifying Omni-channel Retail at Scale: Target Faster transactional processing / analysis incl. Machine Learning / AI Mainframe Offload: RBC Microservices Architecture Online Fraud Detection Online Security (syslog, log aggregation, Splunk replacement) Middleware replacement Regulatory Digital Transformation Application Modernization: Multiple Examples Website / Core Operations (Central Nervous System) The [Silicon Valley] Digital Natives; LinkedIn, Netflix, Uber, Yelp... Predictive Maintenance: Audi Streaming Platform in a regulated environment (e.g. Electronic Medical Records): Celmatix Real-time app updates Real Time Streaming Platform for Communications and Beyond: Capital One Developer Velocity - Building Stateful Financial Applications with Kafka Streams: Funding Circle Detect Fraud & Prevent Fraud in Real Time: PayPal Kafka as a Service - A Tale of Security and Multi- Tenancy: Apple Example Use Cases $↑ $↓ $↔ Example Case Studies (of many)
  • 37. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de Data Streaming in the Finance and Insurance Industries Check past Kafka Summit videos for details about the use cases: https://kafka-summit.org/past-events/
  • 38. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de STREAM PROCESSING CONNECTORS Example Architecture for Data in Motion ksqlDB KStreams Real-time decision making for claim processing and fraud detection Dashboard Oracle DB Oracle CDC CONNECTOR Salesforce CDC CONNECTOR Salesforce Source / Sink CONNECTOR Fraud Detection App
  • 39. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de Global Data Streaming Aggregate Small Footprint Edge Deployments with Replication (Aggregation) Simplify Disaster Recovery Operations with Multi-Region Clusters with RPO=0 and RTO=0 Stream Data Globally with Replication and Cluster Linking
  • 40. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de Why Apache Kafka instead of Traditional Middleware? Data Streaming Platform • But also the core is event-based • Supports real time stream processing • Fire-and-Forget, Publish / Subscribe, Request-Response / RPC, Batch, … Single infrastructure • Messaging, storage, processing • Scalability and throughput can be increased dynamically Reliability and zero downtime • High availability • Exactly-once semantics • Rolling upgrades and dynamic configuration changes • Backwards compatibility Decoupling of clients • Agile microservices • Dumb pipes, smart endpoints • Handling backpressure No vendor lock-in
  • 41. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de Why Apache Kafka instead of traditional middleware? ”Eat your own dog food!”
  • 42. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de Enemies! ESB MQ Storage Streaming Engine Messaging: Kafka Core Storage: Kafka Core Caching: Kafka Core Real-Time, Batch: Kafka Clients Integration: Kafka Connect Stream Processing: Kafka Streams / KSQL Request-Response: REST Proxy ”Eat your own dog food” vs. Enemy 1 Enemy 2 Enemy 3 Enemy 4 …. More components, clusters, technologies means more conflicts, incompatibility, operations burden! Enemy 5
  • 43. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de ETL / ESB Kafka Broker X Source A Source B Sink X Sink Y Kafka Connect Python Kafka Connect Java Kafka Broker 1 Schema Registry REST Proxy Kafka Streams / KSQL Monitoring Tool “Yet another Kafka addon”
  • 44. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de Don’t use your “ESB knowledge” with Kafka! https://www.thoughtworks.com/radar/techniques/recreating- esb-antipatterns-with-kafka !
  • 45. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de Kafka Connect Kafka Cluster CRM Integration Domain-Driven Design for your Integration Layer Legacy Integration Custom Application ESB Connector Java / KSQL / Kafka Streams Schema Registry Data Streaming Platform CRM Domain Legacy Domain Payment Domain è Independent and loosely coupled, but scalable, highly available and reliable! Data Governance Security
  • 46. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de Kafka Decouples Storage and Compute Kafka Java Client Kafka Cluster Monolith Cloud DWH Snowflake Connector Storage Compute Compute (+ non-Kafka Storage) KSQL App KSQL App KSQL App Compute Compute Compute Schema Registry Data Governance Security
  • 47. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de Cloud-native Kafka for Business Continuity and Elastic Scale 63 Confluent Cloud A fully managed, cloud-native service for Apache Kafka Confluent Platform A complete, enterprise-grade distribution of Apache Kafka Cloud-native Confluent for Kubernetes Ansible Playbooks Packages: Docker, RPMs, Tarball Public Cloud Workloads On-Premise and Edge Workloads On Kubernetes On VMs / Bare Metal
  • 48. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de You Manage Provider Managed Self-managed IaaS Hosted Cloud Service Fully Managed SaaS Scaling Scaling Scaling Load balancing Load balancing Load balancing Partition placement Partition placement Partition placement Logical Storage Logical Storage Logical Storage Broker settings Broker settings Broker settings Zookeeper Zookeeper Zookeeper Kafka patching Kafka patching Kafka patching JVM JVM JVM O/S O/S O/S VMs VMs VMs Servers Servers Servers Provider managed features Product ease of use Confluent Cloud Other Kafka Services Apache Kafka What is a fully-managed SaaS?
  • 49. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de Case Study: Advance Auto Parts
  • 50. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de Legacy infrastructure and architecture did not meet real- time performance requirements [Before] CRM WMS MDM HRM Data Lake Finance Legacy ITSM DC MOBILE/WEB STORE (PoS) DC STORE (PoS) Branch (PoS) ECOMM Catalog OMS Inventory ON PREMISES Merchandising (Legacy) CCDB CTDB HJ1 HJ2 JDA ?
  • 51. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de Future-proof data architecture for real-time invoicing and dynamic pricing [After] CRM WMS MDM HRM Finance Legacy ITSM DC MOBILE/WEB STORE (PoS) DC STORE (PoS) BRANCH (PoS) ? Revenue (5) Location (2) Pricing (1) Catalog Customer (6) Inventory (4) Employee (7) Orders (8) Data Lake ECOMM Catalog OMS Inventory ON PREMISES Merchandising (Legacy) Products (3)
  • 52. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de Agenda • Traditional Middleware • Data Streaming Platform • Enemies • Friends • Frenemies
  • 53. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de Partnerships, not Competitors…
  • 54. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de Friends! • Kafka Connect source / sink connectors (JMS, IBM MQ, RabbitMQ, etc.) • JMS Client (Kafka-native JMS Implementation) • ESB or ETL tools with their own Kafka source / sink connectors • Kafka’s Client APIs (like Java, .NET, Go, Python, JavaScript) • REST Proxy • Etc. Plenty of integration options between Kafka and traditional middleware Traditional Middleware Apache Kafka
  • 55. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de Why friends? Kafka is NOT THE ALLROUNDER for every single problem! Maybe you don’t need a scalable, reliable, distributed system, but “just”: • Synchronous Web Service (SOAP / WS* or REST) integration between two endpoints • Integration with legacy components (Cobol, Edifact, …) • Point-to-point messaging with active / passive HA for (“a few”) messages or for XA transactions • Very specific messaging solution for “less than millisecond performance” • Managed file transfer • API Management • “Real” BATCH Processing (Hadoop, Flink, Informatica, …) X
  • 56. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de Legacy integration and visual coding à This is where the ESB / ETL tool shines! • Visual coding for complex graphical mappings • Integration components for complex legacy standard software and protocols • SAP BAPI / iDoc, Cobol, Edifact, SOAP / WS*, etc.
  • 57. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de Confluent Stream Designer for Kafka Data Streams
  • 58. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de Agenda • Traditional Middleware • Data Streaming Platform • Enemies • Friends • Frenemies
  • 59. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de Big Bang fails for critical 24/7 deployments No!
  • 60. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de Some technologies never die… Cough… Can we ever get away from all legacy applications? Probably not! Cobol
  • 61. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de Kafka and API Management in the Enterprise Architecture Orders Customers Payments Stock REST JMS ESB REST CRM Mainframe SOAP … Kafka Kafka Kafka Kafka SOAP API Management HTTP
  • 62. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de Frenemies? How to integrate the old and new world?
  • 63. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de Strangler Design Pattern https://paulhammant.com/2013/07/14/legacy-application-strangulation-case-studies/ https://martinfowler.com/bliki/StranglerFigApplication.html “The most important reason to consider a strangler fig application over a cut-over rewrite is reduced risk.” Martin Fowler
  • 64. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de Year 0: Direct Communication between Mainframe and App Application 1) Direct Legacy Mainframe Communication to App Date Amount 1/27/2017 $4.56 1/22/2017 $32.14 Core Banking ‘1970’ (Mainframe)
  • 65. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de Year 1: Kafka for Decoupling between Mainframe and App Application 1) Direct Legacy Mainframe Communication to App 2) Kafka for Decoupling between Mainframe and App Date Amount 1/27/2017 $4.56 1/22/2017 $32.14 Core Banking ‘1970’ (Mainframe) Mainframe Integration - Change Data Capture (IIDC) - Kafka Connect (JMS, MQ, JDBC) - REST Proxy - Kafka Client - 3rd Party CDC Tool
  • 66. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de Year 2 to 4: New Projects and Applications Application Microservices Agile, Lightweight (but Scalable, Robust) Applications Big Data Project (Elastic, Spark, AWS Services, …) 1) Direct Legacy Mainframe Communication to App 2) Kafka for Decoupling between Mainframe and App 3) New Projects and Applications External Solution Date Amount 1/27/2017 $4.56 1/22/2017 $32.14 Core Banking ‘1970’ (Mainframe) Mainframe Integration - Change Data Capture (IIDC) - Kafka Connect (JMS, MQ, JDBC) - REST Proxy - Kafka Client - 3rd Party CDC Tool
  • 67. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de Year 5: Mainframe Replacement Application Microservices Agile, Lightweight (but Scalable, Robust) Applications Big Data Project (Elastic, Spark, AWS Services, …) 1) Direct Legacy Mainframe Communication to App 2) Kafka for Decoupling between Mainframe and App 3) New Projects and Applications 4) Mainframe Replacement External Solution Core Banking ‘2020’ (Modern Technology) Date Amount 1/27/2017 $4.56 1/22/2017 $32.14
  • 68. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de Confluent JMS 2.0 Bridge https://www.confluent.io/confluent-accelerators/#jms-bridge
  • 70. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de The Rise of Data in Motion 2010 Apache Kafka created at LinkedIn by Confluent founders 2014 2020 80% Fortune 100 Companies trust and use Apache Kafka 97
  • 71. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de I N V E S T M E N T & T I M E V A L U E 3 4 5 1 2 Data Streaming Maturity Model Initial Awareness / Pilot (1 Kafka Cluster) Start to Build Pipeline / Deliver 1 New Outcome (1 Kafka Cluster) Mission-Critical Deployment (Stretched, Hybrid, Multi-Region) Build Contextual Event-Driven Apps (Stretched, Hybrid, Multi-Region) Central Nervous System (Global Kafka) Product, Support, Training, Partners, Technical Account Management... 98
  • 72. Apache Kafka vs. Traditional Middleware (MQ / ETL / ESB / iPaaS) - @KaiWaehner - www.kai-waehner.de Car Engine Car Self-driving Car Confluent completes Apache Kafka. Cloud-native. Everywhere.