Today, in 2022, Apache Kafka is the central nervous system of many applications in various areas related to the automotive and manufacturing industry for processing analytical and transactional data in motion across edge, hybrid, and multi-cloud deployments.
This presentation explores the automotive event streaming landscape, including connected vehicles, smart manufacturing, supply chain optimization, aftersales, mobility services, and innovative new business models.
Afterwards, many real-world examples are shown from companies such as Audi, BMW, Porsche, Tesla, Uber, Grab, and FREENOW.
More detail in the blog post:
https://www.kai-waehner.de/blog/2022/01/12/apache-kafka-landscape-for-automotive-and-manufacturing/
Right Money Management App For Your Financial Goals
Apache Kafka Landscape for Automotive and Manufacturing
1. The Automotive and Manufacturing Landscape
for Apache Kafka
Kai Waehner
Field CTO
kai.waehner@confluent.io
linkedin.com/in/kaiwaehner
@KaiWaehner
confluent.io
kai-waehner.de
2. @KaiWaehner - www.kai-waehner.de – Data in Motion Automotive and Manufacturing
Automotive Industry
Manufacturing, Logistics, Connected Vehicles, Fleets, Aftersales
Real-time Operations, Predictive Maintenance, Cybersecurity
Low Latency
Cost Efficiency
Situational Awareness
Smart Factory
Germany
Siemens
Azure
SAP
Smart Factory
USA
GE
AWS
Oracle
Smart Factory
China
Alibaba
Samsung
Disconneded Edge
Offline Storage
Analytics
Collaboration
with Partners
Traffic Data
Vehicles, Accidents,
Traffic Lights, etc.
Surveillance Data
Buildings, People,
Distance Measuring, etc.
Mobility Services
Multi-modal Integration,
Fleet Management
E-car Charging Stations,
Parking Lots, etc.
Supply Chain Optimization
Customer Experience
Connected Cars
Swarm Intelligence
Data-driven Engineering
Cross-cutting Business
(Mobility, Car Sharing, Insurance)
Real-time Analytics
Integration with CRM, Data Lake, et al
SaaS
Product
Smart
City
Intelligent Vehicle
Embedded Analytics
Data Preprocessing
Sensor / Image / Video
Aftersales
Manufacturing 4.0
Quality Assuance
Predictive Maintenance
Data Historian
Cybersecurity
Public Cloud
3rd Party API
On Premise
Edge
Data
Ingestion
Bidirectional Edge to Cloud Integration
Streaming
Data Exchange
3. @KaiWaehner - www.kai-waehner.de – Data in Motion Automotive and Manufacturing
Manufacturing 4.0
Improved Overall equipment effectiveness (OEE),
Predictive Maintenance, Open Data Historian,
Postmodern ERP/MES, Cybersecurity
Low Latency
Cost Efficiency
Situational Awareness
Smart Factory
Machines
PLCs
IoT Gateway
ERP / MES
Manufacturing 4.0
Quality Assuance
Predictive Maintenance
Data Historian
Cybersecurity
Public Cloud
On Premise
Bidirectional Edge to Cloud Integration
4. @KaiWaehner - www.kai-waehner.de – Data in Motion Automotive and Manufacturing
Supply Chain Optimization
Intralogistics, Track & Trace, Fleet Management, B2B Collaboration
Monitoring
Alerting
Command & Control
Batch Analytics
Reporting
Machine Learning
5. @KaiWaehner - www.kai-waehner.de – Data in Motion Automotive and Manufacturing
Mobility Services
Omnichannel Retail and Aftersales
Connected Cars for Ride-hailing, Taxi, Food Delivery
3rd Party Integration with Partners, B2B, Smart City
SaaS
Product
Smart
City
6. @KaiWaehner - www.kai-waehner.de – Data in Motion Automotive and Manufacturing
New Business Models
Car
Insurance
Vehicle
Rental
Service
Data
Provider
7. @KaiWaehner - www.kai-waehner.de – Data in Motion Automotive and Manufacturing
Connected Car Infrastructure at Audi
7
https://www.youtube.com/watch?v=yGLKi3TMJv8
• Real Time Data Analysis
• Swarm Intelligence
• Collaboration with Partners
• Predictive AI
• …
8. @KaiWaehner - www.kai-waehner.de – Data in Motion Automotive and Manufacturing
BMW
Decoupled Logistics and Manufacturing
Mission-critical workloads at the edge and in the cloud
• Why Kafka? Decoupling. Transparency. Innovation.
• Why Confluent? Stability is key in manufacturing
• Decoupling between logistics and production systems
• Provide edge platform (self-managed) + Azure Cloud (fully-managed)
+ bidirectional integration
• Use case
• Logistics and supply chain in global plants
• Right stock in place (physically and in ERP systems like SAP)
• Just in time, just in sequence
• Lot of critical applications
• Things BMW couldn’t do before
• Get IoT data (without interfering with others), get it to the right
place
• Collect once, process and consume several times (at different
times)
• Enable scalable real-time processing and improve time-to-market
with new applications
8
Jay Kreps, Confluent CEO
Felix Böhm, BMW Plant Digitalization and Cloud Transformation
Keynote at Kafka Summit EU 2021:
https://www.youtube.com/watch?v=3cG2ud7TRs4
(My Notes from the BMW Keynote at Kafka Summit EU 2021)
9. @KaiWaehner - www.kai-waehner.de – Data in Motion Automotive and Manufacturing
Tesla
Trillions of messages per day for IoT use cases
https://www.confluent.io/kafka-summit-san-francisco-2019/0-60-teslas-streaming-data-platform/
https://www.confluent.io/blog/stream-processing-iot-data-best-practices-and-techniques/
10. @KaiWaehner - www.kai-waehner.de – Data in Motion Automotive and Manufacturing
BMW Group
Industry-ready NLP Service Framework Based on Kafka
https://www.confluent.io/kafka-summit-lon19/industry-ready-nlp-service-framework-kafka/
11. @KaiWaehner - www.kai-waehner.de – Data in Motion Automotive and Manufacturing
DriveCentric
A scalable real-time CRM for Automotive Dealerships
Customer 360 with effective customer engagement across all channels
Boost engagement, shorten sales cycles, and spur growth
Focus on business, not infrastructure with Confluent Cloud
11
https://www.confluent.io/customers/drivecentric/
12. @KaiWaehner - www.kai-waehner.de – Data in Motion Automotive and Manufacturing
https://www.confluent.io/thank-you/uber-kafka-uber-worlds-realtime-transit-infrastructure/
https://www.confluent.io/thank-you/stream-processing-kafka-uber/
Trillions of messages and
multiple petabytes of data per day
13. @KaiWaehner - www.kai-waehner.de – Data in Motion Automotive and Manufacturing
Fraud Detection @ Grab
GrabDefence SaaS service build with Confluent Cloud, Kafka Streams and ML for stateful stream processing
Billions of fraud and safety detections performed daily for millions of transactions (1.6% is lost in fraud in Southeast Asia)
Data science and engineering platform to search for anomalous and suspicious transactions and identifying
high-risk individuals
Example: An individual who pretends to be both the driver and passenger, and makes cashless payments to get
promotions
14. @KaiWaehner - www.kai-waehner.de – Data in Motion Automotive and Manufacturing
FREE NOW
Stateful stream processing with Confluent Cloud, Kafka Connect, Kafka Streams, Schema Registry
Cloud-native application elasticity and scalability leveraging Kafka and Kubernetes capabilities
Use cases: Dynamic pricing, fraud detection, real-time analytics for marketing campaigns, etc.
Various information about the trip, location and business performance
14
https://www.confluent.io/events/kafka-summit-europe-2021/development-
of-dynamic-pricing-for-tours-using-real-time-data-feeds/
15. @KaiWaehner - www.kai-waehner.de – Data in Motion Automotive and Manufacturing
‘My Porsche’
A digital service platform for customers, fans, and enthusiasts
15
https://medium.com/porschedev
16. @KaiWaehner - www.kai-waehner.de – Data in Motion Automotive and Manufacturing
Porsche’s Streamzilla
A central platform strategy across data centers, clouds, and regions
16
https://www.confluent.io/events/kafka-summit-europe-2021/developing-a-custom-kafka-connector-make-it-shine/
17. @KaiWaehner - www.kai-waehner.de – Data in Motion Automotive and Manufacturing
Here Technologies
Captures location content such as road networks, buildings, parks and traffic patterns
Sells or licenses mapping content, along with map related navigation and location services to other businesses
https://developer.here.com/documentation/data-client-library/dev_guide/client/direct-kafka.html
18. @KaiWaehner - www.kai-waehner.de – Data in Motion Automotive and Manufacturing
Car Engine Car Self-driving Car
Confluent completes Apache Kafka. Cloud-native. Everywhere.