Apache Camel is the leading open source integration framework, which has been around for over a decade. In this talk we will look back in history, to understand how the integration landscape has evolved from EAI, SOA, and ESB architectures up to microservices, and now with modern serverless and cloud native platforms. Apache Camel has been along for the ride. And we will look to the future and see how the latest release v3 of Apache Camel, is aimed for running modern cloud native workloads with Camel K. In this talk you will: Learn from history software integration, and why you should rely on existing, proven fully featured integration frameworks instead of rolling out your own DIY solutions. See how software integration is (still) important in today’s modern architectures and what role does Camel have in the new cloud native world. What is new and noteworthy in Apache Camel version 3

1. State of Integration
with Apache Camel
Claus Ibsen
@davsclaus Las Vegas, September 2019

2. About me
● Senior Principal Software Engineer at Red Hat
● ASF member / Java Champion
● 11+ years as Apache Camel committer
● Author of Camel in Action books
● https://medium.com/@davsclaus

3. My 1st Apache Con in 2016
ApacheCon EU 2016 in Sevilla, Spain
No attendees

4. My 1st Apache Con in 2016
ApacheCon EU 2016 in Sevilla, Spain

5. Agenda
● Integration Evolution
● Camel 3
● Camel K
● Camel Quarkus
● Summary

6. Integration Evolution

7. Integration 10 years ago

8. Integration Architectures

9. Very old SOA/ESB Architecture

10. Today's ESB Architecture
Apache
Camel
OSGi Framework
Apache
CXF
Apache
ActiveMQ
App App App App
App App App App
App App App App
Deployer Shell Config
Manage Blueprint HTTP
Integration
Core
Application
Apache Karaf

11. Integration Architectures

12. Microservice Architecture (MSA 1.0)
Data
store
SaaS

13. Today's Microservice Architecture (MSA 1.0)
Apache
Camel
Apache Tomcat
Spring
Rest
App
Spring
Framework
Spring Boot
Integration
Core
Application
Spring Boot
Hystrix
Circuit
Breaker

14. Integration Architectures

15. Cloud Native Architecture
Camel
App
Integration
Core
Application
Service
Mesh
Pod
Sidecar
Camel
Spring Boot
Spring Boot
Tomcat

16. Cloud Native Architecture
Camel
App
Integration
Core
Application
Service
Mesh
Pod
Sidecar
Camel Main

17. Cloud Native Architecture
Camel
App
Integration
Application
Service
Mesh
Pod
Sidecar
Camel
Quarkus
Quarkus
Core

18. Serverless Architecture
Camel
App
Integration
Core
Application
Knative
Pod
Sidecar
Camel K
K

19. Apache Camel 3

20. Apache Camel 3 - Projects
Camel
Integration Framework
"Swizz army of integration"

21. Apache Camel 3 - Projects
Camel KCamel
Integration Framework
"Swizz army of integration"
Lightweight Integration
Framework. Camel on
Kubernetes & Knative.

22. Apache Camel 3 - Projects
Camel
Quarkus
Camel KCamel
Integration Framework
"Swizz army of integration"
Lightweight Integration
Framework. Camel on
Kubernetes & Knative.
Camel extensions for
Quarkus. Native compiled
Java (GraalVM).

23. What is Apache Camel
● The swizz army of integration
● 10+ years of development and one
of the most active Apache projects

24. What is Apache Camel
● Packed with functionality
The giant Swiss army knife 😅

25. What is Apache Camel
● Java based integration framework
● Runtime support: Spring Boot, Apache Karaf / OSGi, JEE / WAR, Standalone
● Based on Enterprise Integration Patterns
● Comes with 300+ components
● DSL (Java or XML) to describe integration flow (routes)
● Can integrate everything ... almost everything

26. System Integration

27. Integration Framework

28. Enterprise Integration Patterns

29. Enterprise Integration Patterns

30. Camel Routes
from("file:data/inbox")
.to("jms:queue:order");
<route>
<from uri="file:data/inbox"/>
<to uri="jms:queue:order"/>
</route>
Java DSL
XML DSL

31. Camel Architecture

32. Camel runs everywhere
Application
Servers
Linux
Containers

33. Runs on popular Java Runtimes

34. Camel connects everything
Enterprise
Systems
● File
● FTP
● JMS
● AMQP
● JDBC
● SQL
● TCP/UDP
● Mail
● HDFS
● JPA
● MongoDB
● Kafka
● ...
Public Cloud
● AWS
○ S3
○ SQS
○ Kinesis
○ ...
● Google
○ BigQuery
○ PubSub
● Azure
○ Blob
○ Queue
● Box
● Dropbox
● Facebook
● Linkedin
● Salesforce
● SAP
● ServiceNowIoT
● CoAP
● MQTT
● PubNub
SaaS

35. 300+ Components
ahc ahc-ws amqp apns as2 asn1 asterisk atmos atmosphere-websocket atom atomix avro aws aws-xray azure bam barcode base64
beanio beanstalk bean-validator bindy blueprint bonita boon box braintree cache caffeine cassandraql castor cdi chronicle chunk cmis
cm-sms coap cometd consul context corda core-osgi core-xml couchbase couchdb crypto crypto-cms csv cxf cxf-transport
digitalocean disruptor dns docker dozer drill dropbox eclipse ehcache ejb elasticsearch elasticsearch5 elasticsearch-rest elsql etcd
eventadmin exec facebook fastjson fhir flatpack flink fop freemarker ftp ganglia geocoder git github google-bigquery google-calendar
google-drive google-mail google-pubsub google-sheets gora grape groovy groovy-dsl grpc gson guava-eventbus guice hawtdb
hazelcast hbase hdfs hdfs2 headersmap hessian hipchat hl7 http http4 http-common hystrix ibatis ical iec60870 ignite infinispan
influxdb ipfs irc ironmq jackson jacksonxml jasypt javaspace jaxb jbpm jcache jclouds jcr jdbc jetty jetty9 jetty-common jgroups jibx
jing jira jms jmx johnzon jolt josql jpa jsch jsonpath json-validator jt400 juel jxpath kafka kestrel krati kubernetes kura ldap ldif leveldb
linkedin lra lucene lumberjack lzf mail master metrics micrometer milo mina mina2 mllp mongodb mongodb3 mongodb-gridfs mqtt
msv mustache mvel mybatis nagios nats netty netty4 netty4-http netty-http nsq ognl olingo2 olingo4 openshift openstack opentracing
optaplanner paho paxlogging pdf pgevent printer protobuf pubnub quartz quartz2 quickfix rabbitmq reactive-streams reactor restlet
rest-swagger ribbon rmi routebox rss ruby rx rxjava2 salesforce sap-netweaver saxon scala schematron scr script service servicenow
servlet servletlistener shiro sip sjms sjms2 slack smpp snakeyaml snmp soap solr spark spark-rest splunk spring spring-batch
spring-boot spring-cloud spring-cloud-consul spring-cloud-netflix spring-cloud-zookeeper spring-integration spring-javaconfig
spring-ldap spring-redis spring-security spring-ws sql ssh stax stomp stream stringtemplate swagger swagger-java syslog tagsoup
tarfile telegram test test-blueprint test-cdi testcontainers testcontainers-spring test-karaf testng test-spring thrift tika twilio twitter
undertow univocity-parsers urlrewrite velocity vertx weather web3j websocket wordpress xchange xmlbeans xmljson xmlrpc
xmlsecurity xmpp xstream yammer yql zendesk zipfile zipkin zookeeper zookeeper-master

37. +

38. +
+

39. +
+
+

40. +
+
+
=

41. Apache Camel 3

42. Camel 3 - Website
● New website and documentation

43. Camel 3 - Platforms & Runtimes
● Java 8
○ will be dropped later on 3.x
● Java 11
○ first version to support
● GraalVM
○ camel-quarkus sub-project
● Spring Boot 2.x
● Standalone (camel-main)
● Apache Karaf (OSGi)
● WAR / JEE
● Eclipse Microprofile

44. Camel 3 - Modularized
● Modularized camel-core
camel-core
( Camel 2.x)
camel-api camel-core-osgi camel-management-api
camel-base camel-core-xml camel-management-impl
camel-caffeine-lrucache camel-endpointdsl camel-support
camel-cloud camel-headersmap camel-util
camel-core camel-jaxp
camel-core-engine camel-main

45. Camel 3 - Modularized
● Modularized camel-core components
camel-core
( Camel 2.x)
camel-bean camel-log camel-stub
camel-browse camel-mock camel-timer
camel-controlbus camel-properties camel-validator
camel-dataformat camel-ref camel-vm
camel-direct camel-rest camel-xpath
camel-directvm camel-saga camel-xslt
camel-file camel-scheduler camel-zip-deflater
camel-language camel-seda

46. Camel 3 - Modularized
● camel-core vs camel-core-engine
camel-core
(Camel 3.x)
camel-core-engine
(Camel 3.x)
Includes 33 Camel JARs
(core & core components)
(similar to camel-core 2.x)
Includes 12 Camel JARs
(core only functionality)

47. Camel 3 - Optimized
● Faster startup and lower footprint
○ Smaller core & less classes loaded etc
● Optimized camel-core
○ Many smaller optimizations
examples/camel-example-console
Camel 2.x: 5179 classes loaded (5.3 mb camel JARs)
Camel 3.x: 4286 classes loaded (3.9 mb camel JARs)

48. Camel 3 - Optimized
● Source code generated invocation (no Java reflection)
○ Type Converters
○ EIP model (property placeholders)
○ Endpoint configuration
○ Component configuration
● JMX optional
● Build & Init lifecycle phase
○ Prepare before start (eg Quarkus build time preparation)

49. Camel 3 - Endpoint DSL
● Endpoint DSL
○ Type Safe
○ Java Fluent Builder style

50. Camel 3 - Reactive
● Reactive Core
○ All EIPs now fully reactive
○ Blocking vs Non-Blocking code-paths merged into one (Non-Blocking)
● Postponed for Camel 3.x
○ Backpressure
○ Client API
○ Java 9+ Flowable API (requires to drop Java 8)

51. Camel 3 - Camel Main
● Standalone Camel
○ Bootstrap for Camel K & Camel Quarkus
○ Unified configuration (also for Camel Spring Boot)
● Configurable
○ application.properties (ala Spring Boot)
● Eclipse Microprofile Integration
○ Configuration
○ Metrics
○ Health Checks
● Tooling Support
○ Eclipse
○ Eclipse Che
○ VSCode
○ IDEA

52. Camel 3 - Other
● JUnit 5 support
○ camel-test-junit5
● Step EIP
○ Group together N+ EIPs (logical name)
○ Grouped performance statistics
● Lazy start producer
○ Avoid Camel to fail on startup if producer fails to start
(typically connecting to remote system)
● Writeable Registry
○ Easier to add your own beans
● Route Model more extensible
○ YAML route builder (Camel K)

53. 19/12/2018
Master switched
to camel 3
02/2019
M1
❏ New Camel API
❏ Move components
out of camel core
❏ Extract basic
classes in a support
JAR
❏ Reactive Routing
Engine
❏ Faster releases
❏ Quarkus Support
for a subset of
components
❏ Writeable registry
❏ Step EIP
❏ Faster build
❏ Reactive Routing
Engine improved
❏ Java 11 support
improved
❏ EIP at scale
❏ More Quarkus
support
Finalized
Release
04/2019
M2
06/2019
M3
07/2019
M4
❏ Auto-generate
Endpoint DSL
❏ Camel-core-engine
❏ Camel-main
improved
❏ Website and docs
almost done
09/2019
RC1
Renaming
components,
stabilizing
codebase,
New website live
Reduced
Footprint
Camel 3 - Timeline
10/2019
RC2
11/2019
GA
5000+ commits (Camel 3.x)

54. Camel K

55. A lightweight integration platform, based on Apache Camel,
born on Kubernetes, with serverless superpowers.
What is Apache Camel K ?
Runs on “vanilla” Kubernetes (1), Openshift (2) and gives its best on a Knative-powered cluster (3)!
K
1.
K
2.
K
3.

56. How?
from(“telegram:bots/bot-id”)
.transform()...
.to(“kafka:topic”);
from(“kafka:topic”)
.to(“http:my-host/api/path”);
1. Create a integration file (Java, Groovy, Kotlin, JS, XML…)
Camel DSL, based on
EIPs...
3. Runs on Openshift or
Kubernetes
$ kamel run integration.groovy
2. Run it

57. Architecture of Camel K
Dev Environment Remote Cloud
kamel CLI
Camel K
Operator
“Integration”
Custom
Resource
Running Pod
Live updates!
Fast redeploy!
Less than 1 second!
Tailored for cloud-native development experience

58. Fast Deployment of Camel K
Time to run a integration using different strategies (in seconds)
Lower is better
😃
F-m-p is the “fabric8-maven-plugin”
(http://maven.fabric8.io/) deploying a
average spring-boot based
integration on Minishift vs. a remote
OpenShift cluster (accounting time to
upload the fat Jar). Source S2I build
has been measured in Red Hat Fuse
Online.

59. Quick Camel K Demo

61. Camel Quarkus

63. Java Density Problem
CONTAINER ORCHESTRATION
Node Node Node
Traditional Cloud-Native
Java Stack
Traditional Cloud-Native
Java Stack
Traditional Cloud-Native
Java Stack
Traditional Cloud-Native
Java Stack
NodeJS
NodeJS
NodeJS
NodeJS
NodeJS
NodeJS
NodeJS
Go Go Go
Go Go Go
Go Go Go
Go Go Go
Go Go Go
Go Go Go
Go Go Go
https://developers.redhat.com/blog/2017/03/14/java-inside-docker/

64. SCALE-UP SCALE-DOWN SCALE-TO-
ZERO
Java Fast Scaling Problem

65. What is Quarkus ?
A Kubernetes Native Java stack tailored for
GraalVM & OpenJDK HotSpot, crafted from the
best of breed Java libraries and standards
https://quarkus.io

66. Minimal Footprint
● Minimal footprint Java applications
○ Native vs Quarkus+OpenJDK JVM vs Traditional JVM

67. Apache Camel and Quarkus runs blazingly fast 🚀 with native compiled binaries.
Startup is 7 msec, 28mb binary file, and 15mb RSS memory used.

68. Summary

69. Characteristic Monolithic/SOA Microservies/CNA Functions/Serverless
Packaging Ear/War/Jar Fat-jar Native executable
Startup procedure XML scanning Annotation scanning Instant (ahead-of-time compilation)
Memory/binary size 1000s MBs 100s MBs 10s of MBs
Startup/first response Minutes Seconds Milliseconds
Process lifecycle Long running Managed by platform Ephemeral (executed per request)
State (app/user) Stateful Stateless (no user state) Ephemeral (no application state)
Data ownership Shared data model Owns data No data ownership
Operations Multiple unrelated operations Multiple domain operations Single event driven operation
Scope Multiple business domains Single business domain Single task
Motivation Non-scalable, high complexity
domains
Portable, autonomous,
scalable workloads
Rapid productivity, at the expense
of control and portability
Application trends (Java)

70. More Camel Talks
● Efficient data integrations with the Medley platform
○ Sami Adranly
○ Wednesday, 11th Sep, 16:45 - 17:35 in room Laughlin 2
● Apache Camel K: a cloud-native integration platform
○ Nicola Ferraro & Andrea Tarocchi
○ Wednesday, 11th Sep, 17:45 - 18:35 in room Laughlin 2
● Apache Camel K: connect your Knative serverless applications with
everything else
○ Nicola Ferraro & Andrea Tarocchi
○ Thursday, 12th Sep, 09:00 - 09:50 in room Laughlin 2

71. More Camel Talks
● Agile Integration - Cloud Native Application Development
○ Christina Lin
○ Thursday, 12th Sep, 14:00 - 14:50 in room Laughlin 2
● Configuring Apache Camel for the Cloud
○ Bob Paulin
○ Thursday, 12th Sep, 15:30 - 16:20 in room Laughlin 2
● Serverless Integration with Apache Camel and Knative
○ Michael Costello
○ Thursday, 12th Sep, 16:30 - 17:20 in room Laughlin 2

72. More Camel Material
● Apache Camel
https://camel.apache.org
● Quick Camel K demo
https://www.youtube.com/watch?v=I-g2xt-Qcb8
● Kubernetes enterprise integration patterns with Camel K video
https://www.youtube.com/watch?v=51x9BewGCYA
● Camel K and Knative video
https://www.youtube.com/watch?v=btf_e2GniXM

73. Any Questions ?
Follow us on Twitter
@ApacheCamel
@davsclaus
https://github.com/apache/camel
A ⭐ star on github is appreciated