Hursley comes to you 2011 ESB Usage Scenarios and Patterns Brian Hulse WSRR Development

1. Hursley Comes To You
ESB Usage Scenarios and Patterns
Brian Hulse
WSRR Development
brian_hulse@uk.ibm.com
WebSphere
© 2010 IBM Corporation

2. Hursley Comes To You
Agenda
 ESB and Connectivity Overview
 ESB Usage Patterns
© 2010 IBM Corporation
2

3. Hursley Comes To You
ESB and Connectivity Overview
© 2010 IBM Corporation
3

4. Hursley Comes To You
ESBs Simplify Connectivity
File
MQ/JMS soap/jms
soap/http
Enterprise Service Bushttp
WebSphere MQ
© 2010 IBM Corporation
4

5. Hursley Comes To You
Enrich your SOA connectivity …
Service Enrichment
•Match & Route communications
between services
•Converts between transport protocols
•Transforms between data formats
•Identifies and distributes bus events
… simplifying the overall architecture and reducing IT cost
© 2010 IBM Corporation
5

6. Hursley Comes To You
Agile Connectivity:
The Enterprise Service Bus (ESB)
Connects everything Matches & routes communications
to everything between services
Transforms between Distributes
different data formats Business events
Converts between
different transport
protocols
An ESB enables flexible SOA connectivity for integrating
business applications, services and processes
© 2010 IBM Corporation
6

7. Hursley Comes To You
Two core principles enable flexibility
The ESB facilitates the decoupling of interactions between
requestor(s) and provider(s)
Service Service
Provider Provider
Service Service Service Service
Requestor Requestor Requestor Requestor
The ESB fulfils two core principles in support of separation of concerns:
Service Virtualization
Service Virtualization Aspect Oriented Connectivity
Aspect Oriented Connectivity
 Routing
 Routing Security
Security Log and Audit
 Protocol and transports
 Protocol and transports Management
Management Event tracking
 Transformation of interfaces
 Transformation of interfaces etc …
etc …
© 2010 IBM Corporation
7

8. Hursley Comes To You
Processing Scenarios & Usage Patterns
© 2010 IBM Corporation
8

9. Hursley Comes To You
Many Defined Patterns for ESB-based Solutions
Service
Virtualization
Service Gateway
Enablement
OR
OR
OR
Message-based Event-driven
Integration Integration
File Processing
http://www.ibm.com/developerworks/wikis/display/esbpatterns/
© 2010 IBM Corporation
9

10. Hursley Comes To You
Typical Customer Usage Patterns
 Extend the Reach of Existing Applications
 Connect File with Online for End-to-End Efficiency
 Connect Devices to the Enterprise
 Get the Most from Packaged Applications
 Distribute Database Information to Where It’s Needed
 Make An Application Inventory and Govern processing with a Registry
 Provide a PEP for Secure Application Connectivity
 Monitor your Business Activity and Act Intelligently
 Develop and Reuse Solutions with Patterns
© 2010 IBM Corporation
10

11. Hursley Comes To You
Extend the Reach of Existing Applications
Expose existing applications without change
SOAP & Web 2.0 based access to existing systems
Create a gateway for routing and security
INBOUND and OUTBOUND scenarios
SOAP Web Services Established as Interoperability Standard
– SOAP support allows ESB to act as WS-* façade to existing non WS-* applications
• Support for SOAP/HTTP and SOAP/JMS (any), includes transactions & asynchronous processing
 Web 2.0/REST Provides Lightweight Universal Access
– HTTP ubiquity & REST semantic provide universal access to existing systems
– Popular with both XML and JSON payloads (JSON for lightweight clients)
ESB
 Outbound Scenarios enable Existing Applications to request New Services
– Existing application can invoke and exploit new services with existing technology WS provider
clients
 Typical Customers
– US Payroll Corp. exposes MQ applications via self service SOAP interface for responsiveness &
accuracy
– WW (US based) Airline access external web services from existing JMS/MQ reservation system
– US Wireless Operator expose legacy billing systems via HTTP/XML for customer self service
© 2010 IBM Corporation
11

12. Hursley Comes To You
Connect File and Online for End-to-End Efficiency
Unlock the valuable business data in your files
 Files exchange between applications still popular and effective
– Flexible method of exchange: Neither enterprise has to mandate technology
 There are legitimate reasons for using files to exchange information
– Usually relate to the way businesses run or physical processes occur
 Examples
– A cargo ship has thousands of containers each with hundreds of palettes
– Reduce unit transaction costs by aggregating numerous clients requests
 End to End File Movement and File Processing
– Reliable and secure delivery File Transfer with MQ FTE
– File processing allows clients to get file/batch work online, easily
 Typical Customers
– German Retailer uses ESB & FTE for POS reporting to HQ & price list distribution to store
– NE US Retailer using FTE & ESB to provide timely inventory updates to and from online systems
© 2010 IBM Corporation
12

13. Hursley Comes To You
Connect Devices to the Enterprise
Monitor remote systems and devices
Provide near real-time insight about physical systems, and act
 Industry Observation
– “How to we get information from everywhere, understand it, and act?”
– Medical, Energy and Utilities, Distribution, Transport, Gaming…
– Issues based e.g. traffic congestion, efficient energy, timely supply…
 A Smarter Planet is full of devices
– Data is generated *outside* the enterprise
• Typically very large numbers of devices:
• Often concentrator technology; differentiate, integrate & forward
– MQTT for standards based device integration
IBM is working with Brisbane,
• Small footprint client, embeddable, Low bandwidth cost London, Singapore and
• Fragile network support for hostile environments Stockholm to deploy smarter
traffic systems. Stockholm has
seen approximately 20 percent
 ESB to Connect Devices, Apply Intelligence less traffic, a 12 percent drop in
– Connects MQTT devices to enterprise systems emissions and a reported
40,000 additional daily users of
– Apply intelligence in near real-time; systems tend to be passive today public transportation.
 Typical Customers
– US Medical and Technology services company monitors pacemakers for home health
– Swedish city congestion charging, traffic calming and pollution reduction
© 2010 IBM Corporation
13

14. Hursley Comes To You
Get the Most from Packaged Applications
Provide broad access to EIS systems
Move information to and from packaged systems
 Packaged Applications Provide Best of Breed Business Function
– SAP for purchasing, sales, inventory…
– SEBL for Sales, PeopleSoft for HR
– Oracle, JDEdwards…etc
 Interfaces are often non standard: e.g. SAP BAPIs, IDOCs
– Processing and data are isolated from other applications
– Result: packaged apps have difficultly using/generating information for other apps
– Inhibits adoption of a best of breed philosophy
 Support for SAP, SEBL, PeopleSoft, JDEdwards… inbound and outbound
– Connectivity built-in – no extra moving parts
– Drive new work into its packaged application from any other supported source
– Can send information from packaged application to any other supported target
– Packaged applications can focus on what they do best and be integrated
 Typical customers
– NA Railroad uses MB for all SAP to SAP communication
– WW Pharmaceutical uses MB for order payment to SAP and distribution notification from SAP
– WW Hotel chain uses MB for SEBL customer billing and sales systems
© 2010 IBM Corporation
14

15. Hursley Comes To You
Provide a PEP for Secure Application Connectivity
Provide secure access to applications and services
Understand and convert broad range of security domain identities
Provide secure external access services to partners
 Connectivity often implies security domain change
– ESB supports a broad variety of security tokens
– Userid/pw, X509, SAML, Kerberos, LTPA…
 ESB is Policy Enforcement Point (PEP)
– Security is enforced here, still owned by PDP
– Identity management, access control, authorization
and authentication mechanisms (AAA) are essential
 Policy Decision Point (PDP) and ESB work together
– PDP combination provides a secure infrastructure
– Ensures conformance to centralized security policy
– Many different PDP technologies supported
• Lightweight Directory Access Protocol (LDAP)
Microsoft Active Directory, Open LDAP…
• Tivoli Federated Identity Manager (TFIM)
• WS-Trust, zOS SAF including RACF
 External Partner Access to Services
– Security hardened DMZ device strengths
15 – Combine network and ESB functionality
© 2010 IBM Corporation

16. Hursley Comes To You
A Flexible Infrastructure to Support Change
Enable Application and Service Replacement with minimum risk
 ESB creates a Virtual Service
– Implementation details of a service to be hidden
– Flexibility in implementation; change implementations without affecting consumers
– Introduce new interfaces to existing service in parallel with new interfaces
 Examples include M&A, Decommissioning & External partner communication
– Connect newly acquired systems, particularly relevant in M&A
– Formats and Protocols of acquired technology differ from current systems
– ESB provides managed interface to acquired systems for in-house systems
– Provides new interface for acquired systems
– Staged decommission of legacy implementations
– Maintain existing interface to new implementation
– Allows Managed risk of client migration
– Often combined with new interface definition, often to enable service orientation
– External partner communication
– ESB provides interface to external systems
– Allows partners to be swapped in and out without affecting consumers
© 2010 IBM Corporation
16

17. Hursley Comes To You
Make an Application Inventory & Govern Processing
Understand your application assets and control their access dynamically
Dynamically change processing without redeployment
Provide processing policy and governance
 Catalog application and service assets using a registry, e.g. WSRR
– Web Service and MQ Service definitions
– Classifications: by function, owning department
– Relationships: applications dependencies for life-cycle management, versioning
– User defined properties (meta-data): Application=GOLD or Service=SILVER
Service
 Use registry information in ESB routing Provider
– Built-in ESB facilities allow access registry Use metadata to
implement ‘smart’
• In memory cache for high performance mediations
– Enables policy based processing, examples Virtual 3
• Simple routing based on client meta-data Service
• Dynamic WS-SecurityPolicy processing
• Dynamic transformation based on endpoint Service A’ A
1
Requestor
– WSRR as critical governance point 2 Capture metadata
about services for
Advertise
use by Service Bus
availability of
the ‘virtual
 Typical Customers services’
– US automotive sales company uses MB+WSRR
• Timely match vehicle availability with customer request
© 2010 IBM Corporation
17

18. Hursley Comes To You
Monitor Your Business and Act Intelligently
Understand the business relevance of ESB data
Apply business rules to ESB data in-flight
Detect business situations and act quickly
 ESB Connectivity Processes Events from many Sources, Targets
– Capture business relevant information for WebSphere Business Monitor
• Examples: total dollar trade value per day, orders per hour
– Capture business events to correlation with WebSphere Business Events
• Look for correlations in data, e.g. fraud, sales opportunities, CRM
– Audit, Repair and Replay transported events
ILOG rules
 Generate Business Monitoring Events from existing connectivity engine
– Enables integration with WebSphere Monitor to display & analyze KPIs
– Design time and operational time event activation
– Notification via CEI & Publish subscribe
Inputs Outputs
 Rule-based Decision Services render decisions on input data
– Most often this data comes from a variety of data sources: aggregation, transformation is required
– Rule-based Decision Services send outcome decisions to other systems: rule based routing
 Typical Customers
– European Motor manufacturer creates virtual system of record for audit
– NA Insurance company uses MB+ILOG for business decisions routing
– UK Retail group measures store throughput by item for real-time trending
© 2010 IBM Corporation
18

19. Hursley Comes To You
Detect and Act Upon Business Events
Compose existing applications and services to create new value
 ESB Event Capture and Process Initiation
– Breadth of ESB connectivity enables multiple business process starting points
• Identify event and initiate business process
• e.g. message, file, web service, device endpoints can start business process
– Synchronous and asynchronous invocation for short & long running transactions
• Multiple options with Process Server, Lombardi, FileNet…
 Business Process Connectivity
– Exploit range of ESB connectivity to abstract and simplify BPM
– Process focus on WHAT rather than ESB focus on WHERE, HOW concerns
– ESB receives service request and routes, re-formats, interacts with provider
Business Process Business Process
IBM BPM 7.5
ESB ESB
© 2010 IBM Corporation
19 Web Service, SAP, MQ, File…

20. Hursley Comes To You
Develop & Reuse Solutions with Patterns
Develop connectivity solutions quickly
Capture previous experience for cost reduction
Ensure solutions conform to best practices
 Use ESB’s built-in Patterns to Kick-start Development
– Built-in patterns for Web Services, Messaging, File, SAP...
– Guided solutions using top-down, parameterized approach
– Development artefacts are generated from solution template
 Create your own Patterns to suit your Business needs
– Simple to create your own solution template – User patterns!
– Start from an existing Message Broker solution or IBM pattern
– Ensure specific business: e.g. audit, notification, validation…
 Create and Participate in Public and Private Communities
– Create reusable assets for sharing across your business
– Full check-in/out & versioning with any Library Control System
– Private Communities for internal sharing via Web Content tools
– Public communities for more widely available patterns
 Typical Customers
– Swedish partner providing patterns for low cost off-premises connectivity
– WW GSI using patterns for quicker time-to-value and cost reduction
– mqseries.net public patterns community launched Nov 2010
• Patterns created, rated & used by mqseries.net community © 2010 IBM Corporation
20

21. Hursley Comes To You
Patterns: WESB Service Gateway accelerator
© 2010 IBM Corporation
21

22. Hursley Comes To You
Patterns: WESB Service Gateway accelerator
© 2010 IBM Corporation
22

23. Hursley Comes To You
Patterns: WESB Service Gateway accelerator (Static 3)
© 2010 IBM Corporation
23

24. Hursley Comes To You
Multiple ESB offerings
Solutions to Meet Any and Every Demand
Platform Based Integration Based
WebSphere
WebSphere Message Broker
Enterprise Service Bus
 Built for universal connectivity
 Optimized with WebSphere and transformation in
Application server for an heterogeneous
integrated SOA platform IT environments
 Shares common registry, Appliance Based  Message transformation
security, administrative and developed to accommodate
development tools WebSphere disparate service interfaces
 Services hosted on the  Adapters, protocol bridges
DataPower
application server Integration Appliance XI50 packaged with applications and
legacy platforms
 Hardware built for simplified
deployment and hardened security
 Functions developed in one device
© 2010 IBM Corporation
24

25. Hursley Comes To You
The ESB … at the heart of a smart connectivity ‘ecosystem’
Service Orchestration
and BPM
Service Monitoring
Business Rules
IBM BPM 7.5
Tivoli CAM for SOA
WebSphere iLog JRules
Service Security
Universal
Tivoli Security Products Transformation
Service Registry
Publish Find Enrich Manage Govern
WebSphere Transformation
WebSphere Service Extender
Registry and Repository
Messaging Backbone for SOA
MQI Java JMS XMS for .NET C# XMS for C/C++
WebSphere MQ messaging backbone
© 2010 IBM Corporation
25 WebSphere MQ