My presentation of ITProceed - showing hybrid cloud integration patterns for ITpro's

1. Azure Integration Patterns
Sam Vanhoutte - Codit

2. Nice to meet you
SamVANHOUTTE
CTO Codit
6 year - BizTalkV-TSP
1st year - Integration MVP
sam.vanhoutte@codit.eu
+32 474 849 993
@SamVanhoutte
be.linkedin.com/in/samvanhoutte/
> 60 Active integration customers
International Focus -
HQ in BEFocused on integration solutions
2000 Belgium
2004 France
2013 Portugal
60 employees
> 50 consultants BizTalk certifiede-news + SoMe
2012 & 2013
Partner of the Year
Award Finalist
Application Integration

3. And take home the
Lumia 1320
Present your feedback form when you exit
the last session & go for the drink
Give Me Feedback

4. Bring the cloud to your enterprise:
Integration
Your
Data
Center
Integration
Partners
SaaS
Apps

5. Same problems
different solutions, new challenges
Network latency
Identity Management
Different SLAs
Data Security
Monitoring
Management
Mobile AccessInterop
Changing schemas
Services not Servers
ConnectivityREST-first

6. Architectural challenges
Operational challenges
Security Latency
Standards &
Interop
Hybrid
connectivity …
“DevOps”
Enterprise
procedures SLA’s Monitoring …
Same problems
different solutions, new challenges

7. Cloud Integration Patterns
Network Integration
Data Integration
Application Integration
Connect and synchronize data between on-prem and cloud
Connect on protocol – network level
Synchronous or asynchronous message communication on
application level

8. NETWORK INTEGRATION

9. Network integration:
Technology overview
• Virtual Networking
– Point to Site
– Site to Site
• ExpressRoute
• Hybrid connections
– (app. integration)

10. Virtual networking options

11. ExpressRoute connectivity
Microsoft Azure
Compute
Azure
Edge
Connectivity
Provider
Infrastructure

12. ExpressRoute connectivity
ExpressRoute provides
organizations a private,
dedicated, high-throughput
network connection between
Windows Azure datacenters and
their on-premises IT environment.

13. DATA INTEGRATION

14. Data integration:
Technology overview
• Azure Storage
– Azure File Service
– Table & Blob storage
• Azure SQL Database
– Data Sync
– SQL Connectivity

15. Connect to Azure SQL Database
• Through SQL Azure TDS
• Local firewall settings
– Outbound connections
– TCP port 1433
• SQL database firewall
– Provide allowed IP ranges to connect to server
– Use sp_set_database_firewall_rule on
database level

16. SQL Azure Data Sync
• Warning! Still in preview… For years
• Powers movement of data
– Cloud  cloud
– On-premises  cloud
• Getting data where you need it
– Sync SQL Azure instances
– Sync SQL Server to SQL Azure
– Sync offline apps to SQL Azure
– Enable geo-replication of data
Sync
SQL
Azur
e

17. APPLICATION INTEGRATION

18. Application integration:
Technology overview
• Service Bus
– Relay Service
– Messaging
– Notification Hubs
• BizTalk Services
– Hybrid Connections
– Adapter service
– EDI Trading partners

19. Service Bus Brokered Messaging
Port 9354 outbound
Port 5672 for AMQP
Port 443 for HTTPS
• Asynchronous / queued processing
• Distributed processing
• Load leveling / Temporal decoupling
• Interoperability through AMQP / REST
• Routing of messages

20. Service Bus Relay - how it works
• Outbound firewall only
• Bi-directional
communication patterns
• Load-balancing in the cloud
• HTTP or TCP connectivity
• Different security options

21. Firewall friendly? Yes, but…
• Only outbound firewall rules needed
– TCP: Ports 9350-9353
– HTTP: Ports 80 & 443
• IP range of cloud services change
constantly
– Don’t block outbound IP addresses
– http://bit.ly/15lXMB0

22. Port configuration #fyi
• Outbound TCP (Ports 9350-9353)
– 9350 Unsecured TCP One-way (client)
– 9351 Secured TCP One-way (all listeners, secured clients)
– 9352 Secured TCP Rendezvous (all listeners except one-way)
– 9353 Direct Connect Probing Protocol (TCP listeners with direct
connect)
• Outbound HTTP (Port 80, Listeners)
– TCP equivalent tunnel with overlaid TLS/SSL formed over pair of
HTTP requests
– Alternate connectivity path if outbound TCP is blocked
• Outbound HTTPS (Port 443, Senders)

23. Service Bus Relay
Demo – connect to on prem SQL

24. Hybrid Connections
Web Sites
Mobile Services
Corporate Network
Microsoft SQL Server
Hybrid Connection
Other published
resourcesHybrid Connection
Manager

25. Hybrid connections
Access to on-premises
resources
Connect to SQL Server, Web Services or most other that use
TCP or HTTP connectivity
No need to alter the network
perimeter
Doesn’t require a VPN gateway or Firewall changes to allow
incoming traffic
Applications have access only to the resource that they
require
Outbound connection needed on port 5671
IT maintains control over
resources
Support for Group Policy and Event/Audit Logging providing
Admins control and visibility
Event and Audit logging
IT has insight into resources being accessed
IT can use existing infrastructure investments for monitoring
and control
Dashboard on Azure portal
Access to connection health, status
Will provide insights on usage and metrics

26. Hybrid Connections
Demo – migrate web site

27. BizTalk Services
BizTalk Adapter Service
Server Explorer
(Visual Studio)
PowerShell
CmdLets
Management
Service REST API
Lob Relay
(Service Host)
Bridge
Pipeline
V E T E
Messages
Sources
FTP/S
HTTP
SFTP
Destinations
Service Bus
Web Service
FTP/S
HTTP
Blob

28. BizTalk Services
Demo – connect to SAP or SQL on prem

29. Hybrid connectivity options

30. Scenarios
When to use what ?

31. Local, shielded network
Virtual Networking
VPN device
Site to Site VPN
SOAP
Site to Site VPN, connecting local services and file shares
FTP
IPSec tunnel
Codit Integration Cloud

32. Local, shielded network
Virtual Networking
VPN device
Site to Site VPN
SOAP
Site to Site VPN, connecting local services and file shares
FTP
IPSec tunnel
Advantages
• Connections managed from the cloud
• On-premises footprint extremely small
• No DMZ deployment needed
• Extensible connection service
Reasoning
• Minimize network / application impact
• Fully outsource solution
Codit Integration Cloud

33. Belgium
SQL Data Sync
Worker Role
reference data lookup
SQL Data Sync
Feed Azure Database with local SQL reference data for lookups
On prem SQL
SQL Azure Database

34. Belgium
SQL Data Sync
" changing the way integration is done
BizTalk Services
(bridge enrichment : look up)
SQL Data Sync
Feed Azure Database with local SQL reference data for lookups
On prem SQL
SQL Azure Database
Advantages
• Quick to set up
• Low latency for data access (same data center)
• No changes need to local application
Reasoning
• Warning – in preview for years !
• Good for caching data in the cloud

35. Netherlands
Service Bus Relay
BizTalk Adapter
Service
Service Bus Relay
REST FILE
Cloud Integration environment, using Service Bus Relay to on-prem
SQL
Cyprus
Cloud
Connector
Codit Integration Cloud

36. Service Bus Relay
Cloud Integration environment, using Service Bus Relay to on-prem
Advantages
• Connections managed from the cloud
• On-premises footprint extremely small
• No DMZ deployment needed
• Extensible connection service
Reasoning
• Minimize network / application impact
• Fully outsource solution

37. BizTalk Services
Azure BizTalk Services
On prem ESB
Service Bus Relay
SAP WMS Oracle
FTP, AS2…
Customer moving all B2B to the cloud, relaying to on prem BizTalk

38. BizTalk Services
Windows Azure
BizTalk Services
BizTalk ESB
Service Bus Relay
SAP WMS Oracle
FTP, AS2…
Advantages
• Faster set-up of partner connections
• One-time firewall set-up
• Support for existing mappings & schemas in WABS
• No specific DMZ deployment needed
Reasoning
• Latency less important for B2B than EAI
Customer moving all B2B to the cloud, relaying to on prem BizTalk

39. THANK YOU
AND NOW, QUESTIONS?
OR DRINKS?

40. Follow Technet Belgium
@technetbelux
Subscribe to the TechNet newsletter
aka.ms/benews
Be the first to know

41. Belgiums’ biggest IT PRO Conference