This document discusses hybrid applications that utilize both on-premises and cloud-based resources. It outlines some common scenarios for hybrid applications, such as using the cloud for data storage and archival while keeping computing resources on-premises. It also discusses concerns around security, regulatory compliance, and only moving parts of an application to the cloud that provide clear benefits. The document introduces Windows Azure services like Service Bus that can help enable hybrid applications by allowing communication between on- and off-premises components.
2. About Me
Michael S. Collier
National Architect,
Windows Azure
michael.collier@neudesic.com
@MichaelCollier
www.MichaelSCollier.com
3. A Look Ahead
• Windows Azure Components (quick)
• The Case for Hybrid
• Scenarios and Concerns
• Windows Azure Service Bus
• Additional Connectivity Options
4. Windows Azure Core Components
VM
DataMarket Service WEB
Service Bus Cache Service
WORKER VM
ROLE ROLE ROLE
Compute
Access Control Service
DATABASE DATA SYNC IMPORT REPORTING
BLOB QUEUE TABLE
SERVICE SERVICE EXPORT SERVICE
SERVICE SERVICE SERVICE
SERVICE
Storage Database
Windows Azure Connect Windows Azure Traffic Manager
Windows Azure graphics courtesy of David Pallmann (http://azuredesignpatterns.com)
6. Application Trends
2010+
2000s • Hybrid /
1990s • SOA
Cloud
1980s • Web • .NET & Java,
N-Tier
1970s • Client-Server
• ASP, PHP,
Tight
Architectures,
• COM+, Two ESB, Data
• Mainframe Coupling, Warehousing
tier Web Servers
• COBOL architectures,
C/C++
7. Disruptors and Trends
TECHNOLOGY DISRUPTORS APPLICATION TRENDS
CHEAP PROCESSING
AND STORAGE Service-Orientated
Composite Applications
VIRTUALIZATION Model Driven
Scale-Out
ADVANCES IN Elastic
NETWORKING
Failure Resilient
ADVANCES IN WEB Always Available
TECHNOLOGIES
Multi-Tenant
EMERGENCE OF
SERVICES Staged Production
PLATFORMS
8. Hybrid Clouds – The New Reality?
• Destined to be the most
common “type” of
cloud.
• Determine what to keep
private vs. what is OK
for public exposure.
• Architectures become
complex.
• Balance of cost,
control, flexibility, and
risk.
* Cloud Computing Use Cases White Paper 2009
9. Composite Systems
“By 2015, 80% of transformational systems
implemented by midsize and large
enterprise will be compositions.”
- Gartner
10. Why Consider a Hybrid Approach?
• Expose key functional areas as services enable agility
• Improvements in on-premises and cloud
• Shift from single product, big iron approach -> best in
class, capability driven model
• SOA – service composition of on-premises and in the
cloud.
• Reduce the big spend.
17. Data in Motion
Cloud
SQL AZURE QUEUE
DATABASE
On-premises
DOH! Msg 2
1011011101110111
Msg Msg 3
1
DATABASE
SERVER
Image courtesy Windows Azure Boot Camp
18. Mass Storage
Cloud
BLOB CONTAINER
Doc/Img/JS
On-premises
Bandwidth
DATABASE
SERVER
HTML
Application
Bandwidth
Image courtesy Windows Azure Boot Camp
19. Data Archival
Cloud
BLOB CONTAINER
On-premises
Network Storage
DATABASE
SERVER
Image courtesy Windows Azure Boot Camp
20. Web Applications
WEB ROLE 2+
Cloud
M M
SQL Database SQL Data Sync
(Sync to Hub)
On-premises
The Application
SQL Server
21. Additional Scenarios
Big Data
• Embrace Apache Hadoop on Windows Server and Windows
Azure (see https://www.hadooponazure.com/)
HPC
• Financial risk, engineering, weather modeling, etc.
• Windows Azure HPC Scheduler
• http://www.windowsazure.com/en-us/home/scenarios/parallel/
Cloud Bursting (extending data center to cover peak load)
• Kelly Blue Book uses Windows Azure as a secondary data
center to handle bursts in traffic and new features. Saved
$100,000/year.
22. Windows Azure Service Bus
• Robust messaging and routing services
• Hybrid apps that span on-premises and the cloud
• Specifically designed to traverse NAT and firewall
devices.
• Security via ACS
Service Bus
23. Message Relay
sb://namespace.servicebus.windows.net/service
Service
Bus
TCP:
818/828
HTTP:80
Client Upgrade connection – NAT traversal connection
Service
Application
24. Service Bus Message Queues
(Brokered Messaging)
• Reliable and durable – backed by SQL Database
• Store up to 1GB per queue
• No maximum TTL – unlike Windows Azure queues
• 256KB maximum message size
• Messaging API, WCF, and REST interfaces
Publisher Queue Receiver
Receiver
Receiver
Receiver
25. Service Bus Topics (pub/sub)
(Brokered Messaging)
• Takes SB Queues to the next level
• 2,000 subscriptions on a single Topic
• Subscription is a virtual queue – gets a copy of each message
• Filters
– SQL92 syntax to receive only messages with matching
properties
• Actions
– Modify message properties as they’re selected
Receiver
Rules Receiver
Fulfillment
Subscription Receiver
Publisher Topic
Rules Audit
Subscription Receiver
26. Which to Chose?
Relay Messaging Brokered Messaging
• Built for WCF • WCF, .NET, REST APIs
• Push model • Pull model
• Service connection • Eventually consistent
routing
29. Access Control Services (ACS)
• No need to build your own identity management solution.
• Authenticate (WIF – OAuth and WS-Federation)
• Claims-based authorization
• Multiple Identity Providers (ADFSv2, Google, Live ID,
etc.)
• Ability to bring your own via membership
• Write to ACS and let Microsoft worry about the rest
30. Windows Azure Virtual Machines
• Persistent VM
• Full control and management of virtual machines
• Windows or Linux
• Support for Active Directory, SharePoint, BizTalk & SQL
Server
Image courtesy of http://blogs.msdn.com/b/windowsazure/archive/2012/06/25/infrastructure-as-a-service-series-virtual-machines-and-windows.aspx
31. Windows Azure Virtual Network
Windows Azure
Site-to-Site
VPN Tunnel
Image courtesy of the Windows Azure Training Kit
32. Windows Azure Connect
• Secure network
connectivity between
on-premises and
Windows Azure
cloud.
• Hybrid apps access to
on-premises servers
– App access to SQL
Server
– Role domain-joined to
AD
• Setup & management Enterprise
Image courtesy Windows Azure Platform Training Kit
33. Windows Azure Connect
A Closer Look
• Windows Azure roles
enabled via service
Windows Azure
model. Role A Role B
• Install Connect agent Role C
(multiple VM’s)
for local machines. Relay
• Network policy
managed via portal.
• Auto-setup of secure
IP-level network Dev machines
between role instances Databases
and local machines.
Enterprise
Image courtesy Windows Azure Platform Training Kit
34. Tale of the Tape
Windows Azure Virtual
Network Windows Azure Service Bus
• IP connection between on- • Services running on-premises
premises and Windows or in Windows Azure
Azure role instances • Protocol connection (HTTP,
• Direct IP connection; Active HTTPS, NetTCP)
Directory domain-join • Nothing new (WCF and REST)
• Windows Azure Connect • Expose a (Intranet) service to
Agent the Internet
• Network connectivity • Take advantage of other
• Local database services
• Remote PowerShell • ACS (Facebook, Windows Live
• Network file share ID, etc.)
• Active Directory • Windows Azure Cache
35. Windows Azure Integration Services
Enhancements to the existing Windows Azure Service Bus
EAI Bridges
• Content-based routing rules
• Stages enable message validation, enrichment, and transform
• Send XML output via HTTP, Service Bus Topics/Queues, or other
bridges
• Receive XML via HTTP
Transforms
• Change XML structure between applications
• XSLT mapping tool . . . . A lot like BizTalk
36. Windows Azure Integration Services
Connect
• Enables cloud apps to securely communicate with LOB systems
(SAP, Siebel, SQL Server, Oracle, etc.)
EDI
• Trading Partner Management solution for EDI (B2B)
• Configure partners and create a B2B pipeline – deployed to
Windows Azure Service Bus
• Send EDI via HTTP, FTP, and AS2
• X12 and AS2 only (current CTP release)
Try it now at http://portal.appfabriclabs.com
37. Enabling the Hybrid Enterprise
Windows Azure
Windows Azure Service Bus
SB
S
COMPUTE STORAGE DATABASE
SERVICE SERVICE SERVICE SB
38. New Platform Services
Services
Service Bus/ Composite App
Caching Access Control Integration
Messaging [Workflow, Web Services]
.NET + Platform Services
Composition
Management
Model &
Tools
Container
SQL Azure SQL Server
Windows Windows
Azure Server
39. How to Get Started
WindowsAzure.com – 90 days
free!
http://bit.ly/MikeAzureTrial
Activate MSDN benefits
Install SDK via Web PI
Windows Azure Training Kit
Windows Azure Developer Center
40. Resources
• Windows Azure Platform Training Kit
– http://bit.ly/hb7om9
• Windows Azure Boot Camp
– http://www.WindowsAzureBootCamp.com
• Windows Azure Service Bus
– http://www.windowsazure.com/en-us/home/features/service-bus/
• Rick Garibay’s Blog
– http://rickgaribay.net/
• Windows Azure Service Bus Samples
– http://servicebus.codeplex.com
• Windows Azure Queues and Windows Azure Service Bus Queues - Compared and Contrasted
– http://msdn.microsoft.com/en-us/library/windowsazure/hh767287(d=default,v=vs.103).aspx
• Neudesic Cloud
– http://cloud.neudesic.com/
• Neudesic Connected Systems
– http://www.neudesic.com/What/Expertise/Pages/ConnectedSystems.aspx
41.
42. My Sessions at DevLink
What’s New in Windows Azure
Wednesday. 10:15am – 11:30am
Conv. Ctr. – 12 (Orasi)
The Hybrid Windows Azure Application
Thursday. 9:30am – 10:45am
Conv. Ctr. – G (Pearson)
Using Windows Azure for Solving Identity Management
Challenges
Friday. 9:30am – 10:45am
Conv. Ctr. – G (Pearson)
Notas del editor
Windows Azure National ArchitectWindows Azure MVPHelp customers nationwide with their Windows Azure projects. This can include architectural design sessions, training, development, evangelism, etc.Reach me via email, Twitter, or my blog.
Not Pictured- Virtual Machines- Web Sites
Evolution – Services, Big Data, and Distributed ComputingWhat’s old is new again.In many ways the model we employ now with cloud computing is similar to the mainframe- Break big tasks into small job- Utility computing – pay for what you use
There are a number of technology disruptors that we’ve witnessed over the last decade.Each of this disruptors has brought with it new innovation in the application platform space, almost as a mirror effect to each disruptor. This perfect storm provides a tremendous opportunity for organizations seeking to deliver more robust, agile enterprise solutions to their customers.
More and more midsize and large organizations are looking at systems composed of various components, both on-premises and in the cloud.In fact, Gartner states that .. .http://neuportal.neudesic.com/Tech/EAI/Document%20Library/Sales/Research/Gartner/APN25_F2%20apn25_f2.pdf
More services == more agilityImprovements – networking and virtualization technologiesInstead of a single massive product, take the best of perhaps many smaller products. Location less important.
Cloud is not a silver bulletNot a solution for every problemIf you have something that works today (technically and for the business), then what is the motivation to move to the cloud? What’s the value to be gained?Windows Azure Training Kit
There are some solutions that maybe don’t make sense in the cloudTechnology or business.Is the cloud really cheaper?Find what fits, what provides a clear technical or business advantage – move those.Windows Azure Training Kit
Security is one of the top concerns when it comes to ‘the cloud’Overhyped in some ways – a knee jerk reactionDue your due diligenceUnderstand and then make a decisionMicrosoft Office clipartWindows Azure Training Kithttp://www.istockphoto.com/stock-photo-16376100-secure-cloud-computing.php?st=1bf5460
PCI – Not yetHIPAA – Recently announced for Windows AzureWindows Azure Training Kithttp://www.istockphoto.com/stock-photo-16664378-credit-card-chained-with-padlock-isolated-clipping-path.php?st=b493bedhttp://www.istockphoto.com/stock-photo-4391261-medical-records-theft.php?st=b493bed
Windows Azure Training Kit
Windows Azure Training KitSpeaking NotesNetwork topology agnosticSpecifically designed to traverse NAT and Firewall devices EventingEfficient Pub/Sub style messagingHigh performance one way broadcast communicationsSupports disconnected modes through the use of temporary message buffersService remotingExtend web services to the cloudHandle WCF semantics seamlesslyBroad support for WS-* protocolsSome are merely passed throughSome influence the SB operationTunnellingAd hoc private networkTunnel raw names Pipes or TCP sockets over the internetCan tunnel complex protocols over simple protocolsE.g. Tunnel SQL Server named pipes when only outbound HTTP is availableNoteshttp://blogs.msdn.com/b/brunoterkaly/archive/2010/01/01/azure-service-bus-intro-to-eventing-in-the-app-fabric-project-weather-cloud.aspx
TTL on SB Queues is not system enforced like Windows Azure queues.Publisher could be a phone app, on-premises system, etc.Receiver could be another on-premises app (maybe another location) or a cloud worker role.
No need to build your own identity management Another component to maintainLikely not a distinguishable part of your applicationDeal with user managementUser supportPassword management (including resets)AuthenticateWindows Identity Foundation (WIF)OAuth and WS-FederationAuthorizeClaims-basedIdentity ProvidersCorporate via Active Directory (ADFSv2)SocialWindows Live, Yahoo!, Google, FacebookBuild your own using membership (identityserver.codeplex.com)Write to ACS and let Microsoft worry about the rest
Options- AD On-Premises- AD in the Cloud (Replicated)- AD in the Cloud Only
Setup & managementWindows Azure Service ModelWeb, Worker, & VM Roles* Windows Azure Platform Training Kit
Windows Azure Training KitAuto-setup of secure IP-level network between role instances and local machines.Tunnel firewalls/NATs through hosted SSL-based relaySecured via end-to-end IPSecDNS name resolution
Connect cloud applications via message routing rules, protocol bridging, message transformation services & connectivity to on-prem LOB systems.http://msdn.microsoft.com/en-us/library/windowsazure/hh689864.aspxSDK and samples: http://go.microsoft.com/fwlink/?LinkID=184288Tutorials and documentation: http://go.microsoft.com/fwlink/?LinkID=235197http://www.infoq.com/news/2012/01/azure-eai
Connect – Service Bus Relay + BizTalk AdaptersEDI – Trading Partner ManagementSome of the challenges that customers face while opting for a B2B solution are:Total cost of ownership (TCO) for setting up a B2B solution, especially for the small and medium business (SMB) shopsHigh maintenance cost for the B2B solutions including onboarding partners, managing pipelines, etcOnce the message is received, it will be processed by the B2B pipeline deployed on the cloud and will be routed to the destination configured in the B2B pipeline.
Windows Azure Queues and Windows Azure Service Bus Queues - Compared and Contrasted