RabbitMQ is a complete and highly reliable enterprise messaging system based on the emerging AMQP standard. It is licensed under the open source Mozilla Public License and has a platform-neutral distribution, plus platform-specific packages and bundles for easy installation. In this talk, Alexis talks on use cases for cloud messaging.What is messaging and why it is useful for cloud computing? This talk will answer these questions by way of illustrating use cases from RabbitMQ customers.

1. RabbitMQ at Skills Ma-er Cloud Exchange
Cloud Messaging Use Cases
April 2010
Alexis Richardson
VMware Inc.
copyright (c) VMware Inc.
Friday, 23 April 2010

2. Thank you!
RabbitMQ is a messaging server that just works
Im in yr serverz,
queueing yr messagez
Photo credit: http://flickr.com/photos/53366513@N00/67046506/
copyright (c) VMware Inc.
Friday, 23 April 2010

3. We es7mate 300‐500 or more in produc7on, >20K in dev
copyright (c) VMware Inc.
Friday, 23 April 2010

4. Using RabbitMQ is easy
RabbitMQ integrated with more Rabbit distributed by most Linux type plaForms
than 100 developer plaForms
RabbitMQ.NET and MicrosoO IVA partnership
We offer packages for many other OS plaForms
copyright (c) VMware Inc.
Friday, 23 April 2010

5. Using RabbitMQ is easy
RabbitMQ integrated with more Rabbit distributed by most Linux type plaForms
than 100 developer plaForms
RabbitMQ.NET and MicrosoO IVA partnership
We offer packages for many other OS plaForms
Cloud messaging is the future
45
5
Friday, 23 April 2010

6. Cloud has re‐energised IT
copyright (c) VMware Inc.
Friday, 23 April 2010

7. Cloud maIers because we operate at real 7me on a global scale
Mobile, video, presence, live streams - anywhere, anytime
How to deliver this without lock-in to any one platform or location?
Massive amounts of data everywhere and changing all the time
Security, privacy, consistency of customer experience eg latency, relevance
Cloud Messaging matters!
copyright (c) VMware Inc.
Friday, 23 April 2010

8. http://railsdog.com/blog/2009/12/generating-pdfs-on-ec2-with-ruby/
copyright (c) VMware Inc.
Friday, 23 April 2010

9. http://railsdog.com/blog/2009/12/generating-pdfs-on-ec2-with-ruby/
9
Friday, 23 April 2010

10. Cloud + Queues makes it easy to manage an ARMY of worker bots
copyright (c) VMware Inc.
Friday, 23 April 2010

11. We also care about SCALE ...
copyright (c) VMware Inc.
Friday, 23 April 2010

12. We also care about SCALE ... when we cannot predict demand
copyright (c) VMware Inc.
Friday, 23 April 2010

13. Cloud applica7ons are component based and need intra‐app messaging to scale
See more here: http://aws.typepad.com/aws/2008/12/running-everything-on-aws-soocialcom.html
copyright (c) VMware Inc.
Friday, 23 April 2010

14. Inter‐cloud applica7ons use inter‐applica7on messaging to route and deliver data
West NE Europe
Europe data centre
data centre
Southern
Europe
data centre
!
copyright (c) VMware Inc.
Friday, 23 April 2010

15. Inter‐cloud “secure network overlay” ‐ uses RabbitMQ under the covers
See http://www.cohesiveft.com/vpncubed/ copyright (c) VMware Inc.
Friday, 23 April 2010

16. PUBSUB at massive scale: “TwiIer for Data in the Cloud”
Service.DomainName
Region Virtual IP
Cloud IPs
DMAC
See: http://www.oceanobservatories.org/spaces/display/CIDev/Home
Friday, 23 April 2010

17. Pubsub? wZ?
copyright (c) VMware Inc.
Friday, 23 April 2010

18. At scale, coping
with changing
data can be a
problem
copyright (c) VMware Inc.
Friday, 23 April 2010

19. Social applica7ons store data
19 copyright (c) VMware Inc.
Friday, 23 April 2010

20. Social applica7ons store data
And thereʼs terabytes of it
20 copyright (c) VMware Inc.
Friday, 23 April 2010

21. Social applica7ons store data
And thereʼs terabytes of it
And itʼs in the cloud
21 copyright (c) VMware Inc.
Friday, 23 April 2010

22. Tell me when
THIS changes
copyright (c) VMware Inc.
Friday, 23 April 2010

23. Pubsub wins because Polling Sucks ... “Are we there yet?”, “Are we there yet?”, ..
Pubsubhubbub provides web pubsub
Pubsub Hubs are Cloud Messaging Technology
Check out RabbitHub on github for more info/code
Check out the Google teamʼs video at
http://www.youtube.com/watch?v=B5kHx0rGkec
copyright (c) VMware Inc.
Friday, 23 April 2010

24. Monitoring done wrong
copyright (c) VMware Inc.
Friday, 23 April 2010

25. Monitoring done right
copyright (c) VMware Inc.
Friday, 23 April 2010

26. Monitoring done right
See: Ben Hyde’s post at http://enthusiasm.cozy.org/archives/2009/02/listening-to-the-system
copyright (c) VMware Inc.
Friday, 23 April 2010

27. Monitoring done right
27 copyright (c) VMware Inc.
Friday, 23 April 2010

28. Monitoring done right
Lots more event processing goodness here: http://blog.cloudeventprocessing.com/
28 copyright (c) VMware Inc.
Friday, 23 April 2010

29. Pubsub gets you Monitoring ‐ and if you add Queues you get Logging
29 copyright (c) VMware Inc.
Friday, 23 April 2010

30. Recording informa7on is of fundamental human value
copyright (c) VMware Inc.
Friday, 23 April 2010

31. So what is messaging?
messaging is ‘data in moSon’ and it is really important
and ‘the move to cloud compuSng’ will put messaging everywhere
Messages
Pubsub
Queues
Log Storage
copyright (c) VMware Inc.
Friday, 23 April 2010

32. There are LOTS of cloud messaging technologies!
Email, Chat, Comet, BOSH, ..
SMS, Twitter, ..
SMTP, HTTP, XMPP, AMQP Messages Trading, Cash transfer
Routing, transforming, alerting
AMQP, HTTP PSHB, XMPP Pubsub eg SNS, ESBs and Esper CEP
Buffering, caching, filtering
AMQP, (XMPP) Queues eg SQS, Redis
Archiving + search
AMQP, NoSQL, SQL Log Storage eg Riak, Cassandra
copyright (c) VMware Inc.
Friday, 23 April 2010

33. Thank you!
... and RabbitMQ’s goal is to make all of this really simple
Email, Chat, Comet, BOSH, ..
SMS, Twitter, ..
SMTP, HTTP, XMPP, AMQP Messages Trading, Cash transfer
Routing, transforming, alerting
AMQP, HTTP PSHB, XMPP Pubsub eg SNS, ESBs and Esper CEP
Buffering, caching, filtering
AMQP, (XMPP) Queues eg SQS, Redis
Im in yr serverz,
AMQP, NoSQL, SQL Log Storage
Archiving + search
eg Riak, Cassandra
queueing yr messagez
Photo credit: http://flickr.com/photos/53366513@N00/67046506/
copyright (c) VMware Inc.
Friday, 23 April 2010

34. RabbitMQ
Towards a PLATFORM for Cloud Messaging
copyright (c) VMware Inc.
Friday, 23 April 2010

35. If cloud requires a Cloud OS, then is messaging the Cloud Bus?
copyright (c) VMware Inc.
Friday, 23 April 2010

36. For Infra, yes. Many clouds, eg NASA Nebula, have a RabbitMQ cloud bus:
Use cases: Inter‐VM chaIer
And lots of Management:
Request capacity
Start 100 VMs. Shut them down.
“I am overloaded”
“Find me ‐ who am I?”
“Move me”
“Back me up”
Scale back capacity
copyright (c) VMware Inc.
Friday, 23 April 2010

37. That’s great but we also need a PLATFORM if we are to deploy and run apps
SaaS
cloud applications
PaaS
eg RabbitMQ on Heroku
IaaS
eg Rabbit at NASA
copyright (c) VMware Inc.
Friday, 23 April 2010

38. PlaZorm as a service example: Heroku!
SaaS
cloud applications
PaaS
eg RabbitMQ on Heroku
IaaS
eg Rabbit at NASA
copyright (c) VMware Inc.
Friday, 23 April 2010

39. Conceptually: a plaZorm represents freedom from complexity
App App App
IaaS infra is hidden
Scalable cloud bus ‐ run as many as you like
(Rabbit is open source and can run on any
cloud as its ‘central nervous system’)
copyright (c) VMware Inc.
Friday, 23 April 2010

40. Pubsub is made simple ‐ like apps twee7ng at each other!
App App App
“hey” “hey” “hey”
copyright (c) VMware Inc.
Friday, 23 April 2010

41. Queues are easy too
App App App
“hey”
“hey”
copyright (c) VMware Inc.
Friday, 23 April 2010

42. Queues are easy too
App App App App
“hey”
copyright (c) VMware Inc.
Friday, 23 April 2010

43. By being 100% open ‐ we can also do intercloud just as simply!
Intra-App Intra-Cloud Inter-Cloud
Rabbit Cloud Rabbit Cloud Rabbit Cross-cloud
PaaS Service Service Services
Rabbit inside the RabbitMQ as infra: Federated
IaaS Cloud VM “Cloud Bus” RabbitMQ
copyright (c) VMware Inc.
Friday, 23 April 2010

44. To bridge private and public clouds, open source and open standards are best
SAY NO TO
CLOUD
LOCK IN
44 copyright (c) VMware Inc.
(CC) Giara @flickr.com
Friday, 23 April 2010

45. Summary ‐ clouds break the link between applica7on and loca7on
Can’t predict where apps and VMs are running
Can’t predict scale
Design for DATA IN MOTION
In motion VMs need PUBSUB and ROUTING like with cell phones
VMs suspended or offline need QUEUES
Messaging lets you ‘dial up’ VMs and broadcast changes safely
copyright (c) VMware Inc.
Friday, 23 April 2010

46. Solu7on ‐ RabbitMQ is the open cloud messaging plaZorm
Fantastic community support for messaging intra app
Language neutral open protocols for messaging inter app
Federation - bridge private and public ‘intercloud’
Cloud Bus for IaaS
Messaging PaaS
copyright (c) VMware Inc.
Friday, 23 April 2010

47. Solu7on ‐ RabbitMQ as an open cloud messaging plaZorm
We’ll manage messaging for you
Scalable, easy to use
Completely portable - no lock in
Pre-provisoned - zero install, pay as you go, self-service
Latency is low: Application logic and data are CO-LOCATED
WIN
copyright (c) VMware Inc.
Friday, 23 April 2010

48. Rich Wolski, CTO and Founder, Eucalyptus
“pre-y much everything you own is going to be trying to send you data”
Stefan Norberg, Chief Architect, Unibet
“If you remove the need to invest in infrastructure, the need to train people
on the operaSonal aspects and then get excellent scalability and low latency
guaranteed by contract, I’d buy it in a second. Who will provide me with the
Real Time Web as a service?”
copyright (c) VMware Inc.
Friday, 23 April 2010

49. Thank‐you
Email: alexis@rabbitmq.com
Get started: h-p://www.rabbitmq.com/how.html
copyright (c) VMware Inc.
Friday, 23 April 2010