This was a presentation I gave at the second Minnesota OpenStack Meetup. The presentation goes over a background on Open Source Cloud and Virtualization Technologies, and then does a relative deep-dive into OpenStack, with a focus on Quantum.

1. Kyle Mestery
Office of the Cloud CTO, Cisco
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 1

2. © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 2

3. © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 3

4. • Linux
Red Hat
Fedora
Ubuntu
• Hypervisor
KVM
Xen
• Virtual Switching
Open vSwitch
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 4

5. • Host Management
libvirt
• Infrastructure as a Service Orchestration
OpenStack
CloudStack
oVirt
Eucalyptus
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 5

6. • Platform as a Service
Cloud Foundry
OpenShift
• Cloud Orchestration
Aeolus
Heat APIs (open source implementation of Amazon Cloud Forms APIs)
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 6

7. • DevOps #ftw!
• Automation Options
Puppet
Chef
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 7

8. Applications! Yay to applications!
Automation DevOps at scale!
Cloud Foundry or OpenShift PaaS for the masses!
OpenStack or CloudStack or Eucalyptus or oVirt IaaS for the masses!
Linux (Fedora, Ubuntu, Red Hat, etc.)
At the heart of all of this …
Xen or KVM
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 8

9. Applications! Yay to applications!
Automation DevOps at scale!
Cloud Foundry or OpenShift PaaS for the masses!
OpenStack or CloudStack or Eucalyptus or oVirt IaaS for the masses!
Linux (Fedora, Ubuntu, Red Hat, etc.)
At the heart of all of this …
Xen or KVM
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 9

10. What is OpenStack?
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 10

11. OpenStack Mission
“To produce the ubiquitous open source cloud
computing platform that will meet the needs of
public and private cloud providers regardless of
size, by being simple to implement and
massively scalable.”
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 11

12. OpenStack Technology
Today (Folsom release)
• Compute Service (Nova)
• Object Storage Service (Swift)
• Image Service (Glance)
• Identity Service (Keystone)
• Dashboard (Horizon)
• Network Service (Quantum)
Also Releases
• Load Balancer Service (proposed) • Cactus (Q1 2011)
• Database Service (proposed) • Diablo (Q3 2011)
• Heat API (AWS CloudForms compatible) • Essex (Q1 2012)
• Ceilometer monitoring and metering (proposed) • Folsom (Q3 2012)
• Grizzly (Q1 2013)
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 12

13. OpenStack Compute Key Features
REST-based API
Asynchronous eventually
consistent communication
Horizontally and massively
scalable
Hypervisor agnostic: support
for Xen ,XenServer, Hyper-V, KVM, UML and
ESX
Hardware agnostic: standard
hardware, RAID not required
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 13

14. OpenStack Object Storage Key Features
REST-based API Data distributed evenly throughout system
Scalable to multiple
petabytes, billions of objects
Account/Container/Object structure (not file
system, no nesting) plus Replication (N copies of
accounts, containers, objects)
No central
database
Hardware agnostic: standard hardware, RAID not
© 2010 Cisco and/or its affiliates. All rights reserved.
required Cisco Confidential 14

15. OpenStack Community
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 15

16. OpenStack Quantum
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 16

17. • Advantages of cloud computing
On-demand virtualized resources, self-service, lower cost
Resources managed by others
• Ability to create your own isolated private networks
• Extensible
• Challenge!!
Easy-to-use
Minus the complexity of the traditional data center Quantum
Should work with different networking infrastructure Network Service
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 17

18. • Compute service (EC2): virtual machines
App Svr
• Specify vCPU, Memory, Disk OS
• Launch instance (image, mem_size, disk) VM
• Suspend, clone, migrate
• Storage service (S3, EBS): virtual disks
• Specify storage amount, access rights
• Store object
• Create/attach block
• What to do about networks?
Simplistic implementation
Embedded in the compute component
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 18

19. 2011 Design Summit
- community-driven merger of proposals
… more
NetworkService NaaS Core Design
NetworkServicePOC NetworkContainers
Citrix/Rackspace/Nicira Intel
NTT/Midokura Cisco
Quantum
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 19

20. • Compute service (EC2): virtual machines
App Svr
• Launch instance (image, mem_size, disk) OS
• Suspend, clone, migrate VM
• Storage service (S3, EBS): virtual disks
• Store object
• Create/attach block
• Network service (Quantum): virtual networks App Svr
OS
App Svr
OS
• Create/delete private network VM VM
• Attach VM to network resource
• Work with different networking environments
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 20

21. Quantum Virtual Network Service:
A first class citizen in cloud computing
Portal
(Horizon)
Applications Other
Services
Cloud Platform - Developer API
Compute Storage Network Identity
(Keystone)
(Nova) (Swift) (Quantum)
Servers Disks Networks Images
(Glance)
Folsom Release
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 21

22. Quantum Abstractions
 Virtual Networks:
 A basic dedicated L2 network segment
 Common realization is a VLAN
 Virtual Ports:
 Attachment point for devices connecting to virtual networks.
 Ports expose configuration and monitoring state via extensions (e.g., ACLs, QoS
policies, Packet Statistics)
 Subnets (new in v2):
 An IPAM construct to store CIDR
 Also allows to set the Gateway IP and host routes
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 22

23. Quantum Plugins & Extensions
 Plugin:
 Realization of the Quantum abstractions
 Supports different back-end technologies and vendors
 One plugin per Quantum deployment (there could be sub-plugins managed by
the main plugin)
 Examples: Linux Bridge Plugin, OVS Plugin, Cisco (Nexus)
 Extensions:
 API Extensibility for new or back-end specific features
 Example: Port-profiles, quality-of-service, etc.
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 23

24. Quantum Plug-in Architecture
Quantum Service API API Extensions
Quantum API & Extensions Framework
Quantum Plug-in Framework
Cisco Network Plugin
Cisco Device Managers
Cisco Compute & Networking Infra
• Switching portfolio (Nexus 3k/5k/7k)
• Unified Computing System
• Routing portfolio (e.g. ASR, CRS)
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 24

25. Plugins and Drivers
 Plugin:
 A plugin registers to handle all Quantum API calls (e.g., all network/port calls)
 Plugins may make decisions that are technology, but not device-specific
(e.g., mapping quantum network ‘HR’ to VLAN 100)
 There needs to be a master entity making/resolving decisions in a
deployment, that entity is the plugin
 Drivers:
 The plugin may use drivers to communicate the results of this decision to
different devices (e.g., it may configure the VLAN on a port on a virtual switch
port, and also tell the upstream physical switch to trunk that VLAN)
 Configurable components which can be shared/reused
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 25

26. Extending Quantum to support L3 Constructs
 Routing within the Further evolve Quantum to be a multi-tenant network service for
creating virtual data centers (application specific topologies + network
tenant (support multi- services)
tier topologies)
 Overlapping IP
addresses
 Support gateways –
Internet, VPN
 Support other L3
services –
LB, Firewall, Caching,
etc.
 Hybrid Cloud (Public +
Private)
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 26

27. Why is Quantum important to
OpenStack?
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 27

28. Current Infrastructure-as-a-Service has Challenges
Developer API
• Only provides basic Network
Connectivity.
Compute Storage • Difficult to create N-tier apps.
Service Services
User and
System • Limited ability for applications to
(VMs, Memory, (Block, Massive
Local Disk) Key-value Admin take advantage of network
store) services.
Servers Disks Accounts
Basic Network Connectivity
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 28

29. Network Services Enable Developer Solutions
Developer API
Network APIs
Compute Storage
Network
Service Services
Services
User and
(VMs, Memory, Lo (Block, Massive System Admin
(Subnets, Network
cal Disk) Key-value store)
Svcs, Security)
Virtual
Servers Networks Disks
Network Connectivity
 Create-network(“L2”)
 Attach-vm-to-network(vnet-a)
 Attach-service-to-network(vnet-b)
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 29

30. Open Source Is Where “Standard” Cloud Infrastructure Will
Be Defined
[O]pen standards [require] multiple
providers, access to code and data, [and]
interoperability of services. Whilst open
standards provide part of the solution, it is
critical…that a common reference model (i.e.
running code) is provided.
[T]he obvious solution is an open source
reference model as the standard. Potential
examples of such would be the OpenStack effort.
-Simon Wardley, CSC
From “A Question of Standards”
http://blog.gardeviance.org/2011/04/question-of-standards.html
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 30

31. Applications! Yay to applications!
Automation DevOps at scale!
Cloud Foundry or OpenShift PaaS for the masses!
OpenStack or CloudStack or Eucalyptus or oVirt IaaS for the masses!
Linux (Fedora, Ubuntu, Red Hat, etc.)
At the heart of all of this …
Xen or KVM
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 31

32. X 1000 =
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 32

33. © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 33

34. © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 34

35. • Designed to assist with configuration and management of systems
• Automates deployment
• Automates configuration
• Automates management
• Written in Ruby
• How does it do this?
Declarative language
Puppet: Manifests
Chef: Recipes or cookbooks
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 35

36. • OpenStack automation can be achieved using both Puppet and Chef
Active development and community around both
Cisco is actively participating and contributing to Puppet at the moment
Chef integration is planned
• These technologies are critical to successfully deploying an OpenStack IaaS cloud at
any sort of realistic scale
Replicating configuration by hand is doomed to failure
Replicating things with custom scripts is doomed to not scale
Replicating things with Puppet/Chef allows for advanced, scalable configuration management
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 36

37. • What is Cisco doing around OpenStack and Automation?
• Working closely with Puppet Labs to enable Puppet manifests for deploying OpenStack
on Cisco equipment
UCS B-Series and C-Series Compute
Nexus Switches
• All of these manifests are available on the Cisco github
Allows partners and customers to fully take advantage of this advanced automation
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 37

38. © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 38

39. © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 39

40. • Demonstrate flexible VM communication using open source technologies
• Applications (running in tenants running VMs) should not know or care about underlying
technologies
Flexible, isolated network segmentation utilizing OpenFlow and GRE tunnels
Applications just want to communicate
Think the standard 3-tier web app deployment … but at huge scale
“If they have to think about infrastructure, we’ve failed.”
• All orchestrated by software
Hint: SDN
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 40

41. • OpenStack
Nova: Compute manager
Glance: Image management
Quantum: Network service
• Open vSwitch
An open source virtual switch
Uses GRE tunnels for tenant isolation (also possible to use VXLAN)
• Ryu Network Operating System
Open Source OpenFlow controller
Works with Quantum as a plugin to setup flows for VM communication
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 41

42. • OpenStack
Using devstack on Ubuntu 12.04
Nova, Glance, and Quantum
• Open vSwitch
Top of tree (pre 1.9 release)
• Ryu Network Operating System
OpenFlow Controller plus Quantum Plugin
• All of this is running as VMs on the Macbook Pro I’m using for the preso
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 42

43. OpenStack Control Node + Compute OpenStack Compute
1. VMs are started, VIFs are plugged in
2. Ryu sets up flows for VM1 to VM2
communication
3. Ryu sets up GRE for VM1/VM2 to VM3
communication
OpenStack 4. VM1 pings VM2
Components 5. VM1 pings VM3 over GRE
6. Application developer is very happy!
Nova VM1 VM2 VM3
OpenStack
Components
Glance
Nova
Quantum
Ryu Ryu
Controller Open Agent Open
vSwitch vSwitch
VXLAN
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 43

44. © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 44