Overview of the Openstack architecture and the Reddwarf Architecture.

1. OpenStack
& Reddwarf
Prepared for: Austin Cloud Users Group
Date: August 20th, 2012
Craig Vyvial
https://github.com/hub-cap/reddwarf_lite

2. Agenda
‣ Overview
‣ OpenStack Architecture
‣ Reddwarf Architecture
‣ Developer vs Deployer
‣ Demo?
‣ Questions

3. Overview

4. OpenStack Founding Principles
‣ Apache 2.0 license (OSI), open development process
‣ Open design process, 2x year public Design Summits
‣ Publically available open source code repository
‣ Open community processes documented and
transparent
‣ Commitment to drive and adopt open standards
‣ Modular design for deployment flexibility via APIs

5. OpenStack Community
‣ User groups across the world
‣ Events
‣ Design Summit, Conference, and Meetups
‣ Contribute
‣ Documentation, Design, or Code
‣ Over 180 Companies

6. OpenStack Contributions
‣ Launchpad.net (Bugs/Blueprints)
‣ Code reviews (gerrit)
‣ Unit Tests
‣ Integration Tests
‣ Jenkins jobs with gates

7. Benefits of a Common Platform
‣ Common API contract for public/private cloud
‣ Easy to migrate to public when needed
‣ No vendor lock in with a single provider
‣ Run on commodity hardware

8. OpenStack Platform
‣ Python
‣ Did I mention open source?
‣ github.com/openstack

9. OpenStack Architecture

12. Keystone Identity Service
‣ Provides Identity, Token, Catalog, and Policy Services
‣ Authentication / Authorization
‣ Validation
‣ User management
‣ Project / Tenant management
‣ Service management

14. Glance Service
‣ VM Image Service for nova-compute
‣ Manage and deploy images
‣ Backend storage of images can be anything
‣ File based
‣ Swift
‣ S3
‣ Multiple Image Formats
‣ AMI / raw / iso / qcow / etc.

16. Nova APIs
‣ Rest based
‣ json/xml
‣ OpenStack Compute API
‣ Management API
‣ EC2 API
‣ Dashboard (Horizon)

19. Message Bus
‣ Backbone of system
‣ Message routing between
services
‣ Generic API to send messages
‣ Multiple drivers supported
‣ RabbitMQ
‣ ZeroMQ
‣ Qpid

21. Nova Database
‣ MySQL Server
‣ Stores all OS system data
‣ Instance info
‣ Network info
‣ Node info
‣ Python library SQL-Alchemy
ORM
‣ SQLite for unit testing
‣ Other relational databases

23. Nova-Scheduler Service
‣ Determines the placement of new resources requested via the API
‣ Modular architecture to allow for optimization
‣ Base Schedulers include
‣ Round Robin
‣ Filter Scheduler
‣ Spread First
‣ Fill First
‣ Chance (random)

25. Nova-Compute Service
‣ KVM
‣ QEMU
‣ Xen/Xen Server
‣ VMWare ESX/ESXi
‣ LXC
‣ OpenVZ
‣ HyperV

27. Nova-Network Service (Quantum)
‣ Provides network connectivity as a service
‣ Programmable networking
‣ Open vSwitch
‣ Nicira Network Virtualization Platform (NVP)
‣ Linux Bridge
‣ Ryu OpenFlow Controller
‣ On Demand creation of rich L2 + L3 topologies
‣ Quantum is the core project that came from this service

29. Nova-Volume Service (Cinder)
‣ Provide a Block Storage Service
‣ Create / Delete / Connect volumes to running
instances via iSCSI
‣ Drivers available
‣ LVM / iSCSI
‣ Multiple SAN drivers
‣ Ceph
‣ Cinder is newly formed core project

30. Platform as a Service
Reddwarf Architecture

31. Reddwarf Architecture

32. Reddwarf Architecture

33. Reddwarf API
‣ Rest Based
‣ Json/xml
‣ Create / Delete / Actions on Instance
‣ Extendable API
‣ Communication to the Guest Agent
‣ Keep API response fast (async)

34. Reddwarf Architecture

35. Reddwarf Task Manager
‣ Long running processes
‣ Create / Delete / Resize Instance
‣ Setting status when ACTIVE
‣ Synchronous process

36. Reddwarf Architecture

37. Guest Agent (Sneaky-Pete)
‣ Reference Agent (python)
‣ Listens on the Message Bus
‣ Updates MySQL Status to DB
‣ Sets up and secures the MySQL instance
‣ Controls and manages the MySQL instance
‣ Low memory footprint

38. Developer vs Deployer

39. Developers
‣ Devstack is documented shell script to build a
complete OpenStack development environment.
‣ http://devstack.org
‣ Setup a fresh Ubuntu Precise (12.04) or Fedora
16 installation (VM)
‣ VMware/Virtual Box/etc.
‣ Clone devstack
‣ Deploy your OpenStack Cloud

40. http://www.rackspace.com/cloud/private/

41. We are hiring!
• California
• Austin
• San Antonio
• Virginia
• London
• Hong Kong
• Many other places

42. Questions?

45. Project Links
‣ Project Pages
‣ https://launchpad.net/reddwarf
‣ https://launchpad.net/~reddwarf-drivers
‣ Blueprint
‣ https://blueprints.launchpad.net/openstack-devel/+spec/openstack-dbaas
‣ http://wiki.openstack.org/DatabaseAsAService
‣ Code
‣ https://github.com/rackspace/python-reddwarf
‣ https://github.com/hub-cap/reddwarf_lite