1. Embrace Cloud Computing with an
OpenStack-based Private Cloud
中小型组织如何拥抱云计算
刘希斌
Chief Architect
瞬联软件科技
CIeNET Technologies

2. 1. Challenges
我们面临的问题
CIeNET PROPRIETARY 9/2/2012 2

3. We face common IT problems with other SMEs!
About Us
• CIeNET Technologies （瞬联软件科技）
• A leading consulting and software company founded in 2000
• Telecom, enterprise, mobile & internet software development
• 1,900+ R&D engineers
Honors
• 2012 IAOP Global Outsourcing 100 Top 75 “Leader”
• 2011, 2010 and 2009 IAOP Global Outsourcing 100
• 2011 Diverse Supplier Development Program (Accenture)
• 2010 Minority Global Technology Firm of the Year (US DOC)
• 2011, 2010 and 2009 China Sourcing Top 100 (Gartner)
• 2009 and 2008 Top 100 China Software Export Enterprise
CIeNET PROPRIETARY 9/2/2012 3

4. What is
cloud
computing?
Can I make 什么是云计算？ What are
money from they doing
cloud with cloud
computing? computing?
我能利用云计算赚钱吗？ CTO 大家都用云计算做什
Questions 么？
???
Why do I need
What’s the
cloud
cost to
computing in
deploy cloud
our
computing?
organization?
What if I don’t
部署云计算很贵吗？ adopt cloud 我为什么需要云计算？
computing in
our
organization?
不部署云计算会怎么样？
CIeNET PROPRIETARY 9/2/2012 4

5. Several FACTS we discovered that you may not know about your
organization or also need to deal with …
We have a lot of computers （我们有很多机器）
• Server, Blade, Workstation, Desktop PC, Laptop PC
Computer resource utilization is low （每台机器的使用率很低）
• Average utilization < 10%
Old computers are idle （旧机器闲置）
• They are put aside rather than being utilized
Computer software installation is done manually （软件手动安装）
• Repetitive work (repeated installations) and added overhead for IT maintenance
We use a lot of commercial software licenses （好多商业软件！）
• It’s expensive
We’ve installed some virtualization software （已经尝试使用虚拟化软件）
• Not centrally managed
CIeNET PROPRIETARY 9/2/2012 5

6. Several CONSTRAINTS we are aware of which may also be your
constraints …
Lack disposable budget for new equipment （我们没有额外的预算）
• Economic slowdown and increased efficiency demands
Need for an increase in productivity and shorter TTM （需要提高效率缩短上市时间）
• Competition!
Reluctant to put all data in public cloud （数据暂时不想放在公有云里）
• Security and IPR concerns and not ready for it yet
Limited bandwidth for IT department （IT部门的工作已经非常饱和）
• It’s all about cost
Need rich applications for collaboration （企业协作需要更多的应用）
• Enterprise 2.0 …
CIeNET PROPRIETARY 9/2/2012 6

7. 2. Solution
简单易行的解决方案
CIeNET PROPRIETARY 9/2/2012 7

8. Storage Service
Development
and Deployment
Platform
Virtual
Machine
Management Enterprise
(Computing) Applications
CIeNET PROPRIETARY 9/2/2012 8

9. Why OpenStack?
Open Active Easy Popular
CIeNET PROPRIETARY 9/2/2012 9

10. Embrace Cloud Computing: A Strategic Plan
（拥抱云计算策略）
提供云服务
使用云服务 Provide cloud-
based services to
开发环境 Deploy and use public
cloud-based
IT 基础设施 Develop/test with services
cloud platform
CIeNET PROPRIETARY 9/2/2012 10

11. 3. Practices
我们的实践
CIeNET PROPRIETARY 9/2/2012 11

12. Guideline: Don’t Over-Engineer in the Beginning
初始阶段不要过度设计
 We don’t buy extra hardware: 没有购买新硬件
 Not all applications need a powerful CPU and large memory to support
high transaction rates.
 We haven’t implement HA：暂不实施高可用
 Not all applications need 24x7 availability.
 We only backup data for controller nodes: 仅备份控制节点
 Not all data need extremely high security.
 We don’t engineer for extremely concurrent usage of all users:
不考虑所有用户同时使用等极端情况
 Not all user will use the system at same time
CIeNET PROPRIETARY 9/2/2012 12

13. Re-use Resources
已有资源利用
 High End Computers: 少数“中高端”机做控制节点和计算节点
 Control Node and Computing Node
 EG:
 DELL R510, Xeon E5 2420 1.9G, 16G RAM, 500G * 7, 1Gb NIC
 HP DL380, 2 4-core Intel® Xeon® X5550，16GB RAM，1Gb NIC
 Low End Computers: 大量普通机器做存储
 Storage
 EG：
 DELL 980/990, Intel i5 3.20GHz 4G RAM 500G * 4, 100Mb NIC
 DELL 320, Intel Core2 1.80GHz 2G RAM 80G * 10, 100Mb NIC
CIeNET PROPRIETARY 9/2/2012 13

14. The Infrastructure
我们搭建的基础设施
Users
OpenStack IaaS Software
Virtualization
KVM KVM
KVM
Compute Node Storage Node
CIeNET PROPRIETARY 9/2/2012 14

15. Controller:
HP DL380
Computer:
DELL R510／
Storage:
980
DELL 980/990
／320
CIeNET PROPRIETARY 9/2/2012 15

16. Software Version: 软件版本
 Ubuntu 12.04 64-bit
 Virtualization: QEMU-KVM-1.0
 Openstack Essex Release
 Controller
 nova-network nova-api nova-volume
 Compute Node
 nova-network nova-api nova-compute
 Storage
 Swift Proxy, Swift Object, Swift Container, Swift
CIeNET PROPRIETARY 9/2/2012 16

17. Beyond OpenStack: Put Development
Platform Inside 整合内部开发平台
 Make internal development and testing environment as a
standard image.
 Developers can now easily access a development environment
with just the push of a button. All dependent software is
included. （开发者点击鼠标就能获得想要的开发环境）
 Make environment management very easy.
Java Dev. Env.
Android Compile
Env.
Dev. Config.
Management
Auto Test Framework
CIeNET PROPRIETARY 9/2/2012 17

18. Beyond OpenStack: Develop Enterprise Net
Disk Module 开发企业网盘模块
CIeDISK Module SaaS Software
OpenStack IaaS Software
Virtualization
KVM KVM
KVM
Compute Node Storage Node
CIeNET PROPRIETARY 9/2/2012 18

19. CIeDISK Module: 我们开发的企业网盘－”瞬盘”模块
 User File Management 基于用户的文件管理
 Group Sharing 群组分享
 Multiple Files Upload 多文件上传
 Online Photo Gallery 在线照片库
 MAC/Windows/Tablet Clients 多客户端
CIeNET PROPRIETARY 9/2/2012 19

20. Planning 规划
 Computers
 Floating IP addresses
 Allocate enough floating IP addresses for virtual machines
 Some issues we met
 Partitioning:
 We should give var and tmp partitions a large amount of space
since var is used for instance disk and tmp is used for snapshot
generation
CIeNET PROPRIETARY 9/2/2012 20

21. Installation 安装
 Manual Installation
 With modified OpenStack installer script
 Chef/Puppet/JUJU are not used
CIeNET PROPRIETARY 9/2/2012 21

22. Network 网络
 Network Manager: VLAN
 We use 100Mb NIC
 Issues we met:
 If floating IP and fixed IP are in same subnet, NAT translation will fail
 Some defects we met (but resolved in latest releases):
 Floating IPs are not released
 How: Terminate an instance and show floating lists
 Resolve: Clean the floating IPs timely
 Floating IP List shows Missing Instance
 Reason: Delete zombie instance from database
 Resolve: Set the delete status
CIeNET PROPRIETARY 9/2/2012 22

23. Volume 卷
 To save user data after VM is terminated
 Controller node needs to have enough disk space
 Some defects we met:
 Can't create new volume:
 According to the official document, tgt and iscsitarget should both
be installed and started, but actually, they are conflicting services
 Resolve: Stop iscsitarget
CIeNET PROPRIETARY 9/2/2012 23

24. Resource Quota 资源限额
 Balance between user needs and system performance
 The limits we set:
 Virtual Machine:
 Provide limited flavors: (CPU/RAM/Root Disk)
cloud.large 2 1024 0
cloud.small 1 512 0
TAS.large 2 2048 15GB
TAS.small 1 1024 15GB
 Storage:
 Per user quota: 1GB
 File Size: < 50MB
CIeNET PROPRIETARY 9/2/2012 24

25. Filtering and Scheduling 结点选择
 Chance: With this method, a compute host is chosen
randomly across availability zones
 This is the default configuration, but will easily cause the system
to be overloaded
 Simple: With this method, hosts whose load is least are
chosen to run the instance
 Choose this configuration
CIeNET PROPRIETARY 9/2/2012 25

26. OA&M 监控管理
 Zenoss
 Physical node level, not inside VM
CIeNET PROPRIETARY 9/2/2012 26

27. Operation Results 内部运营效果
 Launched and running internally
 Hardware resource utilization
 10%  60%
 Re-used old idle hardware
 New development machine launch efficiency improved
 4 hours  10 minutes
 File/Picture sharing
 Transactions increased by 30X quarterly
 Personal space utilization
 Average: 10%
CIeNET PROPRIETARY 9/2/2012 27

28. OpenStack-based Infrastructure Summary
关键点
 OpenStack + New Modules + Customizations
OpenStack + 新开发模块 + 定制化
 Low cost 低成本
- Open source
- Re-use existing, under-utilized hardware and old PCs
 Manageable 可管理
- Easy, Private, Secure, Full Control, and Extensible
CIeNET PROPRIETARY 9/2/2012 28

29. 4. Moving to the Next Stage
未来展望
CIeNET PROPRIETARY 9/2/2012 29

30. OpenStack-based Feature Development
继续基于OpenStack开发内部云功能
 More features will be implemented depending on the
needs: 添加功能
 High Availability
 LDAP integration (Single Sign-On)
 OA&M
 Auto Installation
 System growth with more servers
 Deploy PaaS (Cloud Foundry) and Provide Server Running
Environment 部署内部“平台即服务”
CIeNET is the pioneer of doing development around Cloud
Foundry and extending Juju for cloud software deployment
CIeNET PROPRIETARY 9/2/2012 30

31. OpenStack-based Mobile Office &Collaboration
移动办公与协作
 The future working environment 未来的办公环境展望
 Everything is in the cloud 存储在云端
 Mobile 移动化
 Sharing among groups 基于群组的分享
 Our groupware on PC and mobile devices 群组软件
 Group task management software has been developed and is
in alpha release now 群组任务管理
 Share everything in a mobile environment 分享任何东西
 License sharing in the cloud
CIeNET PROPRIETARY 9/2/2012 31

32. Our Private Cloud 我们的企业私有云全景
Users
Developers
Portal
Collaboration CIeDISK … SaaS Software
PaaS Software Cloud Foundry
OpenStack IaaS Software
Virtualization
KVM VMware
Xen
Virtual Machine Nodes Storage Node
CIeNET PROPRIETARY 9/2/2012 32

33. Contribute to the Community 回报社区
 We realized that more features are required 功能缺失
from OpenStack and we would like to work on it:
 OpenStack monitor module
 Instance resource extension
 Define flavors for different projects
 Embedded HA
 Server usage report/statistics
 CIeNET has started submitting bug fixes to the OpenStack
Open Source Project 开始代码提交
 We would like to share more and partner with all community
participants 与所有社区参与者合作共享
CIeNET PROPRIETARY 9/2/2012 33

34. Thank You!
Contact Us:
Weibo:
刘希斌： @LiuXibin
孙琦： @RaySun
瞬联软件: @CIeNET
CIeNET:
business@cienet.com.cn
CIeNET PROPRIETARY 9/2/2012 34