Sharing our expertise building OpenStack infrastructure in AllegroGroup. Original author of the presentation: Piotr Siwczak, Systems Architecture Engineer @ AllegroGroup

1. 07-09.10.2011 OpenStack in AllegroGroup 1

2. 07-09.10.2011 OpenStack in AllegroGroup 2 PiotrSiwczak / Tomasz ‘Zen’ Napierała Systems Architecture Engineers Infrastructure Department OpenStack in AllegroGroup

3. 07-09.10.2011 OpenStack in AllegroGroup 3 Cloudcomputingis not…

4. 07-09.10.2011 OpenStack in AllegroGroup 4 …overclockingyour CPU (untilitstartsburnin’)

5. 07-09.10.2011 OpenStack in AllegroGroup 5 …a way to socializearoundyourcomputer

6. 07-09.10.2011 OpenStack in AllegroGroup 6 Imagine your website gets high traffic

7. 07-09.10.2011 OpenStack in AllegroGroup 7

8. 07-09.10.2011 OpenStack in AllegroGroup 8 „Captain - there’s no chance we can get the site back online with so few servers… Too many users are hogging us out there!”

9. 07-09.10.2011 OpenStack in AllegroGroup 9 Facepalm one

10. 07-09.10.2011 OpenStack in AllegroGroup 10 Facepalmtwo We need addional 500k for servers… The boss Just to stand a 7-day marketing campaign???

11. 07-09.10.2011 OpenStack in AllegroGroup 11

12. The sysadmin 07-09.10.2011 OpenStack in AllegroGroup 12

13. Facepalmthree 07-09.10.2011 OpenStack in AllegroGroup 13 Looking at the clock

14. 07-09.10.2011 OpenStack in AllegroGroup 14 + =

15. 07-09.10.2011 OpenStack in AllegroGroup 15 Double facepalm!!!

16. 07-09.10.2011 OpenStack in AllegroGroup 16

17. 07-09.10.2011 OpenStack in AllegroGroup 17 It’s simple as hell! Next time, when your traffic goes up, use The Cloud.

18. It’s all about… 07-09.10.2011 OpenStack in AllegroGroup 18

19. …scalability 07-09.10.2011 OpenStack in AllegroGroup 19

20. The service 07-09.10.2011 OpenStack in AllegroGroup 20 VM API OS

21. Pay only for what you actually use 07-09.10.2011 OpenStack in AllegroGroup 21 10 USD/day Free

22. Infrastructure as a Service (IaaS) 07-09.10.2011 OpenStack in AllegroGroup 22

23. Platform as a Service (PaaS) 07-09.10.2011 OpenStack in AllegroGroup 23

24. Software as a Service (SaaS) 07-09.10.2011 OpenStack in AllegroGroup 24

25. 07-09.10.2011 OpenStack in AllegroGroup 25

27. 20gb hdd

28. 2 cpus

29. UbuntuH-visor VM Imagerepo VM

30. VM lifecycle 07-09.10.2011 OpenStack in AllegroGroup 27 Bootstrap Poweroff Start (just a plain OS with random IP and hostname) Serve Terminate(all is lost here)

31. But…. 07-09.10.2011 OpenStack in AllegroGroup 28

32. …what about the data??? 07-09.10.2011 OpenStack in AllegroGroup 29

33. All local data is lost when a VM is terminated 07-09.10.2011 OpenStack in AllegroGroup 30

34. Use persistent data storage on the cloud! 07-09.10.2011 OpenStack in AllegroGroup 31

35. VM Authentication (injected pubkey) 07-09.10.2011 OpenStack in AllegroGroup 32

36. Be agile 07-09.10.2011 OpenStack in AllegroGroup 33

37. Be fast 07-09.10.2011 OpenStack in AllegroGroup 34

38. We’ve got it all for ya!!!! 07-09.10.2011 OpenStack in AllegroGroup 35

39. 07-09.10.2011 OpenStack in AllegroGroup 36 Your own private cloud!

41. Run VMs

42. Use VM templates

46. 07-09.10.2011 OpenStack in AllegroGroup 41 But guys…Remember to tell the application folks first !

47. 07-09.10.2011 OpenStack in AllegroGroup 42 WHY ? ….

48. 07-09.10.2011 OpenStack in AllegroGroup 43

49. 07-09.10.2011 OpenStack in AllegroGroup 44

50. 07-09.10.2011 OpenStack in AllegroGroup 45 why we do it

51. 07-09.10.2011 OpenStack in AllegroGroup 46 4 5 5 6 Data gathered on 2011-09-19

52. 07-09.10.2011 OpenStack in AllegroGroup 47 0 (WTF)

53. 07-09.10.2011 OpenStack in AllegroGroup 48 (WTF)

54. 07-09.10.2011 OpenStack in AllegroGroup 49 DO IT!

55. 07-09.10.2011 OpenStack in AllegroGroup 50 AWESOME !

56. 07-09.10.2011 OpenStack in AllegroGroup 51 The “compute” service deploys and runs VM-s on your physical servers. It also takes care that none of the servers is overloaded by VM-s. It’s a huge speed boost for your infrastructure. You can deploy hundreds of VM-s in minutes via a management console or an API.

57. 07-09.10.2011 OpenStack in AllegroGroup 52 Long-term, replicable and scalable storage. Data can go up to petabytes. Accessible via RESTful API. Suitalbe for backups, email archiving, storing VM images

58. 07-09.10.2011 OpenStack in AllegroGroup 53 Delivers and keeps track of VM images across the Compute infrastructure.

59. 07-09.10.2011 OpenStack in AllegroGroup 54 You could do a bit better guys`… This is where we are. @AllegroGroup

60. 07-09.10.2011 OpenStack in AllegroGroup 55 …? Go to hell you little monster. These guys have done a great job.Openstack is still in research phase. It’s got lots of bugs. Keep that in mind!We’ve made our testbed stable enough for production use. We’ve even hacked some bugfixes and keep helping newbies on IRC.

61. 07-09.10.2011 OpenStack in AllegroGroup 56 Now I really insist you watch a short demo of it!

62. 07-09.10.2011 OpenStack in AllegroGroup 57 The compute

63. 07-09.10.2011 OpenStack in AllegroGroup 58 Hybridfox

64. 07-09.10.2011 OpenStack in AllegroGroup 59

65. 07-09.10.2011 OpenStack in AllegroGroup 60

66. 07-09.10.2011 OpenStack in AllegroGroup 61

67. 07-09.10.2011 OpenStack in AllegroGroup 62

68. 07-09.10.2011 OpenStack in AllegroGroup 63

69. 07-09.10.2011 OpenStack in AllegroGroup 64

70. 07-09.10.2011 OpenStack in AllegroGroup 65 Availability Zone

71. 07-09.10.2011 OpenStack in AllegroGroup 66 Building reliable services with availability zones

72. 07-09.10.2011 OpenStack in AllegroGroup 67

73. 07-09.10.2011 OpenStack in AllegroGroup 68

74. 07-09.10.2011 OpenStack in AllegroGroup 69 Availability-Zone 1 Cloud Controller/API

75. 07-09.10.2011 OpenStack in AllegroGroup 70 Availability-Zone 1 Cloud Controller/API

76. 07-09.10.2011 OpenStack in AllegroGroup 71 Availability-Zone 1 Cloud Controller/API

77. 07-09.10.2011 OpenStack in AllegroGroup 72 Availability-Zone 1 Cloud Controller/API

78. 07-09.10.2011 OpenStack in AllegroGroup 73 A-Z1 A-Z2 A-Z3 Cloud Controller/API

79. 07-09.10.2011 OpenStack in AllegroGroup 74 Dealing with large data using block storage

80. 07-09.10.2011 OpenStack in AllegroGroup 75 live example here ;-)

81. 07-09.10.2011 OpenStack in AllegroGroup 76 euca-create-volume Cloud controller Volume controller LV Name: /dev/nova-volumes/volume-<vol_id>

82. 07-09.10.2011 OpenStack in AllegroGroup 77 euca-attach-volume Cloud controller /dev/vdc ISCSI Volume controller LV Name: /dev/nova-volumes/volume-<vol_id>

83. 07-09.10.2011 OpenStack in AllegroGroup 78 Hangling external traffic with fixed IPs

84. 07-09.10.2011 OpenStack in AllegroGroup 79 Compute nodes 192.168.20.21 Network controller 192.168.0.1

85. 07-09.10.2011 OpenStack in AllegroGroup 80 Compute nodes 192.168.20.21(i-0000036c) Network controller 192.168.0.1 209.85.148.106 NAT

86. 07-09.10.2011 OpenStack in AllegroGroup 81 Our gear

87. 07-09.10.2011 OpenStack in AllegroGroup 82

88. 07-09.10.2011 OpenStack in AllegroGroup 83 1000VMsperrack

90. Around 1000 vm-s in a single rack

92. autoscaling service

94. iSCSI is not that bad provided it runs on a dedicated network (jumbo frames, etc.)

95. Small building blocks scale better than large ones (large Dell servers vs small HP blades).

97. 1 cloud authentication service

98. 1 cloud scheduler

99. 3 computing nodes (KVM-based h-vis.)

101. A preconfigured VM image (Ubuntu)

103. Autoscale service (Scalr)