This is a basic tech experience to build auto scale with AWS shared from LIVEhouse.in. The slide also includes how we coordinate auto scaling and the release deployment.

1. Auto Scaling
with
Ruby, AWS, Jenkins
and Redis

2. hello!
I am
JeDDie
A software engineer. A Rails Girls volunteer.

3. Auto Scaling
with
Ruby, AWS, Jenkins
and Redis

4. 1.
Auto Scaling?
Scalability.

5. “Methods of adding more resources for a particular
application fall into two broad categories:
horizontal and vertical scaling.
http://en.wikipedia.org/wiki/Scalability
Michael, Maged; Moreira, Jose E.; Shiloach, Doron; Wisniewski, Robert W. (March 26, 2007).
"2007 IEEE International Parallel and Distributed Processing Symposium"

6. Scale Vertically
▸ Scale up and down
about SCALABILITY
Scale Horizontally
▸ Scale out
scale up
scale down
1
4

7. Okay,
and WHY?
needs auto scaling

8. about
our office
❤ Taiwan

9. Place your screenshot here
Content Matters
When the live show
attracts people, they
will become audience
right away.

10. 柯P：一個更好的台北
2014-11-29
158,157 clicks
10,400 ccu

11. 2.
Amazon Web Services
What we need for auto scaling.

12. AWS
require “aws”
auto_scaling =
ec2 + cli + elb +
elasti_cache

13. 3.
Amazon EC2
Elastic Compute Cloud

14. Amazon EC2
▸ Amazon Elastic Compute Cloud
○ “A web service that provides resizable compute
capacity in the cloud”
○ “Designed to make web-scale cloud computing
easier for developers”
■ Scale up/down; start, stop, terminate...etc.
EASY management with a great UI.

15. AMI
▸ Amazon Machine Images
○ “A template for the root volume for the instance
(for example, an operating system, an
application server, and applications)”
A script of an instance.

16. 4.
AWS CLI
Command Line Interface

17. AWS CLI
▸ AWS Command Line Interface
○ “A unified tool to manage your AWS services”
■ AWS CLI and AWS EC2 CLI
■ Github
● aws/aws-sdk-ruby
● aws/aws-cli
○ Access key
■ AWS Identity and Access Management (IAM)
API.

18. Process of Launching Instance
Launch instance
using image
Allocate IP
Associate IP
with instance

19. `ec2-run-instances #{AMI_ID} #{REGION}
#{GROUP} #{SUBNET} #{INSTANCE_TYPE}
#{BLOCK_DEVICE_MAPPING}`
Launch an Instance Using an Image.
launch
instance
Image
ID
security
group
small?
large?
additional
store volume

20. ec2-run-instances
ec2-run-instances ami-1a2b3c4d -s subnet-1a2b3c4d -t
c1.medium
OUTPUT>
RESERVATION r-1a2b3c4d 111122223333
INSTANCE i-1a2b3c4d ami-1a2b3c4d pending
c1.medium YYYY-MM-DDTHH:MM:SS+0000 10.0.0.146 …
from Amazon doc

21. `ec2-allocate-address -d vpc #{REGION}`
Allocate an Elastic IP for use.
virtual private cloud

22. ec2-allocate-address
ec2-allocate-address -d vpc
OUTPUT>
ADDRESS 198.51.100.1 vpc eipalloc-5723d13e
from Amazon doc

23. `ec2-associate-address
#{ALLOCATION_ID} #{INSTANCE_ID} #{REGION}`
Associates an Elastic IP with an Instance.
bind IP and
instance
elastic ip

24. ec2-associate-address
ec2-associate-address -a eipalloc-5723d13e -i i-
4fd2431a
OUTPUT>
ADDRESS i-43a4412a eipalloc-5723d13e
eipassoc-fc5ca095
from Amazon doc

25. Do all
in One Step
?

26. Do All in One
▸ Pros
○ Simple flow
▸ Cons
○ Legacy > 5 mins
Facts that matter
Break Things Down
▸ Pros
○ Flexible to handle
▸ Cons
○ Different entries by
time
It takes 5 minutes to run an instance up
process
launch + IP
go online
process

27. Process of Terminating Instance
Disassociate IP
from instance
Release IP
Terminate
instance

28. `ec2-disassociate-address #
{ASSOCIATION_ID} #{REGION}`
Disassociates Elastic IP from Instance.
the link
ec2-disassociate-address -a eipassoc-048c746d
OUTPUT>
ADDRESS eipassoc-048c746d
example from Amazon doc

29. `ec2-release-address #{ASSOCIATION_ID} #
{REGION}`
Release Elastic IP.
ec2-release-address -a eipassoc-048c746d
OUTPUT>
ADDRESS eipassoc-048c746d
example from Amazon doc

30. `ec2-terminate-instances #{INSTANCE_ID}
#{REGION}`
Shutdown Instance.
PROMPT> ec2-terminate-instances i-1a2b3c4d
OUTPUT>
INSTANCE i-1a2b3c4d running shutting-down
example from Amazon doc

31. 5.
AWS ELB
Elastic Load Balancing

32. AWS ELB
▸ Elastic Load Balancing
○ “Automatically distributes incoming application
traffic across multiple Amazon EC2 instances in
the cloud.”
Traffic-monitoring UI and the metrics.
Icon made by Freepik from www.flaticon.com is licensed under CC BY 3.0

33. `elb-register-instances-with-lb #
{LOAD_BALANCER} #{INSTANCE_ID} #{REGION}
#{CREDENTIAL_FILE}`
Make Load Balancer Know Instance.

34. elb-register-instance-with-lb
aws elb register-instances-with-load-balancer --load-
balancer-name my-test-loadbalancer --instances i-
4e05f721
OUTPUT>
{
"Instances": [
{"InstanceId": "i-315b7e51"},
{"InstanceId": "i-4e05f721"}
]
}
from Amazon doc

35. `elb-deregister-instances-with-lb #
{LOAD_BALANCER} #{INSTANCE_ID} #{REGION}
#{CREDENTIAL_FILE}`
Cut Instance out from Load Balancer.
aws elb register-instances-with-load-balancer --load-balancer-name
my-test-loadbalancer --instances i-4e05f721
OUTPUT>
{"Instances": [{"InstanceId": "i-315b7e51"}]}
from Amazon doc

36. `aws elb describe-instance-health #
{LOAD_BALANCER} #{REGION}`
Returns the current state of the instances
registered with the specified load balancer.

37. describe-instance-health
aws elb describe-instance-health --load-balancer-name
MyHTTPSLoadBalancer
OUTPUT>
{
"InstanceStates": [
{"InstanceId": "i-cb439ec2", "ReasonCode": "N/A",
"State": "InService", "Description": "N/A"}
]
}
from Amazon doc

38. `mon-get-stats #{METRIC} #{NAMESPACE}
#{STATISTICS} #{REGION} #{DIMENSIONS}
#{CREDENTIAL_FILE}`
Get time-series data for one or more statistics
of a given Metric.
get time-series
data
requestCount,
HTTPCode_Backend_2XX, ...
aws/elb
sum
lb name

39. mon-get-stats
mon-get-stats RequestCount --statistics "Sum" --
namespace "AWS/ELB"
OUTPUT>
2015-01-29 12:01:00 687.0 Count
2015-01-29 12:02:00 753.0 Count
2015-01-29 12:03:00 836.0 Count
from Amazon doc

40. Elements
ELB
monitor
traffic
EC2
launch or
terminate
instance
ElastiCache
track
instance status

41. 6.
Amazon ElastiCache
Redis

42. Amazon ElastiCache
▸ Amazon ElastiCache
○ “makes it easy to deploy, operate, and scale an
in-memory cache in the cloud”
Redis, a key-value database.

43. Redis
“Redis is an open source, BSD
licensed, advanced key-value
cache and store. ”
- http://redis.io
Different data structures:
strings, hashes, lists, sets, ...
Icon made by Carlos Prioglio from www.iconfinder.com is licensed under CC BY-NC-SA 3.0

44. 7.
Auto Scaling!
Automation.

45. Auto Scaling
Icons made by Freepik from www.flaticon.com is licensed under CC BY 3.0

46. Let’s auto scale!
Icon made by SimpleIcon from www.flaticon.com is licensed under CC BY 3.0

47. A Robot’s Day
Its name is Bee!
Icon made by Freepik from www.flaticon.com is licensed under CC BY 3.0

48. Monitor Traffic
▸ CLI
○ elb-register-instances-with-lb
○ mon-get-stats

49. Decide a Threshold
▸ Observe what has happened
time
request

50. The Basic Process
▸ Basic actions
○ ec2-run-instances
○ ec2-allocate-address
○ ec2-associate-address
○ elb-register
○ elb-deregister
○ ec2-disassociate-address
○ ec2-release-address
○ ec2-terminate-instances

51. Watch for Status
▸ Now what should be done?
○ Add/remove instance
■ Number of online-servers
■ Traffic and threshold
○ Register/deregister instance with load balancer
○ Update instance status
■ pending / Initializing / running / stop / problem
○ White List
○ Limitation
■ Time
■ Scaling
Icon made by Freepik from www.flaticon.com is licensed under CC BY 3.0

52. Track Things Down
▸ Online instances
▸ Waken instances
▸ Problem instances
Redis data type: List.
i-abcde01
i-bcdef02
i-cdefg03

53. Track Things Down
▸ Instance information
▸ The timestamp of the last instance
initialized
Redis data type: String.
i-abcde01: "{id: i-abcde01,
status: initializing,
private_ip: 192.168.0.1,
public_ip: 54.12.23.34,
created_at: 2015/01/20 14:03:00}"

54. Release

55. 8.
Deployment
Let’s meet other robots!

56. http://capistranorb.
com/
Icon made by Charles Lowell and Frontside from jenkins-ci.org is licensed under CC BY-SA 3.0

57. Always put the NEWEST service online.
Icon made by OCHA , icon made by Freepik, icon made by Sarfraz Shoukat from www.flaticon.com is licensed under CC BY 3.0
Icon made by Charles Lowell and Frontside from jenkins-ci.org is licensed under CC BY-SA 3.0

58. with Jenkins
Auto Scaling + Deployment

59. New pre and post processes.
Original
Deployment
Get
servers’
IP
Build Image

60. Get
servers’
IP
`aws ec2 describe-instances #{REGION} --filters
"Name=instance-state-name,Values=running"
"Name=instance.group-name,Values=FrontEnd"
"Name=tag-value,Values=FrontEnd Production*"
"Name=ip-address,Values=*"`
RESERVATION r-1a2b3c4d 111122223333
INSTANCE i-1a2b3c4d ami-1a2b3c4d running my-key-pair 0 m1.small YYYY-MM-DDTHH:MM:
SS+0000 us-west-2b windows monitoring-disabled 50.112.172.209 10.0.0.167 vpc-1a2b3c4d
subnet-1a2b3c4d ebs hvm xen ABCDE1234567890123sg-1a2b3c4d default false
BLOCKDEVICE /dev/sdb vol-1a2b3c4d YYYY-MM-DDTHH:MM:SS.SSSZtrue
NIC eni-1a2b3c4dsubnet-1a2b3c4d vpc-1a2b3c4d111122223333in-use10.0.1.167 true
NICATTACHMENT eni-attach-1a2b3c4d 0 attached YYYY-MM-DDTHH:MM:SS+0000true
GROUP sg-1a2b3c4d my-security-group
PRIVATEIPADDRESS 10.0.1.167
PRIVATEIPADDRESS 10.0.1.12
TAG instance i-1a2b3c4d Name Windows
from Amazon doc

61. Build Image
`ec2-create-image #{INSTANCE_ID} #{NAME}
#{DESCRIPTION} --no-reboot #{REGION}`
ec2-create-image i-10a64379 --name "Standard Web Server"
--description "Standard web server AMI"
OUTPUT>
IMAGE ami-4fa54026
from Amazon doc

62. Do we solve it? NOT yet!

63. Good communication matters!
icons made by Freepik from www.flaticon.com is licensed under CC BY 3.0

64. Happy Auto Scaling!
Icon made by Freepik from www.flaticon.com is licensed under CC BY 3.0

65. Join us!
https://livehouse.in/recruit

66. Thanks!
any
questions
?
You can find me at
jeddie@livehouse.in

67. Credits
Special thanks to all the people who made and released
these awesome resources for free:
▸ Busy Icons by Olly Holovchenko
▸ Presentation template by SlidesCarnival
▸ Photographs by Unsplash
▸ Paper backgrounds by SubtlePatterns
▸ Other icons are from
▸ http://www.freepik.com
▸ http://www.flaticon.com
▸ https://livehouse.in
▸ http://jenkins-ci.org