1.
scaling LAMP
doesn’t have to
suck!
@stevencorona
(400 million api calls/day)
(3 billion photos)

2.
let’s learn how to
scale php
...in 40 minutes

3.
scaling is...
architecting your app
for millions of users

4.
scaling is...
an art, not a science

5.
scaling is...
NOT CODE
about infrastructure
your code is fast enough

6.
LAMP
LINUX
APACHE
MYSQL
PHP

7.
problems
•single points of failure
•apache+mod_php memory hog
•slow linux default settings
•can’t do work in the background

8.
a better LAMP
LINUX +TUNING
NGINX
PERCONA
PHP-FPM
NSQ
REDIS

9.
nginx
loadbalancer
nginx
php-fpm
MySQL
Master
nginx
php-fpm
nginx
php-fpm
nsq
MySQL
Read
Only
redis

10.
tuning linux
•linux is mostly sane
•use latest kernel
•distro doesn’t matter
•(i like ubuntu)

11.
top 3 settings
open_files
network/sysctl tuning
i/o scheduler
most settings you find
online are outdated

12.
open files
default is 1024
on linux, each socket = open file
/etc/security/limits.conf
soft nofile 999999
hard nofile 999999

13.
sysctl tuning
thousands of settings
newer kernels autotune network
/etc/sysctl.conf
net.core.somaxconn=999999
net.ipv4.ip_local_port_range=2000 62000
net.ipv4.tcp_tw_recycle=1
vm.swapiness=0

14.
i/o scheduler
linux has swappable scheduler
default is cfq
$ echo “deadline” >
/sys/block/sda/queue/scheduler
+50% IOPS on MySQL

15.
nginx
open-source HTTP server
swap out apache
easy + sane config
nginx.org

16.
nginx
most popular webserver
of top 1000 sites
15,000 requests/second
with 20% CPU and100MB RAM

17.
nginx

18.
nginx
load balancer
http cache
fastcgi proxy
web server

19.
php
php-fpm is king
standard with php5.3

20.
php-fpm
use static worker pool
4x number of CPU cores
pm=static
pm.max_children=128

21.
php
php 5.5 is much faster
than 5.4 and 5.3
USE IT!

22.
php
php 5.5 includes Zend
Optimizer+
(no more APC)
10-20% faster than APC in real world

23.
php
horizontal scaling
watch out for sessions!

24.
php + mysql
mysql persistent
connections are GOOD
to use.
despite what the internet says

25.
php + mysql
20-25% faster for first
query
after that it doesn’t matter

26.
php + mysql
watch out for thundering
herd
mysql’s max_connections
2(pm.max_children * #
servers)

27.
php + mysql
turn on mysql protocol
compression
$m = mysqli_init();
$m->real_connect($username....,
MYSQL_CLIENT_COMPRESS);

28.
percona
open source mysql fork
patches from
twitter and google
percona.com

29.
percona
drop-in replacement
faster at scale, more
reliable

30.
percona
new transactions per
minute (more is better)

31.
percona
•only use innodb
•disable query cache
•enable thread pool
thread_handling=pool-of-threads

32.
percona
watch out for NUMA
innodb_buffer_pool_populate=1
flush_caches=1
numa_interleave=1

33.
percona
stop wasting time
use SSDs
went from15 mysql
servers to 2 using SSD

34.
redis
in the old days, we used
memcache
redis is better
redis.io

35.
redis
•data persisted to disk
•hot cache
•500,000 GET/second

36.
redis
config is great out of box
avoid stalls on EC2
use HVM instances

37.
redis
lots of php libraries
use pecl-redis
c extension
pecl install redis

38.
nsq
message queue server in golang by
bit.ly
we use it to process 370 million
events/day
https://github.com/bitly/nsq

39.
nsq
•nsqphp is best php library
•pub/sub model
•do work async
•api calls
•defer long-running work
https://github.com/davegardnerisme/nsqphp

40.
nsq

41.
nsq
DON’T USE MYSQL
AS A WORK QUEUE!

42.
don’t scale code
your code is fast enough
scale infrastructure

43.
thanks!
follow me on twitter
@stevencorona