Lone Star PHP 2013 - Sysadmin Skills for PHP Developers

Declare Independence from your IT department:
SysAdmin skills for PHP developers
Pablo Godel @pgodel - June 29th, 2013
Lone Star PHP Conference
http://joind.in/8696
Saturday, June 29, 13

- Why SysAdmin Skills
- Introduction to LAMP
- Hosting options
- Linux distributions
- Installing PHP options
- Deploying PHP
-Various production tips
- Monitoring
- Backups
Agenda

Who Am I?
⁃ Born in Argentina, living in the US since 1999
⁃ PHP & Symfony developer
⁃ Founder of the original PHP mailing list in spanish
⁃ Parrilla Lover
⁃ Co-founder of ServerGrove

⁃ Founded ServerGrove Networks in 2005
⁃ Provider of web hosting specialized in PHP,
Symfony, ZendFramework, MongoDB and others
⁃ Servers in USA and Europe!
ServerGrove!

Very active open source supporter through code
contributions and usergroups/conference sponsoring
Community is our teacher

Sysadmin Skills
Who needs them?

Text
IT is busy / Different Priorities

!Rocket Science

Lack of control

Less downtime

Better Performance

What do you prefer?

Or this?

An example...
I     s.
I ’   s  L.
E     Cs ,
       .

LAMP
What is

LAMP
Scott Beale

LANMMPP
Why?

Why LANMMPP
Proven

Stable
Why LANMMPP

Secure
Why LANMMPP

Why LANMMPP
Free

Free*
Why LANMMPP

Inexpensive
Why LANMMPP

Easily Available
Why LANMMPP

Hosting Options

Hosting Options
Shared Hosting
- Inexpensive
- Widely available
- Easy to use
- No maintenance
- No updates
- Instant provisioning
- DNS/Email services
- Shared resources
- No/Limited Shell
- Many restrictions
- No control
- Fixed versions
- Multitude of CPs
+ -

Hosting Options
Dedicated Servers
- Full control
- No sharing
- Best performance
- Software / Hardware
to specs
- Hard to plan
- Software updates
- SysAdmin skills
- Expensive to start
- Parts replacements
- Control Panel licenses
+ -

Hosting Options
Virtual Servers / VPS
- Shared resources
- Software updates
- SysAdmin skills
- Limited/No CP
- Lack of email
-

Hosting Options
Virtual Servers / VPS
- Inexpensive
- Widely available
- Choice of OS
- Root access
- Full shell
- Fast provisioning
- Custom software
- Custom conﬁgurations
- Snapshots
- Multiple Envs
+ +

Hosting Options
Cloud Hosting
Depends on implementation
+ -

Hosting Options
Cloud Hosting
Some are a shared hosting
with a fancy new name

Hosting Options
Cloud Hosting
Others let you start small
and scale easily

Hosting Options
Cloud Hosting
Others let you start small
and scale easily
Gets really expensive at
scale

Hosting Options
Cloud Hosting
Most suffer from some of the
shared hosting problems:
- vendor lock-in
- lack of control
- high learning curve
- limited environment

Hosting Options
Which one to choose?

Hosting Options
I T D E P E N D S

Linux Distributions

Distributions
RedHat based
- Fedora
- RedHat Enterprise Linux (RHEL)
- CentOS
- Scientiﬁc Linux

Distributions
Debian based
- Debian
- Ubuntu

Distributions
Others
- Gentoo
- Slackware
- OpenSuse
- Archlinux
- any many many more!
http://distrowatch.com/
http://en.wikipedia.org/wiki/Linux_distribution

Distributions
Key differences
- Conﬁguration ﬁles
- Package Manager
- Managing Services
- Software versions
- Updates

Distributions
Key differences
- Conﬁguration ﬁles
CentOS
Ubuntu
/etc/sysconfig/network-scripts/ifcfg-eth0
/etc/network/interfaces

Distributions
Key differences
- Package Manager
CentOS
Ubuntu
yum install php-cli
apt-get install php5

Distributions
Key differences
- Package Manager
CentOS
Ubuntu
yum search php-cli
apt-cache search php

Distributions
Key differences
- Managing Services
CentOS
Ubuntu
service restart httpd
chkconfig --list httpd
chkconfig httpd on
service restart apache2
sudo update-rc.d apache2 enable

Distributions
Key differences
- Software versions
CentOS
Ubuntu
httpd-2.2.3
apache-2.2.17

Distributions
Key differences
- Updates
CentOS 5.x
Ubuntu 11
PHP 5.1.6
PHP 5.3.5

Distributions
Key similarities
- Based on Linux Kernel
- Screwed up or ancient PHP
- Lack of PHP extensions

Distributions
I T D E P E N D S

Distributions
- Best feeling
- Previous experience
- Workplace selection
- Coworker / friend knowledge

First Experience

First Experience
- Run Linux natively
- Mac OSX
- Virtual Machine:
- VirtualBox
- Parallels
- VMware
- VPS

First Experience
#!/bin/bash

First Experience
#!/bin/bash
Recommended Books:
- Learning the bash Shell
- bash Cookbook

First Experience
#!/bin/bash
Most Common Commands:
$ ls -l /path/
$ cd /path
$ pwd
$ cat /etc/passwd
$ less /etc/resolv.conf
$ tail -f /var/log/*
$ last
$ lastb
$ vi /etc/hosts

First Experience
#!/bin/bash
User`s config files:
~/.bash_history
~/.bash_logout
~/.bash_profile
PATH=$PATH:$HOME/bin
export PATH
~/.bashrc
alias rm='rm -i'
alias cp='cp -i'
alias mv='mv -i'

First Experience
#!/bin/bash
Most common directories:
/etc
/tmp
/var/log
/var/run
/root
/home
/usr/local
/opt

Installing Apache/PHP

Installing Apache/PHP
# CentOS
$ yum install httpd php-cli mod_php
# Ubuntu
$ apt-get install apache2 libapache2-mod-php5
Mac OSX
- MAMP
- Native Apache + Liip PHP installation
- Zend Server CE
Windows
- WAMP
- IIS + PHP

Installing PHP
CentOS
Third Party Repositories
- Remi RPM
http://blog.famillecollet.com/
- Webtatic
http://www.webtatic.com/
- ServerGrove: PHP 5.3.x / 5.4.x / 5.5.x
(always latest)
http://repos.servergrove.com

Installing PHP
CentOS
cd /etc/yum.repos.d/
wget http://repos.servergrove.com/servergrove-centos-5/
servergrove-centos-5.repo
yum install php53 # or php54

Installing PHP
Ubuntu
- Dotdeb:
http://www.dotdeb.org/
- ServerGrove: (always latest)
http://repos.servergrove.com
PHP 5.3.x / 5.4.x / 5.5.x

Installing PHP
Ubuntu
echo “deb http://repos.servergrove.com/servergrove-ubuntu-
precise precise main” >> /etc/apt/sources.list.d/
servergrove.list
apt-get install php53 # or php54

Installing PHP
From Source
wget http://us2.php.net/get/php-5.4.12.tar.bz2/from/
www.php.net/mirror
tar jxvf php-5.4.12.tar.bz2
cd php-5.4.12
./configure
make && make install

Installing PHP
Recompiling
php -i |grep configure
./configure '--with-apxs2=/usr/sbin/apxs' '--prefix=/usr/local/
php53' '--with-config-file-scan-dir=/etc/php53/conf.d' '--
enable-bcmath' '--enable-ctype' '--enable-exif' '--enable-
mbstring' '--enable-ftp' '--enable-intl' '--enable-sockets' '--
enable-sysvmsg' '--enable-pcntl' '--with-bz2' '--with-curl' '--
with-gettext' '--with-gd' '--enable-gd-native-ttf' '--enable-exif' '--
with-freetype-dir=/usr' '--with-jpeg-dir=/usr' '--with-t1lib=/usr'
'--with-mcrypt' '--with-openssl' '--with-kerberos' '--with-iconv'
'--with-xsl' '--with-xmlrpc' '--with-zlib' '--with-mysql=mysqlnd' '--
with-mysqli=mysqlnd' '--with-pdo-mysql=mysqlnd'

Installing PHP
Compiling for Apache
./configure '--with-apxs2=/usr/sbin/apxs'

Installing PHP
Compiling for Nginx / PHP-FPM
./configure '--enable-fpm'

Installing PHP
Compiling extension
./configure --with-curl --enable-ftp

Installing PHP
Compiling extension
(dynamic)
cd ext/curl
phpize
./configure
echo “extension=curl.so” >> php.ini

Installing PHP
Compiling extension
http://pecl.php.net/

Installing PHP
Compiling extension
(PECL)
pecl install apc
# or
pecl download apc
tar zxvf APC-3.1.13.tgz
cd APC-3.13
phpize
./configure
echo “extension=apc.so” >> php.ini

Automate!
- Chef
- Puppet
- ...
Installing PHP

Installing PHP
Conﬁguration
/etc/php/php.ini
/etc/php5/cli/php.ini
/usr/local/lib/php.ini
Default location
Other common locations
/etc/php5/apache2/php.ini

Installing PHP
Configuration
php -i | grep php.ini
Configuration File (php.ini) Path => /usr/local/php5/lib
Loaded Configuration File => /usr/local/php5-20110426-093151/
lib/php.ini
Scan this dir for additional .ini files => /usr/local/php5/php.d
Additional .ini files parsed => /usr/local/php5/php.d/10-
extension_dir.ini,

Installing PHP
Conﬁguration
php -i | grep mongo
/usr/local/php5/php.d/50-extension-mongo.ini,
mongo
mongo.allow_empty_keys => 0 => 0
mongo.allow_persistent => 1 => 1
mongo.auto_reconnect => 1 => 1
mongo.chunk_size => 262144 => 262144
mongo.cmd => $ => $
mongo.default_host => localhost => localhost
mongo.default_port => 27017 => 27017

Installing PHP
Conﬁguration
[PHP Modules]
apc
bcmath
bz2
Core
ctype
curl
date
dom
ereg
php -m

Installing PHP
Conﬁguration
php.ini
extension_dir=/usr/lib/php/extensions/no-
debug-non-zts-20090626
extension=apc.so
extension=mongo.so

Installing PHP
Conﬁguration
php.ini
php -i | grep extension_dir
extension_dir => /usr/local/php5/lib/php/extensions/no-debug-
non-zts-20090626

Installing PHP
Conﬁguration
php.ini
date.timezone=UTC
display_errors = off
log_errors = on
error_log = /var/log/php.log

Installing PHP
Conﬁguration
Security
memory_limit = 128M
max_execution_time = 30
display_errors = off
expose_php = off
mail.log = /var/log/phpmails.log
disable_functions = exec
allow_url_fopen = off

Installing PHP
Configuration
File uploads on .htaccess
php_value memory_limit 128M
php_value max_file_uploads 20
php_value max_input_time -1
php_value post_max_size 8M
php_value upload_max_filesize 2M
php_value max_execution_time 0
AllowOverride=All in Apache!

Installing PHP
Conﬁguration
Include .htaccess
<Directory /path/to/document/root>
Include /path/to/.htaccess
</Directory>
AllowOverride=None in Apache!

Installing PHP
Conﬁguration
Apache
php_value date.timezone UTC
php_ﬂag display_errors 1
php_value memory_limit 128M
php_value max_execution_time 0
Don’t forget to restart Apache

Installing PHP
Web Server User
- apache
- nobody
- www-data
- ftp / ssh user (sometimes)
Possible users
Permissions issues with clear cache
and uploads, Anyone?

Installing PHP
Web Server User
Fix:
Permissions issues with clear cache
and uploads, Anyone?
rm -rf app/cache/*
rm -rf app/logs/*
sudo chmod +a "www-data allow delete,write,append,file_inherit,directory_inherit" app/cache
app/logs
sudo chmod +a "`whoami` allow delete,write,append,file_inherit,directory_inherit" app/cache
app/logs
http://symfony.com/doc/current/book/installation.html

Deploying PHP

Deploying PHP
Before going live
Make sure ntpd is
installed and running
to ensure accurate
server time
yum install ntp
chkconfig ntpd on
ntpdate pool.ntp.org

Deploying PHP
Before going live
- Disable PHP in speciﬁc directories
<Location /uploads>
php_admin_flag engine off
</Location>

Deploying PHP
Before going live
- Limit access by IP
<Location /admin>
Order Deny,Allow
Deny from all
Allow from 1.2.3.4
</Location>

Deploying PHP
Before going live
- Add HTTP Authentication
<Location /admin>
Require valid-user
AuthType Basic
AuthName "SG"
AuthUserFile /path/users
</Location>

Deploying PHP
Before going live
- Quiet down Apache
ServerTokens Prod

Deploying PHP
Before going live
RewriteEngine On
RewriteRule ^.htaccess$ - [F]
RewriteCond %{REQUEST_FILENAME} -f
RewriteRule ^.*$ - [NC,L]
RewriteCond %{REQUEST_URI} !^/web/.*$
RewriteRule ^(.*)$ /web/$1
Move document root with .htaccess

Deploying PHP
Before going live
- Case senstive ﬁlesystem
IPCheck_Form_Index_Login !=
IpCheck_Form_Index_Login
/path/to/ﬁle/IpCheck_Form_Index_Login.php
<?php
class IPCheck_Form_Index_Login
{
...

Deploying PHP
- server-side vi
- plain old FTP
- SFTP
- scp
- rsync + ssh
- git
- tar / gzip
- rpm / deb packages
- capistrano / capifony

Deploying PHP
Efﬁng Package Management
https://github.com/jordansissel/fpm
Build packages for multiple platforms (deb, rpm, etc) with great ease and sanity.
fpm -s dir -t rpm -n "sfapp" -v 1.0 /var/www/sfapp
fpm -s dir -t deb -a all -n sfapp -v 1.0 /etc/apache2/
conf.d/my.conf /var/www/sfapp

Deploying PHP
Capistrano / Capifony
- multiple servers
- multiple environments
- setup shared folders (vendors, cache, logs, etc)
- copy ﬁles
- update vendors
- multi versions
- rollback
- restart apache

Deploying PHP
Setting up SSH
$ ssh-keygen -t dsa
~/.ssh/id_dsa.pub
$ ssh-copy-id user@remote-host
~/.ssh/authorized_keys
~/.ssh/authorized_keys2
$ ssh-add

Deploying PHP
Setting up SSH
~/.ssh/conﬁg
Host *
ForwardAgent yes
Port 22123
Host gh
HostName github.com
Port 22
PreferredAuthentications publickey
IdentityFile ~/.ssh/me_rsa

Deploying PHP
Setting up SSH
/etc/ssh/sshd_conﬁg
Port 22
Port 22123
PermitRootLogin no
PasswordAuthentication no

Deploying PHP Automate!
https://github.com/pgodel/m-sunshinephp/blob/master/web/deploy.php
<?php
exec('/usr/bin/env -i HOME=/var/
www/vhosts/m.sunshinephp.com/m-
sunshine git pull origin master');
http://m.sunshinephp.com/deploy.php

DNS Tips

DNS Tips The Power of the hosts ﬁle

/etc/hosts
10.0.1.1 www.lottery.com

/etc/hosts
10.0.1.1 example1.com example2.com

DNS Tips
Virtual Document Root
UseCanonicalName Off
VirtualDocumentRoot /var/www/vhosts/%0/web
<Location /var/www/vhosts>
AllowOverride All
Options +FollowSymLinks
</Location>
example.com => /var/www/vhosts/example.com/web
example2.com => /var/www/vhosts/example2.com/web

DNS Tips
Nameservers/Expiration
whois servergrove.com
...
Name Servers:
ns1.servergrove.com
ns2.servergrove.com
ns3.servergrove.com
Creation date: 19 May 2005 23:34:36
Expiration date: 19 May 2014 23:34:00

DNS Tips
DNS records
dig -t A google.com
;; ANSWER SECTION:
google.com. 184 IN A 74.125.230.227
google.com. 184 IN A 74.125.230.228
google.com. 184 IN A 74.125.230.229
google.com. 184 IN A 74.125.230.230
google.com. 184 IN A 74.125.230.231
google.com. 184 IN A 74.125.230.232
google.com. 184 IN A 74.125.230.233
google.com. 184 IN A 74.125.230.238
google.com. 184 IN A 74.125.230.224
google.com. 184 IN A 74.125.230.225
google.com. 184 IN A 74.125.230.226

DNS Tips
DNS records
dig -t A servergrove.eu @ns1.servergrove.com
;; ANSWER SECTION:
servergrove.eu. 3600 IN A 149.5.47.100

DNS Tips DNS Delegation
http://www.simpledns.com/lookup-dg.aspx

DNS Tips
traceroute
traceroute google.com
traceroute to google.com (173.194.37.33), 30 hops max, 40 byte packets
1 2.69-195-222.static.servergrove.com (69.195.222.2) 0.360 ms 0.365 ms 0.432 ms
2 t0-1-0-5.br2.mia.terremark.net (66.165.161.45) 1.558 ms 1.546 ms 1.532 ms
3 core1-1-0-0.mia.net.google.com (198.32.124.133) 0.238 ms 0.224 ms 0.230 ms
4 209.85.253.74 (209.85.253.74) 0.266 ms 0.283 ms 0.312 ms
5 209.85.254.252 (209.85.254.252) 12.764 ms 12.757 ms 12.749 ms
6 64.233.175.92 (64.233.175.92) 14.177 ms 14.257 ms 14.359 ms
7 atl14s07-in-f1.1e100.net (173.194.37.33) 13.653 ms 13.606 ms 13.618 ms

DNS Tips
http://whereisitup.com

DNS Tips
mtr

Monitoring

Monitoring
<Location /server-status>
SetHandler server-status
Order deny,allow
Deny from all
Allow from .your_domain.com
</Location>
ExtendedStatus On
Apache Requests

Monitoring
Apache Requests

Monitoring
- Cacti
- Ganglia
- Zabbix
- collectd
- statsd / StatsDBundle
- graphite

Monitoring
statsd / StatsDBundle / Graphite

Monitoring
CPU / Memory / IO
top

Monitoring
IO
iotop

Monitoring
Network
iptraf

Monitoring
Handling logs
- Centralize logs with syslog
error_log = syslog
- Monolog supports syslog
- logstash, logster, loggly, logio

Monitoring
Handling logs
$ grep POST /var/log/apache2/access_log

Speeding up

Speeding up
- nginx/php-fpm
- APC
- ZendOptimizer+ (Included in PHP 5.5)
- Memcache
- nginx reverse proxy cache
- Varnish

Backups
- rsync
- rdiff-backup
- Unison
- Bacula
- Amanda

Backups
Don’t forget to
backup your DB!
http://blog.servergrove.com/2012/01/24/backup-your-mysql-
database-using-mysqldump/

Reading List
- Automating UNIX and Linux Administration
- Running Linux
- Learning the bash Shell: Unix Shell Programming

The End Questions?
Sysadmin skills for PHP developers

http://joind.in/8696
Thank you!
Sysadmin skills for PHP developers
Pablo Godel @pgodel

Lone Star PHP 2013 - Sysadmin Skills for PHP Developers

Recommended

Recommended

More Related Content

What's hot

What's hot (12)

Viewers also liked

Viewers also liked (20)

Similar to Lone Star PHP 2013 - Sysadmin Skills for PHP Developers

Similar to Lone Star PHP 2013 - Sysadmin Skills for PHP Developers (20)

More from Pablo Godel

More from Pablo Godel (20)

Recently uploaded

Recently uploaded (20)

Lone Star PHP 2013 - Sysadmin Skills for PHP Developers