A talk describing how I use services like Travis CI, Coveralls, Papertrail, DataDog and others to make my life easier and more productive on Plone and Pyramid projects. Personally, I regard time spent fixing preventable problems and doing routine tasks is time wasted stupidly. I'll show you how you can leverage some of the recently available "cloud" services to cut the amount of routine tasks in your day-to-day work. This talk is somewhat based on the Travis CI talk I had last year on PloneConf in Arnhem, but extended to include other cloud services.

1. @nzupan
Turbo-boosting
your Python development

8. Problem

9. Problem
Pull Request

10. Problem
Pull Request

11. Problem
Pull Request
Travis build

12. Problem
Pull Request
Travis build
Automatic Deployment

13. Problem
Pull Request
Travis build
Automatic Deployment
Sentry

14. Problem
Pull Request
Travis build
Automatic Deployment
Sentry
QA

15. Problem
Pull Request
Travis build
Automatic Deployment
Sentry
QA
Datadog
Papertrail

16. CODE REPOSITORY
Any DVCS is OK, but I prefer git
Main reason: GitHub’s UI

17. CONTINUOUS INTEGRATION
Run your tests often
Preferably on every commit
In a clean environment

18. Easy and fun CI for your Python packages
Travis CI

19. Hosted Continuous Integration
for the Open Source Community

20. +

21. BUILDS

22. SINGLE BUILD

23. SINGLE BUILD (CONT.)

24. Free for any public GitHub repo

25. Private repos supported too!

26. Already ran ~8 mio tests for ~78k
open-source projects

27. Supports:
C, C++, Clojure, Erlang, Go, Groovy,
Haskell, Java, JavaScript, Perl, PHP,
Python, Ruby, Scala

28. Preinstalled DBs:
MySQL, PostgreSQL, MongoDB,
CouchDB, Redis, Riak, RabbitMQ,
Memcached, Cassandra, Neo4J,
ElasticSearch, Kestrel, SQLite3

29. GETTING STARTED
Sign in to travis-ci.org with GitHub account
Enable repository
Add .travis.yml to your repository
Push it

30. MINIMAL CONFIG

31. MORE CONTROL

32. PREINSTALLED SERVICES

33. HEADLESS TESTING

34. BRANCHES

35. BUILD NOTIFICATIONS
+ many more

36. STATUS IMAGES

37. STATUS IMAGES
https://travis-ci.org/[YOUR_GITHUB_USERNAME]/
[YOUR_PROJECT_NAME].png

38. PULL REQUESTS TESTING

42. HEROKU: CLOUD
APPLICATION PLATFORM

43. OUT-OF-THE-BOX

44. Add to .travis.yml:

46. AUTO-DEPLOYING PLONE

47. SENTRY: CLOUD ERROR
REPORTING

48. ERROR AGGREGATION

49. ERROR CONTEXT

50. SENTRY SETUP

51. Datadog: cloud monitoring

52. Datadog: cloud monitoring

53. MUNIN + ...

54. ... + OPS TWITTER

55. OUT-OF-THE-BOX
EVENTS:
Fabric, Chef, Puppet
RSS
GitHub, Pivotal Tracker,
Redmine, etc.
Pingdom
Jenkins
HTTP API
METRICS
Nginx & Apache
Amazon AWS & HP Cloud
Cacti & Nagios
PostgreSQL, MySQL,
Cassandra, MongoDB,
CouchDB, etc.
Haproxy,Varnish,
Memcached, RabbitMQ, Solr
& ElasticSearch, etc.

56. CUSTOM METRICS
$ easy_install dogstatsd-python
from statsd import statsd
stasd.gauge(‘users.active’, 50)
statsd.counter(‘base_edit.rendered’)
statsd.histogram: (‘catalog.query.time’, duration)
statsd.set: (‘users.unique’, user_id)

57. CUSTOM APP METRICS

58. PAPERTRAIL: CLOUD LOG
AGGREGATION

59. WHO IS DOWNLOADING?

60. BONUS SLIDE:
CODE COVERAGE REPORTS

65. Problem
Pull Request
Travis build
Automatic Deployment
Sentry
QA
Datadog
Papertrail

66. bobtemplates.niteoweb

67. THE PLONE TEMPLATE
zc.buildout best practices
GenericSetup install profile
Zope 3 browser layer
z3c.jbot overrides folder
static/ resourceDirectory for serving static resources (images, CSS, JS, etc.)
Sphinx documentation
test suite with a solid test coverage
Travis CI integration

68. THE PYRAMID TEMPLATE
zc.buildout best practices
SQLite for development, PostgreSQL for production
A sample view with a Chameleon template
A sample DB model
static resources filled with Twitter Bootstrap niceties
Sphinx documentation
Exemplary test suite
Travis CI & Coveralls integration
Heroku continuous deployment

69. Try it out:
https://github.com/niteoweb/bobtemplates.niteoweb/
Then, let’s generalize it!

70. Thanks!
Some images taken from sxc.hu
http://travis-ci.org/
http://coveralls.io/
https://papertrailapp.com/
http://www.datadoghq.com/
http://docs.fabfile.org/
https://pypi.python.org/pypi/githook
https://www.heroku.com/
@nzupan