These slides are made for the 2013 DevFest talks. It covers the main blocks of Google cloud platform: App engine, Compute Engine, storage options and more.

1. Tel Aviv - Oct 2013

2. Google Cloud Platform
Google Cloud Overview
+GreenIdo
Developer Advocate, Google
App Engine

3. Who?
Ido Green
Developer Advocate, Google
plus.google.com/+greenido
● ido-green.appspot.com
● greenido.wordpress.com
● github.com/greenido/

4. Agenda
●Part I: Background & Motivation
●Part II: Google App Engine
●Part III: Cloud Platform Updates

5. About Scale
● Google's search index
○ (2012)
● YouTube
○ (2013)
● YouTube... monthly uniques?
○ (2013)

6. Innovation

7. Scaling & Innovation
Image courtesy Google/Connie
Zhou
Image courtesy Google
Maps
*AND* security

8. Cloud industry service levels
PaaS
SaaS
Google Apps Salesforce, SugarCRM, NetSuite
Yahoo!Mail YOUR NEXT APP?
Google Apps Script force.com
Google App Engine Cloud Foundry, OpenShift
Windows Azure, Heroku DotCloud, Engine Yard
Google BigQuery, Cloud
SQL, Cloud Datastore,
Translate, Prediction
Amazon RDS, DynamoDB;
Microsoft SQL (Azure) Database
Amazon EC2, S3 Rackspace, Joyent
Google Compute
Engine, Cloud Storage
GoGrid, CloudLayerIaaS

9. Google Cloud Platform service levels
PaaS
SaaS
Google Apps Salesforce, SugarCRM, NetSuite
Yahoo!Mail, Hotmail YOUR NEXT APP?
Google Apps Script force.com
Google App Engine Cloud Foundry, OpenShift
Windows Azure, Heroku DotCloud, Engine Yard
Google BigQuery, Cloud
SQL, Cloud Datastore,
Translate, Prediction
Amazon RDS, DynamoDB;
Microsoft SQL (Azure) Database
Amazon EC2, S3 Rackspace, Joyent
Google Compute
Engine, Cloud Storage
GoGrid, CloudLayerIaaS

10. ● Comprehensive, integrated platform
● Extension of Google internal infrastructure
○ Internal services created for us
SHARED with YOU
● Google makes improvements to their cloud
○ ...and who gets them first...
What is the Google Cloud Platform?

11. Google Cloud Platform services

12. Google worldwide network

13. "This is what makes Google Google: its
physical network, its thousands of fiber
miles, and those many thousands of servers
that, in aggregate, add up to the mother of
all clouds."
-- S. Levy/Wired (Oct 2012)
Our cloud runs our business

14. Google Cloud Platform services

15. Agenda
●Part I: Background & Motivation
●Part II: Google App Engine
●Part III: Cloud Platform Updates

16. ➢ Hardware failure?
➢ Traffic spikes? Scaling?
➢ Patches & upgrades?
➢ Network issues?
➢ License management?
Building a traditional web application

17. Why does App Engine exist?

18. ●Easy to build
●Easy to manage
●Easy to scale
● Enabling greater developer productivity!
● Focus on building your app, not sys admin
● Let us wear the pagers!
● BUT don't confuse App Engine w/IaaS
services!
App Engine to the rescue!!

19. Python, Java, Go, PHP not enough for you?

20. Specialized APIs/Services for the Sandbox
Cloud StorageImages
Mail Channel Task Queue
Memcache Datastore URL Fetch
User Service

21. Hardware failure, traffic spikes,
scaling, software patches,
upgrades handled by Google...
and yes, we’ll operate it for you!
How does it work?

22. Administration Console

23. App Engine - By the Numbers*
● 300,000+ Active developers
● 3,000,000+ Active applications
● Half of world's Internet addresses
touch an App Engine server
(per week)
* per month except as otherwise noted

24. App Engine - Larger Numbers*
7,500,000,000+
Hits (per day)
4,500,000,000,000+
Datastore requests
* per month except as otherwise noted

25. Some App Engine users

26. ● 3.6MM DAUs on FB
● 1.9MM DAUs on MS
● Add Orkut, Bebo,
Hi5, Friendster,
Hyves, Ning…
Long-term scaling...

27. Short-term scaling...
Images courtesy Gigya

28. Official blog & live stream apps
hosted on App Engine
On Wedding day...
Blog app served:
● Up to 2k requests per second
● 15 million pageviews
● 5.6 million visitors
Live stream app served:
● Up to 32k requests per second
● 37.7 million pageviews
● 13.7 million visitors
goo.gl/F1SGc
“Royal” scaling

29. App Engine! -> Cloud Endpoints!
Not all apps have web UI

30. App Engine as Mobile Backend
● Pulse’s mobile app
○ Android
○ iOS
○ Kindle
● Awards (2011)
○ Apple’s App Store Hall of Fame
○ Time Magazine’s Top 50 iOS apps
● 30MM+ users, 10MM+ stories read/day
● Thousands of QPS, 100M daily requests
● Use of App Engine cost-effective
● Get started building your mobile backend:
○ developers.google.com/cloud/samples/mbs

31. Gaming... share data, mobile or web!

32. Multimedia scaling...

33. Google Cloud Endpoints
● APIs for web and mobile backends made easy
● Watch the tutorial & get the code at
cloud.google.com/mobilebackendtutorial

34. Popular App Engine use cases
● Mobile/Tablet
○ App backends
○ Cloud persistence
● Social/Mobile Games
○ Speed, scale
○ API integrations
○ Personals/dating
● Consumer Web Apps
○ Unpredictable traffic
○ Scale
● Apps in Academia
○ Any course where
students build web or
mobile apps
○ Research projects
○ IT/Operational apps
● Business Apps
○ Enterprise
○ Java runtime
○ Web or Mobile

35. “Vendor lock-in”
● What is it?
○ Systems which inherently make
it very difficult or impossible to
migrate (data / logic) to other
systems
● Applies to App Engine?
○ Yes & no.
○ Can’t get something for nothing.
○ Goal: take advantage of
Google's infrastructure
○ Price: need to write against
Google APIs. Make sense?
● Not in Google’s DNA
○ Peter Magnusson post http://goo.
gl/X2UyEz

36. ● “Must use” Google APIs
○ Not necessarily
● Web app alternatives
○ Java: servlets, JSP
○ Python: Django, web2py,
Tipfy, Bottle, Pyramid
● Data Storage
○ Cloud SQL (MySQL)
○ Python: Django ORM*
○ Java: JPA/JDO ORMs
● SDKs: open source
● APIs
○ Java: JSR stds, Python: stdlib
● Datastore bulkloader
○ Easily up/download your data
● Open source backend systems
○ Python: AppScale; TyphoonAE
○ Java: CapeDwarf/JBoss - TCK
○ "Private cloud"
Fighting lock-in

37. Pricing
Google
Prediction API
Google
Storage
Pricing
Tier
Monthly
Cost
99.95%
SLA
Paid
Support
Free $0
Paid pay-per-use *
Premier $150USD+ * *
● cloud.google.com/pricing
● Please compare - “Apples to Apples”

38. ● SAS 70, SSAE 16, ISAE 3402, ISO 27001:2005 Certified
● Choose from US- or EU-based service
Security Compliance & Localization

39. ● Integration w/Compute Engine, BigQuery, Cloud Datastore
● Java Servlet 3.0 support + Blobstore migration tool
● VM Runtime App Engine-managed backends via Compute
Engine
● developers.google.com/appengine/features/#roadmap_features
App Engine
Roadmap

40. Getting Started
Google
Prediction API
Google
Storage
What Where
Product Info cloud.google.com/products
Docs, downloads, etc. developers.google.com/appengine
Create/manage your apps appengine.google.com
Help from experts on anything
technical, including App Engine
stackoverflow.com
Cloud Blog googlecloudplatform.blogspot.com
Social
google.com/+googlecloudplatform
@GoogleCloud
● The docs are great, but what about teaching materials?

41. Cloud Playground
●Try App Engine in your browser...
cloud-playground.appspot.com

42. Agenda
●Part I: Background & Motivation
●Part II: Google App Engine
●Part III: Cloud Platform Updates

43. Connect to Google Cloud Platform
BigQuery
Google Cloud Storage
Google App Engine
Compute
Engine
Cloud SQL
Prediction
???
Cloud
Datastore
Translate

44. Google Compute Engine
● Need to go outside App Engine boundaries?
● On-demand VMs (RHEL/CentOS, Debian)
○ 1-8 virtual cores
○ 1.8-6.5GB RAM/core
○ Private VM network
● 3 storage types
○ Local/scratch: 420GB
○ Persistent disk: 10TB
○ Cloud Storage: unlimited
● 3 interfaces
○ Command-line interface
○ Web-based interface
○ Your code via REST API

45. Compute Engine performance
Source: Scalr/gigaom.com (May 2013)
Real-world Performance Observation

46. Google Cloud Platform
Google Cloud Storage
● Fast, scalable, highly-available object store (US or EU)
● Strong read-your-write consistency
● Easy, flexible authentication & sharing (OAuth2, ACLs)
● REST API, App Engine API, Web UI, command-line
● developers.google.com/storage
Google Cloud SQL
● MySQL-compatible relational cloud database
● App Engine API or externally via JDBC
● developers.google.com/cloud-sql

47. Google Cloud Platform
Google Cloud Datastore
● NoSQL database at Google scale
● Low-level interface (access via HTTP/RPC)
● Familiar native datastore for App Engine
● developers.google.com/datastore
Google Translate
● Translate text into other languages programmatically
● Build multilingual apps with Google translation algorithms
● Familiar RESTful interface
● developers.google.com/translate
Cloud Datastore
Translate

48. Google Cloud Platform
Google BigQuery
● Large scale query and analysis cloud service
● Query multi-terabyte datasets in seconds
● SQL-like query language
● Based on Google's internal Dremel project
● cloud.google.com/bigquery-tour
Google Prediction
● Machine Learning service in the cloud
● Supervised learning
● Train models, get "predictions"
● "Magic?" Possibly.
● developers.google.com/prediction
Prediction

49. Fusion Tables
● Think: Google Maps + Excel/Sheets on steroids
● Aggregate disparate data in spreadsheet & visualize
● google.com/fusiontables

50. Course Builder MOOC

51. Course Builder MOOC
● Open-source MOOC software
○ Easily customizable
○ code.google.com/p/course-builder
● Courses hosted on Google App Engine
○ Run your own MOOCs: your code, your control
○ No need to rely on commercial vendor(s)
● More information
○ googleresearch.blogspot.com/2012/09/helping-world-to-teach.html
● Sample course
○ powersearchingwithgoogle.com

52. CloudCourse class registration
● App Engine app for course offerings & registration
● http://goo.gl/o8NRSk

53. Google Apps Script
● script.google.com
● JavaScript baby! outside the browser, in Google’s cloud.
● Browser based IDE
● Deeply integrated with Google Apps & services
○ Automate repetitive tasks
○ Manipulate data across multiple tools

54. Apps Script example

55. Google APIs
● Android
● Chrome
● Google+
● Ads
● Maps
● Drive
● YouTube
● Commerce
● Google TV

56. ● Ido Green - Developer Advocate, Google
○ +GreenIdo
○ @greenido
○ ido-green.appspot.com
● Google Cloud Platform
○ cloud.google.com
○ plus.google.com/+googlecloudplatform
Thank you!
Q&A Time

57. Ahh! WAIT,
there’s one more
thing...

58. Cloud Platform Starter Pack
● Developers from affiliated partners can
receive up to $2,000USD of credit towards
cloud usage
○ Up to $1,000 for Google App Engine
○ Up to $1,000 for Google Compute Engine + others
● Apply at cloud.google.com/starterpack
and use promo code: gdg-in

59. ● Ido Green - Developer Advocate, Google
○ +GreenIdo
○ @greenido
○ ido-green.appspot.com
● Google Cloud Platform
○ cloud.google.com
○ plus.google.com/+googlecloudplatform
Thank you!
Q&A Time