Using Pivotal Cloud Foundry with
Google BigQuery and Vision API
Joshua McKenty, Pivotal
Tino Tereshko, Google
Michael Goddard, Pivotal

We believe transforming how the
world builds software will shape
the future of our world
2

“A company’s core advantage is in
the applications it builds.”
Diane Greene, Google
Infoworld Q&A, May 23, 2016

Both speed and safety are required
• Addressing customer needs faster, with
less downtime retains your customers
• Protecting market share from disruptors
or something unforeseen
• Being able to make quick experiments
(that aren’t destabilizing) gives you
more chances at success
• The first to successfully rollout the
innovation tends to win, defines the
category

Enterprise Pattern: Cloud Native

Cloud Native
DevOps Continuous
Delivery
ContainersMicro services

Why Go Cloud Native?
▪ Cloud Portability
▪ Operational Efficiencies
▪ Autoscaling
▪ Automated Patching & Upgrading
▪ Standardization of Tooling & Platform-Provided Services
▪ Management & Monitoring through the platform
▪ Runtime consolidation
▪ Reduction of multiple vendors

Cloud Native
• Microservices architecture
• API-first design
• Fault-tolerant and resilient design
• Cloud-agnostic runtime implementation
• Bundled metrics and monitoring
• Proactive failure testing
Cloud Resilient
Cloud Friendly
Cloud Ready
• No permanent disk access
• Self-contained application
• Platform-managed ports and networking
• Consumes platform-managed backing services
• 12 Factor App methodology
• Horizontally scalable
• Leverages platform for high availability
A Cloud Application Maturity Model

Cloud native and microservice models
are moving into the Fortune 500
“Two people built an app and got it
into the App Store in five weeks”
“I said to my vendors, I don’t want five
years ago. I want five years from now.
“The adopters we speak to today, like GE, HP, Equinix, PayPal, Capital
One, Goldman Sachs, Airbnb, Medallia, Square, and Xoom say that
microservices are well worth the tradeoffs.”

Application Framework
Infrastructure Automation
Platform Runtime
Language framework for microservice-based architectures including
components for service discovery, metrics, and circuit breakers.
Application container runtime with attachable backing services,
automated CI/CD, routing, health management and logging.
A single deployment API for provisioning for bit-for-bit, consistent,
self-healing deployments across any private or public cloud.
Dev
Dev Ops
Ops
Spring
Cloud
Spring
Boot
BOSH
Cloud Foundry
Pivotal
Cloud Foundry
Pivotal
Contract: 12 Factor Application
Contract: BOSH Release
Cloud Native with Pivotal

Connect to Data-Driven
Business Apps with the
service broker for GCP:
• Cloud SQL
• BigQuery
• Cloud PubSub
• Google Cloud Storage
• Vision API
• Speech API
• Natural Language API
• Translate API
Service
Broker
Pivotal Cloud Foundry with GCP Services

Enterprise Pattern: Extending Cloud Native
with Data & Analytics

Google Cloud Platform Services
VIRTUAL NETWORK
LOAD BALANCING
CDN
DNS
INTERCONNECT
Management Compute Storage Networking Data
Machine
Learning
STACKDRIVER
IDENTITY AND
ACCESS
MANAGEMENT
CLOUD ML
SPEECH API
VISION API
TRANSLATE API
NATURAL
LANGUAGE API

Google Cloud Platform Services
VIRTUAL NETWORK
LOAD BALANCING
CDN
DNS
INTERCONNECT
Management Compute Storage Networking Data
Machine
Learning
STACKDRIVER
IDENTITY AND
ACCESS
MANAGEMENT
CLOUD ML
SPEECH API
VISION API
TRANSLATE API
NATURAL
LANGUAGE API

Google BigQuery

1616
Demo

Most importantly, complexity is hidden from end user
We only paid $20
We just rented ~3000 cores from Google for ~20 seconds1
2
3
BigQuery - explained
@thetinot

18
What is BigQuery?
Durable and Highly Available
Convenience of SQL
Petabyte-Scale and Fast
Fully Managed, No-Ops Data Warehouse

19
BigQuery: 5 years of seamless innovation
2010 2011 2012 2013 2014
Public launch
Large query results
2015 2016
900
300
0
1,200
Code Submits
Beta Release at Google I/O
Dremel X
Big JOIN support
Dynamic Execution
Capacitor
Faster shuffle
100k qps streaming
User-defined functions

BigQuery - The Database is The Data Center(s)
@thetinot

Machine Learning for Everyone

22
Android
Apps
Gmail
Maps
Photos
Speech
Search
Translation
YouTube
and many others ...
Used across products:
2012 2013 2014 2015
1500
1000
500
0
Number of directories containing model description files
Rapidly accelerating use of deep learning at
Google

Google confidential | Do not distribute
Applications that can see, hear and understand

Google Cloud Platform 24
AlphaBeta
Cloud
Natural Language
Pre-Trained Machine Learning Models
BetaGAGA
Cloud
Speech
Cloud
Translate
Cloud
Vision
CloudML
Fully trained ML models from Google that allow a developer to easily
take advantage of rich machine learning capabilities.
Custom ML
Managed TensorFlow service
to train and predict custom
models on customer-provided
datasets.

Sample App: Landmark Vanguard

App
Data &
Analytics
Platform
Infrastructure
Sample App: Landmark Vanguard

Demo

Thanks - Questions?
Overview of PCF on GCP
http://www.pivotal.io/google
Download a trial of PCF for GCP
https://network.pivotal.io/products/ops-manager
GCP Service Broker for PCF
https://network.pivotal.io/products/gcp-service-broker/
Free trial of Pivotal Web Services
http://run.pivotal.io
Landmark Vanguard Sample App
https://github.com/cf-platform-eng/gcp-ml-sentiment
Image resizing service
https://github.com/cf-platform-eng/image-resizing-service

30