1.
AI at Google
Scott Penberthy
Director of Applied AI, Google

2.
Agenda
Mission Examples How it works
1 2 3 4
Start
Now!

3.
Mission

4.
Mission
Solve Intelligence.1
2 Use (1) to solve everything else.

5.
Approaches
Hand-coded solutions
Inspired by logic
Learn from experience (data)
Inspired by neuroscience

6.
Framework

7.
Inspiration
https://physicsworld.com/a/quantum-microscope-peers-into-the-hydrogen-atom/

8.
Confidence

9.
Examples

10.
Seeing
Deep Learning has become a better
driver than humans by literally going
from pixels to steering, throttle,
distance, and more.
https://waymo.com/tech/

11.
Hearing
Deep Learning now powers real time
audio speech translation for the top
languages, allowing more humans to
connect than before.

12.
Speaking
Deep Learning now generates
realistic human speech, much how
we evolved as mammals.

13.
Reading
Deep Learning can analyze 51
different file formats, condensing
information to tensors for search,
labeling and summarizing.
Iron Mountain InSight™
51 File Formats

14.
Creating
Generative techniques are now
creating imagery and art with
humans, as well as simulated
environments for learning.
source: thispersondoesnotexist.com

15.
Operating
Reinforcement learning techniques
from AlphaGo are optimizing data
centers, simulating quantum
chemistry, and controlling robots.
source: thispersondoesnotexist.com

16.
How it works

17.
Scalar Vector Matrix Tensor

18.
input
input
5
3
a
b
add
mul
c
d
add
e
23
3
5
8
15
3
5
x F(x)
Tensors flow through graphs

19.
Gradient Descent - find F(x)

20.
“Our results are 10^5-10^6 faster with
double-digit process improvement...”
...multiple projects
F(x) v. f(x)
Universal
Approximation

21.
Tensor Pods (11.5 pflops)

22.
Unity (US, JP) 2010
Monet (US,
BR) 2017
Tannat (BR, UY, AR)
2017
Junior (Rio, Santos) 2017
FASTER (US, JP, TW) 2016
PLCN (HK, LA) 2019SJC (JP, HK, SG) 2013
Indigo (SG, ID, AU)
2019
Edge node locations >1000
Edge points of presence >100
Network
Network sea cable investments
The largest cloud network, comprising
>100 points of presence
25% of the World’s Internet Traffic
Tensor connectors
- 1000x our speed

23.
Impact?
Product Users
Data20161950
$
Cost of
Prediction
Source: “Managing the Machines: AI is making prediction cheap, posing new challenges for managers” by
Ajay Agrawal, Joshua Gans, and Avi Goldfarb © 2016 (ajay@agrawal.ca)

24.
Start now

25.
Democratizing AI
https://ai.google
Normal humans
AI Nerds
ML frameworks: TensorFlow, XGBoost, Sklearn, PyTorch
Cloud ML Engine: managed service for
training & serving custom models
RPA:
Build robots for
the office
worker
Kubeflow: deploy ML pipelines for pre-processing data,
training and serving models on Kubernetes
Deep Learning VM images: spin up VMs with
popular ML frameworks pre-installed
AutoML, BQML: train & serve
no model code
ML APIs:
integrate AI into codebase

26.
Process screens across SAP,
Windows, Web, Citrix at 10+ clicks per
second
AI-powered
Robotic Process
Automation

27.
Enable your entire team to
automatically build and deploy
state-of-the-art ML models on
structured data at massively
increased speed and scale.
Cloud AutoML Tables

28.
It’s almost not fair
For each product:
● Relevant tables joined by given IDs
● Some minimal preprocessing done
to match input requirements
● Run until converge
● Benchmarks run between H2 2018
to today (as they became available)

29.
Learn through play
https://ai.google/education

30.
AIY Vision
Build your own smart camera (cloud + edge)

31.
AIY Voice
Build your own assistant (cloud + edge)

32.
ML5.js
Tensorflow for poets
https://www.youtube.com/watch?v=jmznx0Q1fP0

33.
Text
recognition
Image labeling Barcode scanning
Face detection Landmark recognition
ML Kit
Mobile SDK for vision, reading, ocr and barcodes

34.
http://colab.research.google.com
https://kubeflow.org
AI Raspberry Kubes!
Pico 3S Raspberry Pi Cluster, Coral Edge TPU

35.
http://colab.research.google.com
https://kubeflow.org
(free) Personal
Supercomputers

36.
Exponential growth of AI
Because tensors … work.
Arxiv Papers
18 months
Google Directories
18 months
Model Computation
3.5 months

37.
Thank you!