The document discusses big data, providing definitions and examples of big data problems and opportunities. It outlines a timeline of big data technologies and discusses best practices for big data success, including having a data-driven culture. The document argues that combining big data with machine learning algorithms and large computing power will lead to super-human machine intelligence within 10 years, and provides examples of current deep learning applications in areas like image and text recognition.
15. A Timeline of
Big Data Techology
Doug
Cutting
Hortonworks
Qi Lu
MapReduce
Paper
Google
Search
Build biggest
Index of the
Internet
‘98
MapR
Cloudera
Eric14
Jeff
Dean
‘04
Hadoop
Hadoop
‘06
‘09
‘11
17. % Respondents with Big Data Projects
Already in Operation
100%
HOW
are people
operationalizing
Big Data
50%
2012
0%
2013
EMA Research, Operationalizing Big Data
18. Google BigQuery
Interactive,
Ad Hoc Business Query
Finance
Insight Discovery on
Aggregated
Operational Data
Marketing
Engineering
Sales
Employee Engagement with Operational Data goes through the roof
23. If we have data,
let’s go with that.
If all we have are opinions,
let’s go with mine.
—Jim Barksdale, former Netscape CEO
24. Google Search Latency Experiment
User Survey Opinion
“We prefer 30-result pages to 10-result pages”
Empirical Data
The extra 500ms causes users to search by 25% less
—Marissa Mayer, Google then-VP
That’s $12 Billion per year!
35. Deep Learning Neural Networks
Human
Machine
(Source: http://www.doc.ic.ac.uk/~nd/surprise_96/journal/vol2/cs11/article2.html)
36. Reading Digits in Zip Codes
Geoff Hinton, Yann Lecun, et al.
Demo
!
http://www.cs.toronto.edu/~hinton/adi/index.htm
37. Google Brain Project
16,000 Computers to Recognize Cats
and 19,999 other concepts
Andrew Ng et al.
Application
Unsupervised Image Classification
Source: http://www.nytimes.com/2012/06/26/technology/in-a-big-network-of-computers-evidence-of-machine-learning.html
38. Words are Vectors
Mikolov et al.
Portugal
-
China
+
Bejing
=
Lisbon
!
!!!
Source: http://gigaom.com/2013/08/16/were-on-the-cusp-of-deep-learning-for-the-masses-you-can-thank-google-later/