Cognitive Computing

@pieroleo
Cognitive Computing
How Artificial Intelligence and Machine Learning is
transforming Data into Wisdom
Pietro Leo
Executive Architect - IBM Italy CTO for Big Data Analytics & Watson
IBM Academy of Technology Leadership
Head of IBM Italy Center of Advanced Studies

@pieroleo
WISDOM
KNOWLEDGEDATA
INFORMATION

@pieroleo
DATA
INFORMATION
KNOWLEDGE
WISDOM "Olli"
Self-Drive Vehicle
Co-creative community
3D-printed
Cloud IoT
Artificial Intelligence
30 Transportation Sensors + New ones
Conversation
Recommender
Video Recognition
Personalization
…

5
You shared
your position
with me and
can guess
your mobility
need.
I can take you
where you
need to be
Just enjoy
your new
experience.
Stay safe as
in your
home
I know
what is
needed for
you, even
before you
order it
Please, come
with me and
stay by me.
I know your
content I can
take care of all
your digital life

Artificial
Intelligence
patents have
more than
tripled in 10
years

Venture
Scanner are
tracking 1481
Artificial
Intelligence
companies
with a
combined
funding
amount of
$8.8 Billion

78% of
Executives say
business will
manage
people along
side
machines

11
Image
source:
http://personalexcellence.co/blog/ideal-‐beauty/
City
Lifestyle
ZIPcode
Costal
vs
Inland Marital
status
Generation
Location
Family
Size
Gender
Income
Level
Competitors
Age
Loyalty
&
Card
Activity
Revenue
Size
Life
Stages
Eductation
Legal
status
Sector
Industry

12
Image
source:
City
Lifestyle
ZIPcode
Costal
vs
Inland Marital
status
Generation
Location
Family
Size
Gender
Income
Level
Competitors
Age
Loyalty
&
Card
Activity
Revenue
Size
Life
Stages
Eductation
Legal
status
Sector
Industry
Subscriptions
Date on Site
Wish List
Size of
Network
Check-ins
App usage duration
Number of Apps on Device
Deposits/Withdrawals
Device Usage
Purchase History
Following
Followers
Likes
Number of Hashtags used
History of Hashtags
Search Strings entered
Sequence of visits
Time/Day log in
Time spent on site
Time spent on page
Frequency of Search
Videos Viewed
Photos liked

13
Image
source:
City
Lifestyle
ZIPcode
Costal
vs
Inland Marital
status
Generation
Location
Family
Size
Gender
Income
Level
Competitors
Age
Loyalty
&
Card
Activity
Revenue
Size
Life
Stages
Eductation
Legal
status
Sector
Industry
Subscriptions
Date on Site
Wish List
Size of
Network
Check-ins
App usage duration
Number of Apps on Device
Deposits/Withdrawals
Device Usage
Purchase History
Following
Followers
Likes
Number of Hashtags used
History of Hashtags
Search Strings entered
Sequence of visits
Time/Day log in
Time spent on site
Time spent on page
Frequency of Search
Videos Viewed
Photos liked
Sentiment
Tone
Euphemisms
Hedonism
Extroversion
Face Recognition
Openess
Colloquialism
Reasoning Strategies
Language Modeling
Dialog
Intent
Latent Semantic Analysis
Phonemes
Ontology Analysis
Linguistics
Image Tags
Question Analysis
Self-transcendent
Affective Status

@pieroleo
Source: http://www.bloomberg.com/video/meet-the-world-s-most-connected-man-
Vs~LzkbkR7yhjza~7nji1g.html
Meet the
World's Most
Connected Man

@pieroleo
Rapid growth of exogenous data is transforming healthcare
6 Terabytes
60%
Exogenous Factors
1100 Terabytes
Volume, Variety, Velocity, Veracity:
Educational records, Employment Status,
Social Security Accounts, Mental Health
Records, Caseworker Files, Fitbits, Home
Monitoring Systems, and more…
0.4 Terabytes
Electronic Medical / Health Records,
Physician Management Systems, Claims
Systems and more…
30%
Genomics Factors
10%
Clinical Factors
IBM Watson Health // SOURCE: ©2015 J.M. McGinnis et al., “The Case for More Active
Policy Attention to Health Promotion,” Health Affairs 21, no. 2 (2002):78–93
Data Generated per Life

@pieroleo
Leveraging Exogenous Data for Chronic Care (Type 2 Diabetes;;
Primary & Secondary Prevention)
60%
Exogenous Factors
30%
Genomics Factors
10%
Clinical Factors
SOURCE: ©2015 J.M. McGinnis et al., “The Case for More Active Policy
Attention to Health Promotion,” Health Affairs 21, no. 2 (2002):78–93
Glucose Monitoring
Calorie
Intake
Stress
Levels
Physical Activity
Other vital signs Social

Interaction
Affinity (retail)
Sleep Pattern

18
Automating
the
World
Understanding
the
World
Main Technology Shift
H-Factor
Program Train
Knowledge Workers Learning Workers

19
BIG DATA
DATA
WISDOM
Knowledge
Information
Technology is no more
supporting every kind of
private and public
organizations, it is becoming
part of them.
Machine Intelligence
Is becoming the key
ingredient.
Analytics
Cloud Computing
Data Science
Mobile
Social
Digitalization
Technology
Business
Robotics
Artificial Intelligence
Business & Tech NexusThings

@pieroleo
Cognitive Computing
scales our wisdom to expand what’s possible.
New Information Technology challenge is now about the
possibility to expand our WISDOM options
Watson

@pieroleo
21
Analytic
Systems use
statistical
techniques for
detecting patterns
or detect trends
within data, yield
an understanding
of historical or
current state from
which to draw
conclusions
Text Mining is a class of functions for
parsing and identifying significant words
in language (NLP) as well as
understand the semantic of a textual
content
Cognitive Systems
leverage machine
learning to predict
meaning in features of
human language
(spoken, written, visual)
and related forms of
human reasoning
Multi-Media Mining is a a class of
function for analyzing visual content
such as images or videos
Speech Mining is a class of
functions for analyzing audio
signals including speech to such
as ability Cognitive Solutions
leverage a combination of
cognitive system reasoning
strategies and other analytic and
classical computing techniques to
solve for a complex problem ->
Amplify Human WISDOM in a
specific domain
XXX Mining is class of large
specialized functions for analyzing
“digital representation” in a
specific domain à e.g.,
Bioinformatics, Financial Analytics,
etc.
Capitalize on Digital Data
Machine Learning
is a class of
statistical techniques
that use training
data to recognize
the correlation
between a set of
feature patterns and
outcomes.
It includes also Deep
Learning that is a
rapidly maturing space,
based on neural
network techniques,
that are taught to find
their own features
Emerging Patterns for Artificial Intelligence adoption in Business World
WISDOM

@pieroleo
2011
2015
2016 - AlphaGO=4 Lee Se-Dol=1
1997 - IBM=2.5 Kasparov=2.5
1997
AlphaGO uses self-trained net to evaluate
positions and moves on 30M historical
games
DeepBlue uses a hard-coded objective function
written by a human coupled with High
Performance Computing
2016
10
10170
1040
Applying or having wisdom in real world is
not only an AI game
COMPUTING & MATH WISDOM
IBM Watson – Jeopardy!
SEMANTICS

@pieroleo
IBM Cognitive Computing by numbers in IBM
45
Countries
100+
Applications
already in market
6.000
Researchers
& Specialists in IBM
8
Languages
Learned by Watson
200
Universities
offering Watson courses
500+
Partners
Powered by Watson
28
API
already available
20
Industries
80.000
Developers
building with Watson
Watson Health
Watson Internet
Of Things
Watson Finantial
Services
3 Industrial Business
Units

@pieroleo
24
IBM Platforms are
hosting all layers
needed to design,
develop, build and
SCALE cognitive
systems or apps on
cloud
Watson Core
Watson Health
Cloud
Ecosystems to quick industrialize and scale cognitive systems
are emerging
Watson for Financial
Services
Watson Internet
of Things
IBM Vertical Cognitive Business
Units are emerging blending, in
industry specific platforms,
cognitive layer & specific data
Cognitive Systems &
Products built by
Customers, Partners
and IBM
Ecosystems to quick industrialize and scale cognitive systems are emerging
Ecosystem Cognitive Applications
Cognitive
Products
Cognitive Solutions
& Conversation
Applications
4.
Watson
Services - API
3. 2.Hybrid Cognitive
Frameworks
1.

@pieroleo
25
IBM Platforms are
hosting all layers
needed to design,
develop, build and
SCALE cognitive
systems or apps on
cloud
Watson Core
Watson Health
Cloud
are emerging
Services
Watson Internet
of Things
Cognitive Systems &
Products built by
Customers, Partners
and IBM
Cognitive
Products
Cognitive Solutions
& Conversation
Applications
4.
Watson
Services - API
Frameworks
1.

@pieroleo
26
IBM Conversation Applications
Watson Marketing
• Watson Real-time Personalization
• Watson Customer Experience
Analytics
• Watson Ads
Watson Commerce
• Watson Commerce Insights
• Watson Content Hub
• Watson Order Optimizer
• Watson Personal Shopper
Watson Supply Chain
• Watson Supply Chain Insights
Watson Work
• Watson Workplace
• Watson Work Services (3 APIs)
Watson Education
• Watson Element for Educators
• Watson Enlight for Educators
• Watson Teacher Advisor
Watson Talent
• Watson Talent Insight
• Watson Career Coach
• Watson Recruitment
• Watson Talent Development
• Watson Virtual Agent for HR
Watson for Financial Services
• Watson Regulatory Compliance
• Watson Client Insight for Wealth
Management
• Watson Customer Insight for
Banking
Insurance
Watson Health
• Watson Health Cloud
• Watson Drug Discovery
• Watson Genomics
• Watson Oncology
1.
….and more

@pieroleo
27
IBM Conversation Applications
Watson Marketing
• Watson Real-time Personalization
• Watson Customer Experience
Analytics
• Watson Ads
Watson Commerce
• Watson Commerce Insights
• Watson Content Hub
• Watson Order Optimizer
• Watson Personal Shopper
Watson Supply Chain
• Watson Supply Chain Insights
Watson Work
• Watson Workplace
• Watson Work Services (3 APIs)
Watson Marketing
Watson Education
• Watson Element for Educators
• Watson Enlight for Educators
• Watson Teacher Advisor
Watson Talent
• Watson Talent Insight
• Watson Career Coach
• Watson Recruitment
• Watson Talent Development
• Watson Virtual Agent for HR
Watson for Financial Services
• Watson Regulatory Compliance
• Watson Client Insight for Wealth
Management
Banking
Insurance
Watson Health
• Watson Health Cloud
• Watson Drug Discovery
• Watson Genomics
• Watson Oncology
1.

@pieroleo
1-800 Flowers
Live at: https://www.1800flowers.com/gwyn-1800flowers?flws_rd=1 Live at: https://www.thenorthface.com/xps
GWYN (Gifts When You Need), a Watson-powered personal
concierge designed to help customers find the perfect gift
The North Face
A personal Shop Assistant that can drive you to select the
most appropriate Jacket

@pieroleo
170,000 personal weather
stations worldwide
2.2 B locations forecasted every
15 minutes.
15 B Weather averages 15B
forecast queries daily.
20 terabytes, every day.
Bring Advanced Weather Insights to Business
Source: https://www.wunderground.com/

@pieroleo
Weather is
the secret to
understanding how
consumers feel
30

@pieroleo
And that earned us
a spot in the daily
routines and rituals
of consumers.
31

@pieroleo
Making
real
connections
with

consumers
through
weather

and
analytics.
32

@pieroleo
When
do
people

want
soup?

Soup
warms
L.A.
up

when
it’s
55°
33
New
Yorkers
enjoy

soup
when
temps

drop
from
50° to
30°
LOS ANGELES NEW YORK CITY

@pieroleo
34
https://watsonads.com/#
Watson Ads

@pieroleo
35
IBM Platforms are
hosting all layers
needed to design,
develop, build and
SCALE cognitive
systems or apps on
cloud
Watson Core
Watson Health
Cloud
are emerging
Services
Watson Internet
of Things
Cognitive Systems &
Products built by
Customers, Partners
and IBM
Cognitive
Products
Cognitive Solutions
& Conversation
Applications
4.
Watson
Services - API
Frameworks
1.

@pieroleo
Visual
Recognition
Speech to
Text
Personalit
y
Insights
Language
Translatio
n
Cognitive
Services are
a set of
building
blocks that
can be mixed
to build
cognitive
applications.
They run on a
Platform.
IBM Cognitive Services –
BlueMix - Platform
Text to
speech
2.

@pieroleo
Anaphoric Co-referencing
Colloquialism Processing
Content Management -- Versioning
Convolutional Neural Networks
Curation
Deep Learning
Dialog Framing
Ellipses
Embedded Table Processing
Ensembles and Fusion
Entity Resolution
Factoid Answering
Feature Engineering
Feature Normalization
Focus and Spurious Phrase
Resolution
HTML Page Analysis
Image Management
Information Retrieval
Knowledge (Property) Graphs
Knowledge Answering
Knowledge Extraction Annotators
Knowledge Validation and
Extrapolation
Language Modeling
Latent Semantic Analysis
Learn To Rank
Linguistic Analysis
Logical Reasoning Analysis
Logistical Regression
Machine Learning
Multi-Dimensional Clustering
Multilingual training
n-Gram Analysis (word
combinations and distance)
Ontology Analysis
Pareto Analysis
Passage Answering
PDF Conversion
Phoneme Aggregation
Question Analysis
Question-answering Reasoning
Strategies
Recursive Neural Networks
Rules Processing
Scalable Search
Similarity Analytics
Statistical Language Parsing
Support Vector Machines
Syllable Analysis
Table Answering
Visual Analysis
Visual Rendering
Voice Synthesis
These APIs are underpinned by
50 technologies:
2011
2015Source: http://www.ibm.com/smarterplanet/us/en/ibmwatson/developercloud/services-catalog.html
3.

@pieroleo
IBM Cognitive Services
1. Watson APIs are
continuously.
2. They are
complemented with
tens of other APIs in
other domains, all
running on ONE
platform.
3. They can mashed
up to build an
infinite number of
cognitive assistants.
2011
2015
Pipeline

@pieroleo
39
IBM Platforms are
hosting all layers
needed to design,
develop, build and
SCALE cognitive
systems or apps on
cloud
Watson Core
Watson Health
Cloud
are emerging
Services
Watson Internet
of Things
Cognitive Systems &
Products built by
Customers, Partners
and IBM
Cognitive
Products
Cognitive Solutions
& Conversation
Applications
4.
Watson
Services - API
Frameworks
1.

@pieroleo
New programming environments on clouds are providing a fast and easy
access to IBM Watson APIs and more …
40

@pieroleo
41
IBM Platforms are
hosting all layers
needed to design,
develop, build and
SCALE cognitive
systems or apps on
cloud
Watson Core
Watson Health
Cloud
are emerging
Services
Watson Internet
of Things
Cognitive Systems &
Products built by
Customers, Partners
and IBM
Cognitive
Products
Cognitive Solutions
& Conversation
Applications
4.
Watson
Services - API
Frameworks
1.

@pieroleo
Cognitive Products3.
Watson Analytics
Watson Trend
Watson Machine Learning
…
Chef Watson
Watson Design
Watson Beat
…..
…..
Cognitive
Fro All
Cerativity

@pieroleo
Source:
https://www.whitehouse.gov/sites/default/files/whitehouse_files/microsites/ostp/NSTC/prep
aring_for_the_future_of_ai.pdf
1 Private and public institutions are
encouraged to examine whether and
how they can responsibly leverage AI
and machine learning in ways that will
benefit society.
2 Federal agencies should prioritize
open training data and open data
standards in AI.
3 The Federal Government should
explore ways to improve the capacity of
key agencies to apply AI to their
missions.

@pieroleo
@pieroleo
www.linkedin.com/in/pieroleo
Pietro Leo
Executive Architect
IBM Italy CTO for Big Data Analytics & Watson
IBM Academy of Technology Leadership
Head of IBM Italy Center of Advanced Studies
Grazie!

Cognitive Computing

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Viewers also liked

Viewers also liked (20)

Similar to Cognitive Computing

Similar to Cognitive Computing (20)

More from Pietro Leo

More from Pietro Leo (20)

Recently uploaded

Recently uploaded (20)

Cognitive Computing