1. Jim Spohrer (IBM)
NSF Visit – Alexandria, VA
Wednesday January 24, 2018
http://www.slideshare.net/spohrer/nsf-20180124-v18
1/24/2018 1
The Future of AI and Education:
Measuring Progress and Preparing
7. TED Arai Todai Robot
1/24/2018 (c) IBM 2017, Cognitive Opentech Group 7
… when will
your smartphone
be smart enough to
pass a university
entrance exam?
8. Questions
• What is the timeline for solving AI and IA?
• Who are the leaders driving AI progress?
• What will the biggest benefits from AI be?
• What are the biggest risks associated with AI, and
are they real?
• What other technologies may have a bigger
impact than AI?
• What are the implications for stakeholders?
• How should we prepare to get the benefits and
avoid the risks?
1/24/2018 (c) IBM 2017, Cognitive Opentech Group 8
9. Every 20 years, compute costs are down
by 1000x
• Cost of Digital Workers
– Moore’s Law can be thought of as
lowering costs by a factor of a…
• Thousand times lower
in 20 years
• Million times lower
in 40 years
• Billion times lower
in 60 years
• Smarter Tools (Terascale)
– Terascale (2017) = $3K
– Terascale (2020) = ~$1K
• Narrow Worker (Petascale)
– Recognition (Fast)
– Petascale (2040) = ~$1K
• Broad Worker (Exascale)
– Reasoning (Slow)
– Exascale (2060) = ~$1K
91/24/2018 (c) IBM 2017, Cognitive Opentech Group
2080204020001960
$1K
$1M
$1B
$1T
206020201980
+/- 10 years
$1
Person Average
Annual Salary
(Living Income)
Super Computer
Cost
Mainframe Cost
Smartphone Cost
T
P
E
T P E
AI Progress on Open Leaderboards
Benchmark Roadmap to solve AI/IA
10. GPD/Employee
1/24/2018 (c) IBM 2017, Cognitive Opentech Group 10
(Source)
Lower compute costs translate into increasing productivity and GDP/employees for nations
Increasing productivity and GDP/employees should translate into wealthier citizens
AI Progress on Open Leaderboards
Benchmark Roadmap to solve AI/IA
11. Leaderboards Framework
AI Progress on Open Leaderboards - Benchmark Roadmap
Perceive World Develop Cognition Build Relationships Fill Roles
Pattern
recognition
Video
understanding
Memory Reasoning Social
interactions
Fluent
conversation
Assistant &
Collaborator
Coach &
Mediator
Speech Actions Declarative Deduction Scripts Speech Acts Tasks Institutions
Chime Thumos SQuAD SAT ROC Story ConvAI
Images Context Episodic Induction Plans Intentions Summarizatio
n
Values
ImageNet VQA DSTC RALI General-AI
Translation Narration Dynamic Abductive Goals Cultures Debate Negotiation
WMT DeepVideo Alexa Prize ICCMA AT
Learning from Labeled Training Data and Searching (Optimization)
Learning by Watching and Reading (Education)
Learning by Doing and being Responsible (Exploration)
2015 2018 2021 2024 2027 2030 2033 2036
1/24/2018 (c) IBM 2017, Cognitive Opentech Group 11
Which experts would be really surprised if it takes less time… and which experts really surprised if it takes longer?
Approx.
Year
Human
Level ->
12. Icons of AI
Progress
• 1956: Dartmouth Conference
organized by:
– John McCarthy (Dartmouth, later
Stanford)
– Marvin Minsky (MIT)
– and two senior scientists:
• Claude Shannon (Bell Labs)
• Nathan Rochester (IBM)
• 1997: Deep Blue (IBM) - Chess
• 2011: Watson Jeopardy! (IBM)
• 2016: AlphaGo (Google DeepMinds)
1/24/2018 (c) IBM 2017, Cognitive Opentech Group 12
14. AI Leaders
• Who is winning?
– Regions China vs USA vs EU vs ROW
– Companies Microsoft vs Google vs IBM
• Leaderboards
– SQuAD – Question Answering
– EFF Measuring AI Progress
1/24/2018 (c) IBM 2017, Cognitive Opentech Group 14
15. AI to IA Timeline: Hard unsolved AI
problems
• 2012-2017 AI Pattern Recognition and
Learning from Massive Labeled Data
– Speech, image, translation, driverless, games
– Chatbots as digital assistants
• 2018 Video Understanding
• 2021 Episodic Memory
• 2022 Learning from Watching
• 2024 Commonsense Reasoning
• 2026 Learning from Reading
• 2028 Learning from Doing
• 2030 Fluent Conversation
• 2031-2039 Cognitive Collaborator and
Mediator; Intelligence Augmentation (IA)
1/24/2018 (c) IBM 2017, Cognitive Opentech Group 15
16. AI Benefits
• Access to expertise
– “Insanely great” labor productivity for trusted
service providers
– Digital workers for healthcare, education, finance,
etc.
• Better choices
– ”Insanely great” collaborations with others on
what matters most
– AI for IA = Augmented Intelligence and higher
value co-creation interactions
1/24/2018 (c) IBM 2017, Cognitive Opentech Group 16
17. AI Risks
• Job Loss
– Shorter term
bigger risk
= de-skilling
• Super-intelligence
– Shorter term
bigger risk
= bad actors
1/24/2018 (c) IBM 2017, Cognitive Opentech Group 17
18. Other Technologies: Bigger impact?
Yes.
• Augmented Reality (AR)/
Virtual Reality (VR)
– Game worlds
grow-up
• Blockchain/
Security Systems
– Trust and security
immutable
• Advanced Materials/
Energy Systems
– Manufacturing as cheap,
local recycling service
(utility fog, artificial leaf, etc.)
1/24/2018 (c) IBM 2017, Cognitive Opentech Group 18
19. Stakeholders
• Individuals
• Families
• Businesses and
other Organizations
• Industry Groups
• Regional
Governments:
– Cities
– States
– Nations
1/24/2018 (c) IBM 2017, Cognitive Opentech Group 19
20. Be Prepared
• Understand open AI code + data +
models + stacks + communities
– Leaderboards
– Ethical conduct
• Learn 3 R’s of IBM’s Cognitive
Opentech Group (COG)
– Read arXiv
– Redo with Github
– Report with Jupyter notebooks on
DSX and/or leaderboards
• Improve your team’s skills of rapidly
rebuilding from scratch
– Build your open code eminence
– Understand open innovation
– Communities + Leaderboards
1/24/2018 (c) IBM 2017, Cognitive Opentech Group 20
1972 used
Punch cards
2016 used
IBM Watson
Open APIs to win…
21. Cupertino Teens
• IBM Watson on Bluemix
1/24/2018 (c) IBM 2017, Cognitive Opentech Group 21
AI for NLP
entity identification
22. Courses
• 2015
– “How to build a cognitive system for Q&A task.”
– 9 months to 40% question answering accuracy
– 1-2 years for 90% accuracy, which questions to reject
• 2025
– “How to use a cognitive system to be a better professional X.”
– Tools to build a student level Q&A from textbook in 1 week
• 2035
– “How to use your cognitive mediator to build a startup.”
– Tools to build faculty level Q&A for textbook in one day
– Cognitive mediator knows a person better than they know themselves
• 2055
– “How to manage your workforce of digital workers.”
– Most people have 100 digital workers.
1/24/2018 22
Take free online cognitive classes today at cognitiveclass.ai
23. Headlines
• 2017 Popular
– “AI vs People”
– “X-Y team up to invest big in AI”
• 2025 Commonplace
– “People using AI to become better at their
professions, serving others.”
– “Teenagers using AI to solve challenges,
and improve their communities.”
• 2085 Resilience
– “Teams competing to rapidly rebuild
socio-economic-technical systems (wise
service systems) from scratch”
– “U.N. Pluto-base makes major discovery
about nature of universe. U.F.P.
established.”
1/24/2018 (c) IBM 2017, Cognitive Opentech Group 23
IEEE 2017
24. IBM-MIT $240M over 10 year AI
mission
1/24/2018 (c) IBM 2017, Cognitive Opentech Group 24
37. 1/24/2018 37
1955 1975 1995 2015 2035 2055
Can better service help us be wiser?
Cognitive Mediator (2035): Tool, Assistant, Collaborator, Coach
38. Courses
2015
– “How to build a cognitive system for Q&A task.”
– 9 months to 40% question answering accuracy
– 1-2 years for 90% accuracy, which questions to reject
2025
– “How to use a cognitive system to be a better professional X.”
– Tools to build a student level Q&A from textbook in 1 week
2035
– “How to use your cognitive mediator to build a startup.”
– Tools to build faculty level Q&A for textbook in one day
– Cognitive mediator knows a person better than they know themselves
2055
– “How to manage your workforce of digital workers.”
– Most people have 100 digital workers.
1/24/2018 38
45. “The best way to predict the future is to inspire the
next generation of students to build it better”
Digital Natives Transportation Water Manufacturing
Energy Construction ICT Retail
Finance Healthcare Education Government
57. In Conclusion
• Hundreds of AI Challenge Leaderboards
exist and the number is growing
• Can one system be built to do them all?
See: https://www.youtube.com/watch?v=8FpdEmySsuc
61. You say you want a
revolution?
October 8, 2017
https://www.slideshare.net/spohrer/revolution-20171008-v23
1/24/2018 (c) IBM 2017, Cognitive Opentech Group
61
62. By 2035, T-Shaped Makers with great
Building Blocks and Cognitive Mediators
1/24/2018 62
Empathy & Teamwork
sector
region/culture
discipline
Depth
Breadth
STEM
Liberal Arts
79. What types of digital cognitive systems?
• Cognitive Build: Outthink Challenge (250K people)
• Imagine a digital cognitive system to help you do something
important in your personal or professional lives
• Team to design it and advocate for it, and then everyone
votes
• Winners: reduce waste and human suffering, screen for
health issues and safety threats, learn life skills and make
better choices, find what you are looking for, move around
more effectively, provide emotional support, provide IT
support, learn about important public policy goals and make
better choices
• Types: Tool, Assistant, Collaborator, Coach, Mediator
1/24/2018 Understanding Cognitive Systems 79
104. Tomorrow: Servitization
• Start with any traditional product that is sold to customers
• Make the product part of a smart/wise service system
– Instrument it (sensors) – Internet of Things/Everything
– Set-up an intelligent operation center to monitor all products’
performance across their life-cycles
– Use big data analytics to determine how to improve product
performance, efficiency, maintenance, etc.
– Offer customer the “product-performance-as-a-service” with
financing/Internet of Service
– Customer benefits from cost-savings, predictability
– Provider benefits margin-improvements, predictability
• Every product becomes a platform technology (a vehicle for
service innovation) for innovative university startups
105. Vision: MMaaRRSS
• Modular Manufacturing as a Regional
Recirculation Service System
– “I am the stuff that will be made into product X for
customer Y.”
– Stuff = Material, Energy, and Information Flows
– Minimize transport costs (for products and waste)
• The Vision: Circular Economy (~4 minutes)
111. Some paths to becoming 64x smarter:
Improving learning and performance
• 2x from Learning sciences (methods)
– Better models of concepts
– Better models of learners
• 2x from Learning technology (tools)
– Guided learning paths
– Elimination of “thrashing”
• 2x from Quantity effect (overlaps)
– More you know, faster you go
– Advanced organizers
• 2x from Lifelong learning (time)
– Longer lives and longer careers
– Keeps “learning-mode” activated
• 2x from Early learning (time)
– Start earlier: Challenged-based approach
– STEM-2D in K-12 (SSME+DAPP Design of Smart Service Systems)
• 2x from Cognitive systems (performance support)
– Technology & Infrastructure Interactions
– Organizations & Others Interactions
112. Next Generation:
Future-Ready T-Shaped Adaptive Innovators
Many disciplines
Many sectors
Many regions/cultures
(understanding & communications)
Deepinonesector
Deepinoneregion/culture
Deepinonediscipline
120. Assisting individuals and organizations
to close their service innovation skills gap
and co-create wiser service systems
empowering employees, customers, citizens
with cognitive mediators
in the collaborative service economy
124. “The best way to predict the future is to inspire the
next generation of students to build it better”
Digital Natives Transportation Water Manufacturing
Energy Construction ICT Retail
Finance Healthcare Education Government
127. Today’s Talk: Cyber-Social-Learning-
Systems• What is the impact of Artificial Intelligence (AI) on CSLS?
– Augmented Intelligence (IA) via digital cognitive systems
– White House OSTP Response(s)
• Other topics to think about:
– What are more of the implications of digital cognitive systems?
• Tool > Assistant > Collaborator > Coach > Mediator
• Transformation > Experience > Data > Software > Hardware
– What does social intelligence require? Episodic Memory?
– What is the impact of augmented reality on CSLS?
– What are possible connections to service systems science
(SSME+DAPP)?
– What type of adaptive innovator with growth mindset needed
(T-shapes)?
1/24/2018 Understanding Cognitive Systems 127
129. White House OSTP Response(s)
• AI for public good
• Social & economic implications
• Education to harness AI
• Research questions and gaps
• Data sets and model sets
• Multidisciplinary research
• Role of incentives and prizes
• Safety and control protocols
• Legal and governance issues
1/24/2018 Understanding Cognitive Systems 129
132. Understanding
Cognitive Systems
Jim Spohrer (IBM), August 25, 2016
CSIG (Cognitive Systems Institute Group) Speaker
Series
http://www.slideshare.net/spohrer/understanding_20
160825_v3
1/24/2018 Understanding Cognitive Systems
132
133. Today’s Talk: Understanding Cognitive
Systems• What is a cognitive system (entity)?
– biological
– technological
– types of digital cognitive systems
• How to…
– build them?
– understand them?
– work with them?
• Steps toward a next generation cognitive
curriculum…
1/24/2018 Understanding Cognitive Systems 133
134. But first…. Cognitive Science, a young
field
• Society
– cognitivesciencesociety.org
• People
– Founders: Roger Schank, Donald Norman,
Allan Collins
– Others: David Rumelhart, Herbert Simon,
Allen Newell
– Today: Patrick Langley, Wayne Gray,
Kenneth Forbus, Ashok Goel, Paul Maglio,
etc.
• Systems Conference
– cogsys.org
– (JCS wishes this was part of HICSS)
1/24/2018 Understanding Cognitive Systems 134
135. Advances in Cognitive Systems -
cogsys.org
1/24/2018 Understanding Cognitive Systems 135
137. Today’s Talk: Understanding Cognitive
Systems• What is a cognitive system (entity)?
– biological
– technological
– types of digital cognitive systems
• How to…
– build them?
– understand them?
– work with them?
• Steps toward a next generation cognitive
curriculum…
1/24/2018 Understanding Cognitive Systems 137
138. What is a cognitive system (entity)?
1/24/2018 Understanding Cognitive Systems 138
139. What is a digital cognitive system
(entity)?
1/24/2018 Understanding Cognitive Systems 139
140. What types of digital cognitive
systems?
• Cognitive Build: Outthink Challenge (250K people)
– Imagine a digital cognitive system to help you do
something important in your personal or professional
lives
– Team to design it and advocate for it, and then
everyone votes
– Winners: reduce waste and human suffering, screen
for health issues and safety threats, learn life skills and
make better choices, find what you are looking for,
move around more effectively, provide emotional
support, provide IT support, learn about important
public policy goals and make better choices
• Types: Tool, Assistant, Collaborator, Coach, Mediator
1/24/2018 Understanding Cognitive Systems 140
149. Backup slides
• Service systems - http://service-
science.info/archives/3368
1/24/2018 Understanding Cognitive Systems 149
150. What is service science?
• IBM initiated effort to establish a
multidisciplinary field to study
service systems … with a focus on
people-centered, IT-enabled service
innovations for business and society
– based on service-dominant logic
– service = value co-creation
– IT-enabled service architectures
– service systems (socio-technical
systems for win-win value co-creation)
• IBM helped establish
– computer science (1945-present)
– service science (2005-present)
1/24/2018 Understanding Cognitive Systems 150
Service systems are dynamic configurations of
resources (people, technology, organizations,
and information) interconnected by
value propositions, internally and externally.
Examples:
- macro: cities, states, nations
- meso: hospitals, universities, businesses
- micro: households, families, individuals
Reference:
Spohrer J, Maglio P, Bailey J, Gruhl D (2007)
Steps toward a science of service systems.
IEEE Computer Society. 40(3):71-77(January).
151. What is service science?
• Now over 500 universities globally teach a more
multidisciplinary approach to service innovation,
including:
– Service management and marketing
– Service engineering and operations
– Service design and arts
– Service public policy and economics
– Service computing and informatics
• SSME + DAPP =
Service Science Management Engineering +
Design Arts Public Policy
– People, technology, organizations, information
interconnected by value propositions.
1/24/2018 Understanding Cognitive Systems 151
Reference:
IfM & IBM (2008). Succeeding through service
innovation: A service perspective for education,
research, business and government.
University of Cambridge Institute for Manufacturing,
Cambridge, UK. 2008.
152. How to get involved?
• Weekly speaker series
– Service innovation
– Service education & research
– Smart service/cognitive systems
• Discovery summits & book series
• Opportunities
– Institutional memberships
– Leadership & ambassadors
– Volunteer opportunities
– Awards & sponsored
conferences
1/24/2018 Understanding Cognitive Systems 152
ISSIP.org is a non-profit society
International Society of Service Innovation Professionals
Membership:
Over 1000 professionals and students from 40+ countries,
50+ companies and 50+ universities.
153. How to get involved?
• Journals (INFORMS,
etc.)
• Conferences (HICSS,
etc.)
• Courses (MIT, etc.)
• Funding (NSF, etc.)
• Society (ISSIP, etc.)
1/24/2018 Understanding Cognitive Systems 153
154. What are the hot topics?
• Smart Service Systems: Intelligence Augmentation
– AI + AR UX (Artificial Intelligence + Augmented Reality User
Experience)
– Smartphones (mobile, social, secure, etc.)
• Collaborative Economy: Servitization
– From assets to co-creation (e.g., Uber, AirBnB, etc.)
– From product to capability/outcome-as-a-service
– Manufacturing as a local recycling service
• Digital Transformation: Trust and Identity
– Blockchain: Don Tapscott’s TED Talk & book
– Big Data: Service Analytics & HAT (Hub of All Things)
1/24/2018 Understanding Cognitive Systems 154
156. Some paths to becoming 64x smarter:
Improving learning and performance
• 2x from Learning sciences (methods)
– Better models of concepts
– Better models of learners
• 2x from Learning technology (tools)
– Guided learning paths
– Elimination of “thrashing”
• 2x from Quantity effect (overlaps)
– More you know, faster you go
– Advanced organizers
• 2x from Lifelong learning (time)
– Longer lives and longer careers
– Keeps “learning-mode” activated
• 2x from Early learning (time)
– Start earlier: Challenged-based approach
– STEM-2D in K-12 (SSME+DAPP Design of Smart Service Systems)
• 2x from Cognitive systems (performance support)
– Technology & Infrastructure Interactions
– Organizations & Others Interactions
157. Next Generation:
Future-Ready T-Shaped Adaptive Innovators
Many disciplines
Many sectors
Many regions/cultures
(understanding & communications)
Deepinonesector
Deepinoneregion/culture
Deepinonediscipline