SlideShare una empresa de Scribd logo
1 de 22
Descargar para leer sin conexión
Bridging the gap between AI Research and
Human-Centered Products
Andreja Ilic, Principal Group Engineering Manager
Microsoft Office AI, Product, and Engineering
https://www.linkedin.com/in/andrejailic/
Traditional rule based & expert systems
AI based systems
Hybrid systems
You are here
There are two types of products: the ones they use AI, and the ones that will use AI.
AI Research or
Proof of Concept (PoC)
Human-Centered Products or
Production at scale
Bridging the gap between
According to Gartner, 80% of AI projects fail to reach production, and only 60% of those that do
are profitable
DL for chest radiograph diagnosis
“achieved radiologist-level performance on 11 pathologies”
AI Research & PoC
Human-Centered Products
Excel: Data from Picture
Microsoft Editor: Tone and Conciseness suggestions
Word & PowerPoint: Designer
ML Model(s)
Model Explainability
Responsible AI
Benchmark data
Small data & Data
distribution
Data
representativeness
Labeling process &
scale
Model Personalization
Compliant re-training
system
Monitoring tools
Hybrid Inferencing
Trust & Why
(Explainability)
Variety of outputs and
Ranking
User in Control
Feedback Loop
Optimization and
COGS
Endpoints and Devices
Seamless Experience
Researcher's machine
Metrics & Optimization
function
Data and Model
version control
Engineering System
and Infra
Data
AI Models and
System
User Scenario and
Experience
AI
Research
Human-Centered
Products
… …
Pre/post processing
models
…
Data Analytics
…
AI view on Research and Product
AI Project Life Cycle Change Management Team Culture
Non-Tech Challenges. Equally important for success.
Small business
Entrepreneurs
Consumers
(*) How AI Could Empower Any Business, Andrew Ng, TED (2022)
(*) Custom Vision | Azure Cognitive Service
Democratization of AI.
AI Literacy.
Large-Scale AI models
Input: The sun rose over the beach as the waves soothingly rolled
… in and out. The sound of
the waves was like music to
my ears. I took a deep breath
and smelled the salty air. I
felt the sand between my
toes and the sun on my skin.
I was in heaven.
Illustrated by DALL-E 2
Completed by GPT-3 Animated by NUWA-Infinity
Trend of sizes of state-of-the-art NLP models over time
Self-supervised learning & Transformers
Raw data
Training
Large-Scale
Model
Adaption
Task
Q&A
Image captioning
Text Generation
Object Detection
Entity Reco
…
What's in a name? That which we call a rose, by any other word would ___?____ as sweet.
?
Self-supervised learning:
The dark matter of intelligence
Summary
THANK YOU!
Discussion and Q&A
Andreja Ilic, Principal Group Engineering Manager
Microsoft Office AI, Product, and Engineering
https://www.linkedin.com/in/andrejailic/

Más contenido relacionado

Similar a [DSC Europe 22] Bridging the gap between AI Research and Human-Centered Products - Andreja Ilic

A Dawn of Generative AI – Cuneiform Consulting.pdf
A Dawn of Generative AI – Cuneiform Consulting.pdfA Dawn of Generative AI – Cuneiform Consulting.pdf
A Dawn of Generative AI – Cuneiform Consulting.pdfCuneiform Consulting Pvt Ltd.
 
Workshop_Presentation.pptx
Workshop_Presentation.pptxWorkshop_Presentation.pptx
Workshop_Presentation.pptxRUDRAPRASADSABAR
 
AI in the Enterprise - Looking Forward
AI in the Enterprise - Looking ForwardAI in the Enterprise - Looking Forward
AI in the Enterprise - Looking ForwardDavid Vandegrift
 
Decoding L&D Jargon: How Learning Can Use Machine Learning and AI
Decoding L&D Jargon: How Learning Can Use Machine Learning and AIDecoding L&D Jargon: How Learning Can Use Machine Learning and AI
Decoding L&D Jargon: How Learning Can Use Machine Learning and AIDavid Blake
 
Artificial intelligence in practice- part-1
Artificial intelligence in practice- part-1Artificial intelligence in practice- part-1
Artificial intelligence in practice- part-1GMR Group
 
Benefiting from Semantic AI along the data life cycle
Benefiting from Semantic AI along the data life cycleBenefiting from Semantic AI along the data life cycle
Benefiting from Semantic AI along the data life cycleMartin Kaltenböck
 
Data scientist the sexiest job of the 21st century by thomas h davenport and ...
Data scientist the sexiest job of the 21st century by thomas h davenport and ...Data scientist the sexiest job of the 21st century by thomas h davenport and ...
Data scientist the sexiest job of the 21st century by thomas h davenport and ...Darpan Deoghare
 
Towards Secure and Interpretable AI: Scalable Methods, Interactive Visualizat...
Towards Secure and Interpretable AI: Scalable Methods, Interactive Visualizat...Towards Secure and Interpretable AI: Scalable Methods, Interactive Visualizat...
Towards Secure and Interpretable AI: Scalable Methods, Interactive Visualizat...polochau
 
Introduction to AI with Business Use Cases
Introduction to AI with Business Use CasesIntroduction to AI with Business Use Cases
Introduction to AI with Business Use CasesJack C Crawford
 
Running Head ARTIFICIAL INTELLIGENCE AND EXPERT SYSTEMSArtifici
Running Head ARTIFICIAL INTELLIGENCE AND EXPERT SYSTEMSArtificiRunning Head ARTIFICIAL INTELLIGENCE AND EXPERT SYSTEMSArtifici
Running Head ARTIFICIAL INTELLIGENCE AND EXPERT SYSTEMSArtificiMalikPinckney86
 
Running Head ARTIFICIAL INTELLIGENCE AND EXPERT SYSTEMSArtifici.docx
Running Head ARTIFICIAL INTELLIGENCE AND EXPERT SYSTEMSArtifici.docxRunning Head ARTIFICIAL INTELLIGENCE AND EXPERT SYSTEMSArtifici.docx
Running Head ARTIFICIAL INTELLIGENCE AND EXPERT SYSTEMSArtifici.docxtoddr4
 
From Lab to Factory: Or how to turn data into value
From Lab to Factory: Or how to turn data into valueFrom Lab to Factory: Or how to turn data into value
From Lab to Factory: Or how to turn data into valuePeadar Coyle
 
Testing of artificial intelligence; AI quality engineering skils - an introdu...
Testing of artificial intelligence; AI quality engineering skils - an introdu...Testing of artificial intelligence; AI quality engineering skils - an introdu...
Testing of artificial intelligence; AI quality engineering skils - an introdu...Rik Marselis
 
Getting into ai event slides
Getting into ai   event slidesGetting into ai   event slides
Getting into ai event slidesMatthew Miller
 
Bio IT World 2019 - AI For Healthcare - Simon Taylor, Lucidworks
Bio IT World 2019 - AI For Healthcare - Simon Taylor, LucidworksBio IT World 2019 - AI For Healthcare - Simon Taylor, Lucidworks
Bio IT World 2019 - AI For Healthcare - Simon Taylor, LucidworksLucidworks
 
Digital Transformation with AI and Data - H2O.ai and Open Source
Digital Transformation with AI and Data - H2O.ai and Open SourceDigital Transformation with AI and Data - H2O.ai and Open Source
Digital Transformation with AI and Data - H2O.ai and Open Sourcesrisatish ambati
 

Similar a [DSC Europe 22] Bridging the gap between AI Research and Human-Centered Products - Andreja Ilic (20)

A Dawn of Generative AI – Cuneiform Consulting.pdf
A Dawn of Generative AI – Cuneiform Consulting.pdfA Dawn of Generative AI – Cuneiform Consulting.pdf
A Dawn of Generative AI – Cuneiform Consulting.pdf
 
AI pitch SSideri
 AI pitch SSideri  AI pitch SSideri
AI pitch SSideri
 
Workshop_Presentation.pptx
Workshop_Presentation.pptxWorkshop_Presentation.pptx
Workshop_Presentation.pptx
 
MOOCS AI 1.pptx
MOOCS AI 1.pptxMOOCS AI 1.pptx
MOOCS AI 1.pptx
 
Startup Village Keynote 2020
Startup Village Keynote 2020Startup Village Keynote 2020
Startup Village Keynote 2020
 
AI in the Enterprise - Looking Forward
AI in the Enterprise - Looking ForwardAI in the Enterprise - Looking Forward
AI in the Enterprise - Looking Forward
 
Decoding L&D Jargon: How Learning Can Use Machine Learning and AI
Decoding L&D Jargon: How Learning Can Use Machine Learning and AIDecoding L&D Jargon: How Learning Can Use Machine Learning and AI
Decoding L&D Jargon: How Learning Can Use Machine Learning and AI
 
Artificial intelligence in practice- part-1
Artificial intelligence in practice- part-1Artificial intelligence in practice- part-1
Artificial intelligence in practice- part-1
 
Benefiting from Semantic AI along the data life cycle
Benefiting from Semantic AI along the data life cycleBenefiting from Semantic AI along the data life cycle
Benefiting from Semantic AI along the data life cycle
 
Data scientist the sexiest job of the 21st century by thomas h davenport and ...
Data scientist the sexiest job of the 21st century by thomas h davenport and ...Data scientist the sexiest job of the 21st century by thomas h davenport and ...
Data scientist the sexiest job of the 21st century by thomas h davenport and ...
 
Towards Secure and Interpretable AI: Scalable Methods, Interactive Visualizat...
Towards Secure and Interpretable AI: Scalable Methods, Interactive Visualizat...Towards Secure and Interpretable AI: Scalable Methods, Interactive Visualizat...
Towards Secure and Interpretable AI: Scalable Methods, Interactive Visualizat...
 
demo AI ML.pptx
demo AI ML.pptxdemo AI ML.pptx
demo AI ML.pptx
 
Introduction to AI with Business Use Cases
Introduction to AI with Business Use CasesIntroduction to AI with Business Use Cases
Introduction to AI with Business Use Cases
 
Running Head ARTIFICIAL INTELLIGENCE AND EXPERT SYSTEMSArtifici
Running Head ARTIFICIAL INTELLIGENCE AND EXPERT SYSTEMSArtificiRunning Head ARTIFICIAL INTELLIGENCE AND EXPERT SYSTEMSArtifici
Running Head ARTIFICIAL INTELLIGENCE AND EXPERT SYSTEMSArtifici
 
Running Head ARTIFICIAL INTELLIGENCE AND EXPERT SYSTEMSArtifici.docx
Running Head ARTIFICIAL INTELLIGENCE AND EXPERT SYSTEMSArtifici.docxRunning Head ARTIFICIAL INTELLIGENCE AND EXPERT SYSTEMSArtifici.docx
Running Head ARTIFICIAL INTELLIGENCE AND EXPERT SYSTEMSArtifici.docx
 
From Lab to Factory: Or how to turn data into value
From Lab to Factory: Or how to turn data into valueFrom Lab to Factory: Or how to turn data into value
From Lab to Factory: Or how to turn data into value
 
Testing of artificial intelligence; AI quality engineering skils - an introdu...
Testing of artificial intelligence; AI quality engineering skils - an introdu...Testing of artificial intelligence; AI quality engineering skils - an introdu...
Testing of artificial intelligence; AI quality engineering skils - an introdu...
 
Getting into ai event slides
Getting into ai   event slidesGetting into ai   event slides
Getting into ai event slides
 
Bio IT World 2019 - AI For Healthcare - Simon Taylor, Lucidworks
Bio IT World 2019 - AI For Healthcare - Simon Taylor, LucidworksBio IT World 2019 - AI For Healthcare - Simon Taylor, Lucidworks
Bio IT World 2019 - AI For Healthcare - Simon Taylor, Lucidworks
 
Digital Transformation with AI and Data - H2O.ai and Open Source
Digital Transformation with AI and Data - H2O.ai and Open SourceDigital Transformation with AI and Data - H2O.ai and Open Source
Digital Transformation with AI and Data - H2O.ai and Open Source
 

Más de DataScienceConferenc1

[DSC Europe 23] Luciano Catani - AI in Diplomacy.PDF
[DSC Europe 23] Luciano Catani - AI in Diplomacy.PDF[DSC Europe 23] Luciano Catani - AI in Diplomacy.PDF
[DSC Europe 23] Luciano Catani - AI in Diplomacy.PDFDataScienceConferenc1
 
[DSC Europe 23] Rania Wazir - Mathematician jokes, cute cat photos, offensiv...
[DSC Europe 23] Rania Wazir -  Mathematician jokes, cute cat photos, offensiv...[DSC Europe 23] Rania Wazir -  Mathematician jokes, cute cat photos, offensiv...
[DSC Europe 23] Rania Wazir - Mathematician jokes, cute cat photos, offensiv...DataScienceConferenc1
 
[DSC Europe 23] Irena Cerovic - AI in International Development.pdf
[DSC Europe 23] Irena Cerovic - AI in International Development.pdf[DSC Europe 23] Irena Cerovic - AI in International Development.pdf
[DSC Europe 23] Irena Cerovic - AI in International Development.pdfDataScienceConferenc1
 
[DSC Europe 23] Ilija Duni - How Foursquare Builds Meaningful Bridges Between...
[DSC Europe 23] Ilija Duni - How Foursquare Builds Meaningful Bridges Between...[DSC Europe 23] Ilija Duni - How Foursquare Builds Meaningful Bridges Between...
[DSC Europe 23] Ilija Duni - How Foursquare Builds Meaningful Bridges Between...DataScienceConferenc1
 
[DSC Europe 23] Branka Panic - Peace in the age of artificial intelligence.pptx
[DSC Europe 23] Branka Panic - Peace in the age of artificial intelligence.pptx[DSC Europe 23] Branka Panic - Peace in the age of artificial intelligence.pptx
[DSC Europe 23] Branka Panic - Peace in the age of artificial intelligence.pptxDataScienceConferenc1
 
[DSC Europe 23][DigiHealth] Goran Dumic - Data-Driven Approach In Treatments
[DSC Europe 23][DigiHealth]  Goran Dumic -  Data-Driven Approach In Treatments[DSC Europe 23][DigiHealth]  Goran Dumic -  Data-Driven Approach In Treatments
[DSC Europe 23][DigiHealth] Goran Dumic - Data-Driven Approach In TreatmentsDataScienceConferenc1
 
[DSC Europe 23][DigiHealth] Milos Todorovic - Bridging the Gap-Innovating Ag...
[DSC Europe 23][DigiHealth]  Milos Todorovic - Bridging the Gap-Innovating Ag...[DSC Europe 23][DigiHealth]  Milos Todorovic - Bridging the Gap-Innovating Ag...
[DSC Europe 23][DigiHealth] Milos Todorovic - Bridging the Gap-Innovating Ag...DataScienceConferenc1
 
[DSC Europe 23][DigiHealth] Urosh VIlimanovich Clinical Data Management and C...
[DSC Europe 23][DigiHealth] Urosh VIlimanovich Clinical Data Management and C...[DSC Europe 23][DigiHealth] Urosh VIlimanovich Clinical Data Management and C...
[DSC Europe 23][DigiHealth] Urosh VIlimanovich Clinical Data Management and C...DataScienceConferenc1
 
[DSC Europe 23][DigiHealth] Vladimir Brusic - SMART HEALTH HOME: Technology,...
[DSC Europe 23][DigiHealth]  Vladimir Brusic - SMART HEALTH HOME: Technology,...[DSC Europe 23][DigiHealth]  Vladimir Brusic - SMART HEALTH HOME: Technology,...
[DSC Europe 23][DigiHealth] Vladimir Brusic - SMART HEALTH HOME: Technology,...DataScienceConferenc1
 
[DSC Europe 23][DigiHealth] Dimitar Penkov Grid Search Optimization of Novel...
[DSC Europe 23][DigiHealth]  Dimitar Penkov Grid Search Optimization of Novel...[DSC Europe 23][DigiHealth]  Dimitar Penkov Grid Search Optimization of Novel...
[DSC Europe 23][DigiHealth] Dimitar Penkov Grid Search Optimization of Novel...DataScienceConferenc1
 
[DSC Europe 23][DigiHealth] Tomislav Krizan - AIMED
[DSC Europe 23][DigiHealth] Tomislav Krizan - AIMED[DSC Europe 23][DigiHealth] Tomislav Krizan - AIMED
[DSC Europe 23][DigiHealth] Tomislav Krizan - AIMEDDataScienceConferenc1
 
[DSC Europe 23][DigiHealth] Katarina Vucicevic - Navigating theKinetics of Dr...
[DSC Europe 23][DigiHealth] Katarina Vucicevic - Navigating theKinetics of Dr...[DSC Europe 23][DigiHealth] Katarina Vucicevic - Navigating theKinetics of Dr...
[DSC Europe 23][DigiHealth] Katarina Vucicevic - Navigating theKinetics of Dr...DataScienceConferenc1
 
[DSC Europe 23][DigiHealth] Anja Baresic 0- Croatian digital Healthcare ecosy...
[DSC Europe 23][DigiHealth] Anja Baresic 0- Croatian digital Healthcare ecosy...[DSC Europe 23][DigiHealth] Anja Baresic 0- Croatian digital Healthcare ecosy...
[DSC Europe 23][DigiHealth] Anja Baresic 0- Croatian digital Healthcare ecosy...DataScienceConferenc1
 
[DSC Europe 23][AI:CSI] Dragan Pleskonjic - AI Impact on Cybersecurity and P...
[DSC Europe 23][AI:CSI]  Dragan Pleskonjic - AI Impact on Cybersecurity and P...[DSC Europe 23][AI:CSI]  Dragan Pleskonjic - AI Impact on Cybersecurity and P...
[DSC Europe 23][AI:CSI] Dragan Pleskonjic - AI Impact on Cybersecurity and P...DataScienceConferenc1
 
[DSC Europe 23][AI:CSI] Uros Arsenijevic Unlocking Cybersecurity with Seif
[DSC Europe 23][AI:CSI] Uros Arsenijevic Unlocking Cybersecurity with Seif[DSC Europe 23][AI:CSI] Uros Arsenijevic Unlocking Cybersecurity with Seif
[DSC Europe 23][AI:CSI] Uros Arsenijevic Unlocking Cybersecurity with SeifDataScienceConferenc1
 
[DSC Europe 23][AI:CSI] Goran Gvozden Improving Cybersecurity Posture with an...
[DSC Europe 23][AI:CSI] Goran Gvozden Improving Cybersecurity Posture with an...[DSC Europe 23][AI:CSI] Goran Gvozden Improving Cybersecurity Posture with an...
[DSC Europe 23][AI:CSI] Goran Gvozden Improving Cybersecurity Posture with an...DataScienceConferenc1
 
[DSC Europe 23][AI:CSI] Aleksa Stojanovic - Applying AI for Threat Detection ...
[DSC Europe 23][AI:CSI] Aleksa Stojanovic - Applying AI for Threat Detection ...[DSC Europe 23][AI:CSI] Aleksa Stojanovic - Applying AI for Threat Detection ...
[DSC Europe 23][AI:CSI] Aleksa Stojanovic - Applying AI for Threat Detection ...DataScienceConferenc1
 
[DSC Europe 23][DigiHealth] Muthu Ramachandran AI and Blockchain Framework fo...
[DSC Europe 23][DigiHealth] Muthu Ramachandran AI and Blockchain Framework fo...[DSC Europe 23][DigiHealth] Muthu Ramachandran AI and Blockchain Framework fo...
[DSC Europe 23][DigiHealth] Muthu Ramachandran AI and Blockchain Framework fo...DataScienceConferenc1
 
[DSC Europe 23][DigiHealth] Ligia Kornowska-How_may AI help you
[DSC Europe 23][DigiHealth] Ligia Kornowska-How_may AI help you[DSC Europe 23][DigiHealth] Ligia Kornowska-How_may AI help you
[DSC Europe 23][DigiHealth] Ligia Kornowska-How_may AI help youDataScienceConferenc1
 
[DSC Europe 23][DigiHealth] Ilya Zakharov - NETWORK NEUROSCIENCE WHERE THE BR...
[DSC Europe 23][DigiHealth] Ilya Zakharov - NETWORK NEUROSCIENCE WHERE THE BR...[DSC Europe 23][DigiHealth] Ilya Zakharov - NETWORK NEUROSCIENCE WHERE THE BR...
[DSC Europe 23][DigiHealth] Ilya Zakharov - NETWORK NEUROSCIENCE WHERE THE BR...DataScienceConferenc1
 

Más de DataScienceConferenc1 (20)

[DSC Europe 23] Luciano Catani - AI in Diplomacy.PDF
[DSC Europe 23] Luciano Catani - AI in Diplomacy.PDF[DSC Europe 23] Luciano Catani - AI in Diplomacy.PDF
[DSC Europe 23] Luciano Catani - AI in Diplomacy.PDF
 
[DSC Europe 23] Rania Wazir - Mathematician jokes, cute cat photos, offensiv...
[DSC Europe 23] Rania Wazir -  Mathematician jokes, cute cat photos, offensiv...[DSC Europe 23] Rania Wazir -  Mathematician jokes, cute cat photos, offensiv...
[DSC Europe 23] Rania Wazir - Mathematician jokes, cute cat photos, offensiv...
 
[DSC Europe 23] Irena Cerovic - AI in International Development.pdf
[DSC Europe 23] Irena Cerovic - AI in International Development.pdf[DSC Europe 23] Irena Cerovic - AI in International Development.pdf
[DSC Europe 23] Irena Cerovic - AI in International Development.pdf
 
[DSC Europe 23] Ilija Duni - How Foursquare Builds Meaningful Bridges Between...
[DSC Europe 23] Ilija Duni - How Foursquare Builds Meaningful Bridges Between...[DSC Europe 23] Ilija Duni - How Foursquare Builds Meaningful Bridges Between...
[DSC Europe 23] Ilija Duni - How Foursquare Builds Meaningful Bridges Between...
 
[DSC Europe 23] Branka Panic - Peace in the age of artificial intelligence.pptx
[DSC Europe 23] Branka Panic - Peace in the age of artificial intelligence.pptx[DSC Europe 23] Branka Panic - Peace in the age of artificial intelligence.pptx
[DSC Europe 23] Branka Panic - Peace in the age of artificial intelligence.pptx
 
[DSC Europe 23][DigiHealth] Goran Dumic - Data-Driven Approach In Treatments
[DSC Europe 23][DigiHealth]  Goran Dumic -  Data-Driven Approach In Treatments[DSC Europe 23][DigiHealth]  Goran Dumic -  Data-Driven Approach In Treatments
[DSC Europe 23][DigiHealth] Goran Dumic - Data-Driven Approach In Treatments
 
[DSC Europe 23][DigiHealth] Milos Todorovic - Bridging the Gap-Innovating Ag...
[DSC Europe 23][DigiHealth]  Milos Todorovic - Bridging the Gap-Innovating Ag...[DSC Europe 23][DigiHealth]  Milos Todorovic - Bridging the Gap-Innovating Ag...
[DSC Europe 23][DigiHealth] Milos Todorovic - Bridging the Gap-Innovating Ag...
 
[DSC Europe 23][DigiHealth] Urosh VIlimanovich Clinical Data Management and C...
[DSC Europe 23][DigiHealth] Urosh VIlimanovich Clinical Data Management and C...[DSC Europe 23][DigiHealth] Urosh VIlimanovich Clinical Data Management and C...
[DSC Europe 23][DigiHealth] Urosh VIlimanovich Clinical Data Management and C...
 
[DSC Europe 23][DigiHealth] Vladimir Brusic - SMART HEALTH HOME: Technology,...
[DSC Europe 23][DigiHealth]  Vladimir Brusic - SMART HEALTH HOME: Technology,...[DSC Europe 23][DigiHealth]  Vladimir Brusic - SMART HEALTH HOME: Technology,...
[DSC Europe 23][DigiHealth] Vladimir Brusic - SMART HEALTH HOME: Technology,...
 
[DSC Europe 23][DigiHealth] Dimitar Penkov Grid Search Optimization of Novel...
[DSC Europe 23][DigiHealth]  Dimitar Penkov Grid Search Optimization of Novel...[DSC Europe 23][DigiHealth]  Dimitar Penkov Grid Search Optimization of Novel...
[DSC Europe 23][DigiHealth] Dimitar Penkov Grid Search Optimization of Novel...
 
[DSC Europe 23][DigiHealth] Tomislav Krizan - AIMED
[DSC Europe 23][DigiHealth] Tomislav Krizan - AIMED[DSC Europe 23][DigiHealth] Tomislav Krizan - AIMED
[DSC Europe 23][DigiHealth] Tomislav Krizan - AIMED
 
[DSC Europe 23][DigiHealth] Katarina Vucicevic - Navigating theKinetics of Dr...
[DSC Europe 23][DigiHealth] Katarina Vucicevic - Navigating theKinetics of Dr...[DSC Europe 23][DigiHealth] Katarina Vucicevic - Navigating theKinetics of Dr...
[DSC Europe 23][DigiHealth] Katarina Vucicevic - Navigating theKinetics of Dr...
 
[DSC Europe 23][DigiHealth] Anja Baresic 0- Croatian digital Healthcare ecosy...
[DSC Europe 23][DigiHealth] Anja Baresic 0- Croatian digital Healthcare ecosy...[DSC Europe 23][DigiHealth] Anja Baresic 0- Croatian digital Healthcare ecosy...
[DSC Europe 23][DigiHealth] Anja Baresic 0- Croatian digital Healthcare ecosy...
 
[DSC Europe 23][AI:CSI] Dragan Pleskonjic - AI Impact on Cybersecurity and P...
[DSC Europe 23][AI:CSI]  Dragan Pleskonjic - AI Impact on Cybersecurity and P...[DSC Europe 23][AI:CSI]  Dragan Pleskonjic - AI Impact on Cybersecurity and P...
[DSC Europe 23][AI:CSI] Dragan Pleskonjic - AI Impact on Cybersecurity and P...
 
[DSC Europe 23][AI:CSI] Uros Arsenijevic Unlocking Cybersecurity with Seif
[DSC Europe 23][AI:CSI] Uros Arsenijevic Unlocking Cybersecurity with Seif[DSC Europe 23][AI:CSI] Uros Arsenijevic Unlocking Cybersecurity with Seif
[DSC Europe 23][AI:CSI] Uros Arsenijevic Unlocking Cybersecurity with Seif
 
[DSC Europe 23][AI:CSI] Goran Gvozden Improving Cybersecurity Posture with an...
[DSC Europe 23][AI:CSI] Goran Gvozden Improving Cybersecurity Posture with an...[DSC Europe 23][AI:CSI] Goran Gvozden Improving Cybersecurity Posture with an...
[DSC Europe 23][AI:CSI] Goran Gvozden Improving Cybersecurity Posture with an...
 
[DSC Europe 23][AI:CSI] Aleksa Stojanovic - Applying AI for Threat Detection ...
[DSC Europe 23][AI:CSI] Aleksa Stojanovic - Applying AI for Threat Detection ...[DSC Europe 23][AI:CSI] Aleksa Stojanovic - Applying AI for Threat Detection ...
[DSC Europe 23][AI:CSI] Aleksa Stojanovic - Applying AI for Threat Detection ...
 
[DSC Europe 23][DigiHealth] Muthu Ramachandran AI and Blockchain Framework fo...
[DSC Europe 23][DigiHealth] Muthu Ramachandran AI and Blockchain Framework fo...[DSC Europe 23][DigiHealth] Muthu Ramachandran AI and Blockchain Framework fo...
[DSC Europe 23][DigiHealth] Muthu Ramachandran AI and Blockchain Framework fo...
 
[DSC Europe 23][DigiHealth] Ligia Kornowska-How_may AI help you
[DSC Europe 23][DigiHealth] Ligia Kornowska-How_may AI help you[DSC Europe 23][DigiHealth] Ligia Kornowska-How_may AI help you
[DSC Europe 23][DigiHealth] Ligia Kornowska-How_may AI help you
 
[DSC Europe 23][DigiHealth] Ilya Zakharov - NETWORK NEUROSCIENCE WHERE THE BR...
[DSC Europe 23][DigiHealth] Ilya Zakharov - NETWORK NEUROSCIENCE WHERE THE BR...[DSC Europe 23][DigiHealth] Ilya Zakharov - NETWORK NEUROSCIENCE WHERE THE BR...
[DSC Europe 23][DigiHealth] Ilya Zakharov - NETWORK NEUROSCIENCE WHERE THE BR...
 

Último

Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...
Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...
Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...Boston Institute of Analytics
 
Non Text Magic Studio Magic Design for Presentations L&P.pdf
Non Text Magic Studio Magic Design for Presentations L&P.pdfNon Text Magic Studio Magic Design for Presentations L&P.pdf
Non Text Magic Studio Magic Design for Presentations L&P.pdfPratikPatil591646
 
6 Tips for Interpretable Topic Models _ by Nicha Ruchirawat _ Towards Data Sc...
6 Tips for Interpretable Topic Models _ by Nicha Ruchirawat _ Towards Data Sc...6 Tips for Interpretable Topic Models _ by Nicha Ruchirawat _ Towards Data Sc...
6 Tips for Interpretable Topic Models _ by Nicha Ruchirawat _ Towards Data Sc...Dr Arash Najmaei ( Phd., MBA, BSc)
 
IBEF report on the Insurance market in India
IBEF report on the Insurance market in IndiaIBEF report on the Insurance market in India
IBEF report on the Insurance market in IndiaManalVerma4
 
English-8-Q4-W3-Synthesizing-Essential-Information-From-Various-Sources-1.pdf
English-8-Q4-W3-Synthesizing-Essential-Information-From-Various-Sources-1.pdfEnglish-8-Q4-W3-Synthesizing-Essential-Information-From-Various-Sources-1.pdf
English-8-Q4-W3-Synthesizing-Essential-Information-From-Various-Sources-1.pdfblazblazml
 
Digital Indonesia Report 2024 by We Are Social .pdf
Digital Indonesia Report 2024 by We Are Social .pdfDigital Indonesia Report 2024 by We Are Social .pdf
Digital Indonesia Report 2024 by We Are Social .pdfNicoChristianSunaryo
 
why-transparency-and-traceability-are-essential-for-sustainable-supply-chains...
why-transparency-and-traceability-are-essential-for-sustainable-supply-chains...why-transparency-and-traceability-are-essential-for-sustainable-supply-chains...
why-transparency-and-traceability-are-essential-for-sustainable-supply-chains...Jack Cole
 
Digital Marketing Plan, how digital marketing works
Digital Marketing Plan, how digital marketing worksDigital Marketing Plan, how digital marketing works
Digital Marketing Plan, how digital marketing worksdeepakthakur548787
 
Role of Consumer Insights in business transformation
Role of Consumer Insights in business transformationRole of Consumer Insights in business transformation
Role of Consumer Insights in business transformationAnnie Melnic
 
Bank Loan Approval Analysis: A Comprehensive Data Analysis Project
Bank Loan Approval Analysis: A Comprehensive Data Analysis ProjectBank Loan Approval Analysis: A Comprehensive Data Analysis Project
Bank Loan Approval Analysis: A Comprehensive Data Analysis ProjectBoston Institute of Analytics
 
DATA ANALYSIS using various data sets like shoping data set etc
DATA ANALYSIS using various data sets like shoping data set etcDATA ANALYSIS using various data sets like shoping data set etc
DATA ANALYSIS using various data sets like shoping data set etclalithasri22
 
Presentation of project of business person who are success
Presentation of project of business person who are successPresentation of project of business person who are success
Presentation of project of business person who are successPratikSingh115843
 
Statistics For Management by Richard I. Levin 8ed.pdf
Statistics For Management by Richard I. Levin 8ed.pdfStatistics For Management by Richard I. Levin 8ed.pdf
Statistics For Management by Richard I. Levin 8ed.pdfnikeshsingh56
 
Decoding Movie Sentiments: Analyzing Reviews with Data Analysis model
Decoding Movie Sentiments: Analyzing Reviews with Data Analysis modelDecoding Movie Sentiments: Analyzing Reviews with Data Analysis model
Decoding Movie Sentiments: Analyzing Reviews with Data Analysis modelBoston Institute of Analytics
 

Último (17)

Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...
Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...
Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...
 
Non Text Magic Studio Magic Design for Presentations L&P.pdf
Non Text Magic Studio Magic Design for Presentations L&P.pdfNon Text Magic Studio Magic Design for Presentations L&P.pdf
Non Text Magic Studio Magic Design for Presentations L&P.pdf
 
6 Tips for Interpretable Topic Models _ by Nicha Ruchirawat _ Towards Data Sc...
6 Tips for Interpretable Topic Models _ by Nicha Ruchirawat _ Towards Data Sc...6 Tips for Interpretable Topic Models _ by Nicha Ruchirawat _ Towards Data Sc...
6 Tips for Interpretable Topic Models _ by Nicha Ruchirawat _ Towards Data Sc...
 
IBEF report on the Insurance market in India
IBEF report on the Insurance market in IndiaIBEF report on the Insurance market in India
IBEF report on the Insurance market in India
 
English-8-Q4-W3-Synthesizing-Essential-Information-From-Various-Sources-1.pdf
English-8-Q4-W3-Synthesizing-Essential-Information-From-Various-Sources-1.pdfEnglish-8-Q4-W3-Synthesizing-Essential-Information-From-Various-Sources-1.pdf
English-8-Q4-W3-Synthesizing-Essential-Information-From-Various-Sources-1.pdf
 
Digital Indonesia Report 2024 by We Are Social .pdf
Digital Indonesia Report 2024 by We Are Social .pdfDigital Indonesia Report 2024 by We Are Social .pdf
Digital Indonesia Report 2024 by We Are Social .pdf
 
why-transparency-and-traceability-are-essential-for-sustainable-supply-chains...
why-transparency-and-traceability-are-essential-for-sustainable-supply-chains...why-transparency-and-traceability-are-essential-for-sustainable-supply-chains...
why-transparency-and-traceability-are-essential-for-sustainable-supply-chains...
 
2023 Survey Shows Dip in High School E-Cigarette Use
2023 Survey Shows Dip in High School E-Cigarette Use2023 Survey Shows Dip in High School E-Cigarette Use
2023 Survey Shows Dip in High School E-Cigarette Use
 
Insurance Churn Prediction Data Analysis Project
Insurance Churn Prediction Data Analysis ProjectInsurance Churn Prediction Data Analysis Project
Insurance Churn Prediction Data Analysis Project
 
Digital Marketing Plan, how digital marketing works
Digital Marketing Plan, how digital marketing worksDigital Marketing Plan, how digital marketing works
Digital Marketing Plan, how digital marketing works
 
Role of Consumer Insights in business transformation
Role of Consumer Insights in business transformationRole of Consumer Insights in business transformation
Role of Consumer Insights in business transformation
 
Bank Loan Approval Analysis: A Comprehensive Data Analysis Project
Bank Loan Approval Analysis: A Comprehensive Data Analysis ProjectBank Loan Approval Analysis: A Comprehensive Data Analysis Project
Bank Loan Approval Analysis: A Comprehensive Data Analysis Project
 
Data Analysis Project: Stroke Prediction
Data Analysis Project: Stroke PredictionData Analysis Project: Stroke Prediction
Data Analysis Project: Stroke Prediction
 
DATA ANALYSIS using various data sets like shoping data set etc
DATA ANALYSIS using various data sets like shoping data set etcDATA ANALYSIS using various data sets like shoping data set etc
DATA ANALYSIS using various data sets like shoping data set etc
 
Presentation of project of business person who are success
Presentation of project of business person who are successPresentation of project of business person who are success
Presentation of project of business person who are success
 
Statistics For Management by Richard I. Levin 8ed.pdf
Statistics For Management by Richard I. Levin 8ed.pdfStatistics For Management by Richard I. Levin 8ed.pdf
Statistics For Management by Richard I. Levin 8ed.pdf
 
Decoding Movie Sentiments: Analyzing Reviews with Data Analysis model
Decoding Movie Sentiments: Analyzing Reviews with Data Analysis modelDecoding Movie Sentiments: Analyzing Reviews with Data Analysis model
Decoding Movie Sentiments: Analyzing Reviews with Data Analysis model
 

[DSC Europe 22] Bridging the gap between AI Research and Human-Centered Products - Andreja Ilic

  • 1. Bridging the gap between AI Research and Human-Centered Products Andreja Ilic, Principal Group Engineering Manager Microsoft Office AI, Product, and Engineering https://www.linkedin.com/in/andrejailic/
  • 2. Traditional rule based & expert systems AI based systems Hybrid systems You are here There are two types of products: the ones they use AI, and the ones that will use AI.
  • 3. AI Research or Proof of Concept (PoC) Human-Centered Products or Production at scale Bridging the gap between According to Gartner, 80% of AI projects fail to reach production, and only 60% of those that do are profitable
  • 4. DL for chest radiograph diagnosis “achieved radiologist-level performance on 11 pathologies”
  • 5. AI Research & PoC Human-Centered Products
  • 7. Microsoft Editor: Tone and Conciseness suggestions
  • 9. ML Model(s) Model Explainability Responsible AI Benchmark data Small data & Data distribution Data representativeness Labeling process & scale Model Personalization Compliant re-training system Monitoring tools Hybrid Inferencing Trust & Why (Explainability) Variety of outputs and Ranking User in Control Feedback Loop Optimization and COGS Endpoints and Devices Seamless Experience Researcher's machine Metrics & Optimization function Data and Model version control Engineering System and Infra Data AI Models and System User Scenario and Experience AI Research Human-Centered Products … … Pre/post processing models … Data Analytics … AI view on Research and Product
  • 10. AI Project Life Cycle Change Management Team Culture Non-Tech Challenges. Equally important for success.
  • 12. (*) How AI Could Empower Any Business, Andrew Ng, TED (2022)
  • 13. (*) Custom Vision | Azure Cognitive Service
  • 15. Large-Scale AI models Input: The sun rose over the beach as the waves soothingly rolled … in and out. The sound of the waves was like music to my ears. I took a deep breath and smelled the salty air. I felt the sand between my toes and the sun on my skin. I was in heaven. Illustrated by DALL-E 2 Completed by GPT-3 Animated by NUWA-Infinity
  • 16.
  • 17. Trend of sizes of state-of-the-art NLP models over time
  • 18. Self-supervised learning & Transformers Raw data Training Large-Scale Model Adaption Task Q&A Image captioning Text Generation Object Detection Entity Reco … What's in a name? That which we call a rose, by any other word would ___?____ as sweet. ?
  • 19. Self-supervised learning: The dark matter of intelligence
  • 21.
  • 22. THANK YOU! Discussion and Q&A Andreja Ilic, Principal Group Engineering Manager Microsoft Office AI, Product, and Engineering https://www.linkedin.com/in/andrejailic/

Notas del editor

  1. Intro words. Topic of the talk & Title. AI and humanity in co-existence. Segue: start w/ why 
  2. Technological revolutions. AI is the new electricity, catalyst of seismic changes, and tech platform of our generation. Traditional programming vs ML. Rules, Input, and Output. Automate and enhance workflows, or new unmet user needs. OCR for digitization and visual impairment. Trend that is clear – Algorithms are being replaced with ML/DNN models. Movie or product recommendation. AI Inflection Point today – technology has abstracted away a lot of layers so that wider base of people and product roles can try it. Example chatbot for customer service. Cloud first, Mobile first => AI first. Segue: OK, so what’s the problem
  3. Exciting breakthroughs and SOTA research, but despite all of this not much deployed in the real world. Gartner data. Goal of the talk: experience and perspectives for the future. Segue: start with examples
  4. Various papers, trusted and reviewed. Benchmark and model optimization function, precision. Pneumonia vs Hernia. Small data set. Explainability. Trust. OpenAI not in your day-to-day apps yet. Apps in your mobile not using them. Segue: Why is this?
  5. Why: it’s hard and expensive + descriptive + great responsibility. Beyond happy path. My intro. AI for productivity, quality, and cognitive load. Example from my work, to paint a picture of problems and insights.
  6. Analog content digitization, transformation, and augmentation. Scanner in your pocket. Tone of papers for ImageOfTable to Table. Great for demo, but sufficient? Generalization Robustness. Data is fixed and often preprocessed. Unseen scenarios and noise. Cow camel example, and lazy student. Correlation vs causation. GANs, Transfer Learning etc. Seamless user experience: Table auto-detection and confidence output per cell. Expert system with a lot of models. Hybrid Inferencing. Works on you Ferrari or Maserati, but should work on humble version. Model for client. Model distillation.
  7. Editor – Intelligent Writing Assistant, from s& to TP, summarization, etc. Tone for thoughtful decisions about messaging. Conciseness wordy to alternate clear versions. Data. Small data problem. Language. Responsibility AI. Machine amplifies, solution not to have better data. Toxic outputs – bias or offensiveness. System optimization. COGS & supply issues – there is not enough harder even if you have money. Scale of Editor – millions of request per second. Prediction model.
  8. Intelligent assistance tool that helps you create documents with a polished, professional, and consistent look and feel with no design skills required. Model (feature) metrics. Precision/Recall vs Kept. Quality of model from user behave. Engagement vs Task. Possession vs Love. Personalization. Subjectiveness, no ground truth data. Meaning, time to Wow – easy. Time to Value – hard. Ship initial model and personalize per user. Compliant re-training. When you ship it, it’s only the beginning. Eng system to process this and train.
  9. Hopefully lands message for iceberg Every box Research working on. Problems: a) isolated, and b) priority/funding. Segue: Up until now we talked about technical problems. What about non-tech ones?
  10. Project life cycle. AI different from software development. Iterations, start with ship, unknowns. Change. Transforms the work of people and meaning. AI Radiologist. Think about influence upfront. Culture. Success determined by team/culture. Working across roles. Learn it all, instead of know it all.
  11. From large companies to small business. Budget or hiring. One size fits all approach. Bakery example – collectively they are big, but each is different.
  12. Long tail problem. Sorted by value – customer problems on the right. Research correlated with this curve, but things changing.
  13. Low-code & no-code, provide data and hints. Tech savvy. Example of inventory process.
  14. AI – literacy and math. Society better with everybody reading, writing, and basic math. AI Next. AI in hands of research and business. Give it to hands of everybody. Democratization. Enabling all requires solving all the problems we talked about. Segue: Large scale models, reducing this gap.
  15. GPT-3, text completions on prompts. DALL:E image based on description. NUWA-Infinity animating – video from initial image frame. Humans adapt quickly. Mind-blowing. Segue: Cool, but what about the value.
  16. GPT3 Playground. Chat between client and bank agent. Mail covering details and answering questions. Speed-up the process for email follow-up.
  17. Chart linear, but log-scale. 86 billion neurons in the human brain. Know everything, understand nothing. This changed. Chess, Turing test, Elementary school – easy. Did not plateau. Bigger is better – monolingual to multilingual. Unimodal to multimodality. Segue: what is data.
  18. New paradigm in AI, learning from data. Extract representation and capture meaning and context. I will not go into Transformers, but this is current SOTA architecture for large-scale models. Example: text and masking some word, or frames and masking some frame. Model trained to predict.
  19. Supervised learning was a bottleneck. Generalist models. Learning as babies – observation or experimenting. Predicting future = common sense. Compression – understanding the essence of the topic. Creativity – biggest systemic error in thinking, models will contribute to knowledge. Don’t be racist. Foundational models – develop by large companies or governments.
  20. Not disappointed, not having magic list – start with why, humans at the center, importance of team, democratization of AI, research breakthroughs like large-scale models etc. One final thoughts – in 10 years, “remember the day”. Today.