SlideShare una empresa de Scribd logo
1 de 28
Descargar para leer sin conexión
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Donnie Prakoso, MSc
AWS Technology Evangelist, ASEAN
Text Analytics Workload with
Amazon Comprehend
AWS User Group Meetup
@donnieprakoso
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Hello, World.
Donnie Prakoso, MSc
AWS Technology Evangelist, ASEAN
@donnieprakoso
donnieprakoso
• Speak in Go and Python
• Machine Learning and Serverless
• I AWS User Groups
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Let’s Discuss Something
• Why do we need text analytics?
• What are the examples of the use cases?
• How Amazon Comprehend can help
you?
• Demo + API and architecture diagram
example
https://bit.ly/aws-donnie-serverless-text-analytics
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Why do we need text
analytics?
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Enabling The Possibility for These Use Cases
• News Media
• Brand trends, correlating events
• Customer engagement
• Call center, issue triage, social media analytics
• Records and research
• Actionable document-centric processes, understand patterns
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS Machine Learning Services
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
FRAMEWORKS AND INTERFACES
AI for data scientists
KERAS
Frameworks Interfaces
APPLICATION SERVICES
AI for everyone
P O L L Y R E K O G N I T I O N C O M P R E H E N DL E X R E K O G N I T I O N
V I D E O
T R A N S C R I B E T R A N S L A T E
PLATFORM SERVICES
AI for engineers
AMAZON
SAGEMAKER
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
G e t S t a r t e d w i t h
A W S M L A p p l i c a t i o n S e r v i c e s
POLLY REKOGNITION COMPREHENDLEX REKOGNITION
VIDEO
TRANSCRIBE TRANSLATE
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Sentiment Entities Languages Key phrases Topic modeling
POWERED BY DEEP
LEARNING
Amazon Comprehend
Discover insights and relationships in text
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Entities
Key Phrases
Language
Sentiment
Amazon
Comprehend
Amazon Comprehend
Discover insights and relationships in text
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
A m a z o n . c o m , I n c . i s l o c a t e d
i n S e a t t l e , W A a n d w a s
f o u n d e d J u l y 5 t h , 1 9 9 4 b y
J e f f B e z o s . O u r c u s t o m e r s
l o v e b u y i n g e v e r y t h i n g f r o m
b o o k s t o b l e n d e r s a t g r e a t
p r i c e s
N a m e d E n t i t i e s
• A m a z o n . c o m : O r g a n i z a t i o n
• S e a t t l e , W A : L o c a t i o n
• J u l y 5 t h , 1 9 9 4 : D a t e
• J e f f B e z o s : P e r s o n
K e y p h r a s e s
• O u r c u s t o m e r s
• b o o k s
• b l e n d e r s
• g r e a t p r i c e s
S e n t i m e n t
• P o s i t i v e
L a n g u a g e
• E n g l i s h
Text Analysis
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Synchronous
• DetectDominantLanguage and BatchDetectDominantLanguage – to detect
the dominant language in a document. We can detect up to 100 languages.
• DetectEntities and Batch DetectEntities – to detect the entities, such as persons
or places, in the document.
• DetectKeyPhrases and Batch DetectKeyPhrases – to detect key noun phrases
that are most indicative of the content.
• DetectSentiment and Batch DetectSentiment – to detect the emotional
sentiment, positive, negative, mixed, or neutral, of a document.
API Summary - Synchronous
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Demo
Twitter Sentiment Analysis w/
Amazon Comprehend
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Twitter
Search API
Analyze social media postings and comments
AWS
Lambda
Amazon
S3
AWS IoT
Amazon
DynamoDB
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Twitter
Stream API
Organize and classify customer feedback and look for common patterns.
Visualize results in Amazon QuickSight
Amazon
Kinesis
Amazon
Athena
Amazon
S3
AWS
Lambda
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Comprehend
Customer Feedback Analytics
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Comprehend
STORM
WORLD SERIES
STOCK MARKET
WASHINGTON
LIBRARY OF
NEWS ARTICLES
Amazon
Comprehend
Topic Modelling
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Topic Modeling
Document Topic Proportion
Doc.txt 0 .89
Doc.txt 1 .67
Doc.txt 2 .91
Topic Term Weight
0 Washington .89
1 Silicon Valley .67
2 Roasting .91
Keywords Topic Groups Document Relationship to Topics
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Asynchronous
• StartTopicDetection – to start a topic modeling job
• ListTopicDetection – to list all your submitted jobs
• DescribeTopicDetection –to get progress status and
information about each submitted job
API Summary - Asynchronous
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Demo
Classifying Customer
Feedback
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Comprehend + AWS = Scale Text Analytics
Amazon Kinesis
Amazon EMR
Amazon Redshift
Amazon EMR
• Semantic
• Rich Filtering
• Grouping, Trends
• Joining, Correlating
• Clustering
• Graph, Search
• Near real-time
• Alerts
Amazon S3
Articles, Documents
Social Media, Support
Amazon Aurora
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Comprehend
Knowledge Management and Discovery
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Ideas Are Welcome
Content Personalization: Customers are using Comprehend NLP output to understand related documents
based on entities, phrases or even topic similarities for trends analysis, to drive content personalization and
recommendations
Semantic Search: Customers using Amazon Comprehend to index entities for boosting and ranking
search results.
Intelligent data warehouse: Customers are using Amazon Comprehend to query unstructured data in
relational databases, processing data within the data lake (S3) and then inserting it back into the data
warehouse
Social Analytics: Customers are using Amazon Comprehend to ingest, process and analyze trends from
entities and sentiment from social media posts across Twitter and Facebook.
Information management: Customers are using Amazon Comprehend for indexing and finding related
content for enterprise information management and various internal business processes including
compliance and IT.
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Lex
Scale
Business Logic
SecurityAnalytics
Text to Speech
Speech to Intent
End to
End
Native support &
maintains context
One-click
deployment
Completely managed
service
Native integration
with AWS Lambda
Encrypted
data in transit
& at rest
Monitor and
improve
Amazon Polly
integrated into API
ASR + NLU integrated
into one API
Dialog Management Deployment
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Lex
Informational
Bots
Chatbots for
everyday consumer
requests
Application
Bots
Build powerful
interfaces to mobile
applications
News updates
Weather information
Game scores ….
Book tickets
Order food
Manage bank accounts ….
Enterprise Productivity
Bots
Streamline enterprise
work activities and
improve efficiencies
Check sales numbers
Marketing performance
Inventory status ….
Internet of Things
(IoT) Bots
Enable conversational
interfaces for device
interactions
Wearables
Appliances
Auto ….
Contact Center
Bots
Chatbots for
customer service IVR
Account inquiries
Bill payment
Service update ….
Use cases
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Intents
A particular goal that the
user wants to achieve
Utterances
Spoken or typed phrases
that invoke your intent
Slots
Data the user must provide to fulfill the
intent
Prompts
Questions that ask the user to input
data
Fulfillment
The business logic required to fulfill the
user’s intent
BookHotel
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Lex Customers
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Build On!
Donnie Prakoso
@donnieprakoso

Más contenido relacionado

La actualidad más candente

La actualidad más candente (20)

ATC303-Cache Me If You Can Minimizing Latency While Optimizing Cost Through A...
ATC303-Cache Me If You Can Minimizing Latency While Optimizing Cost Through A...ATC303-Cache Me If You Can Minimizing Latency While Optimizing Cost Through A...
ATC303-Cache Me If You Can Minimizing Latency While Optimizing Cost Through A...
 
Build Text Analytics Solutions with Amazon Comprehend & Amazon Translate
Build Text Analytics Solutions with Amazon Comprehend & Amazon TranslateBuild Text Analytics Solutions with Amazon Comprehend & Amazon Translate
Build Text Analytics Solutions with Amazon Comprehend & Amazon Translate
 
RET301-Build Single Customer View across Multiple Retail Channels using AWS S...
RET301-Build Single Customer View across Multiple Retail Channels using AWS S...RET301-Build Single Customer View across Multiple Retail Channels using AWS S...
RET301-Build Single Customer View across Multiple Retail Channels using AWS S...
 
STG302_Best Practices for Amazon S3
STG302_Best Practices for Amazon S3STG302_Best Practices for Amazon S3
STG302_Best Practices for Amazon S3
 
NEW LAUNCH! Introducing Amazon Translate – Now in Preview - MCL209 - re:Inven...
NEW LAUNCH! Introducing Amazon Translate – Now in Preview - MCL209 - re:Inven...NEW LAUNCH! Introducing Amazon Translate – Now in Preview - MCL209 - re:Inven...
NEW LAUNCH! Introducing Amazon Translate – Now in Preview - MCL209 - re:Inven...
 
Working with Amazon Lex Chatbots in Amazon Connect - AWS Online Tech Talks
Working with Amazon Lex Chatbots in Amazon Connect - AWS Online Tech TalksWorking with Amazon Lex Chatbots in Amazon Connect - AWS Online Tech Talks
Working with Amazon Lex Chatbots in Amazon Connect - AWS Online Tech Talks
 
Deliver Voice Automated Serverless BI Solutions in Under 3 Hours - ABD325 - r...
Deliver Voice Automated Serverless BI Solutions in Under 3 Hours - ABD325 - r...Deliver Voice Automated Serverless BI Solutions in Under 3 Hours - ABD325 - r...
Deliver Voice Automated Serverless BI Solutions in Under 3 Hours - ABD325 - r...
 
GAM311-How Linden Lab Built a Virtual World on the AWS Cloud.pdf
GAM311-How Linden Lab Built a Virtual World on the AWS Cloud.pdfGAM311-How Linden Lab Built a Virtual World on the AWS Cloud.pdf
GAM311-How Linden Lab Built a Virtual World on the AWS Cloud.pdf
 
FSV307-Capital Markets Discovery How FINRA Runs Trade Analytics and Surveilla...
FSV307-Capital Markets Discovery How FINRA Runs Trade Analytics and Surveilla...FSV307-Capital Markets Discovery How FINRA Runs Trade Analytics and Surveilla...
FSV307-Capital Markets Discovery How FINRA Runs Trade Analytics and Surveilla...
 
BAP202_Amazon Connect Delivers Personalized Customer Experiences for Your Clo...
BAP202_Amazon Connect Delivers Personalized Customer Experiences for Your Clo...BAP202_Amazon Connect Delivers Personalized Customer Experiences for Your Clo...
BAP202_Amazon Connect Delivers Personalized Customer Experiences for Your Clo...
 
SRV301-Optimizing Serverless Application Data Tiers with Amazon DynamoDB
SRV301-Optimizing Serverless Application Data Tiers with Amazon DynamoDBSRV301-Optimizing Serverless Application Data Tiers with Amazon DynamoDB
SRV301-Optimizing Serverless Application Data Tiers with Amazon DynamoDB
 
NEW LAUNCH! Data Driven Apps with GraphQL: AWS AppSync Deep Dive - MBL402 - r...
NEW LAUNCH! Data Driven Apps with GraphQL: AWS AppSync Deep Dive - MBL402 - r...NEW LAUNCH! Data Driven Apps with GraphQL: AWS AppSync Deep Dive - MBL402 - r...
NEW LAUNCH! Data Driven Apps with GraphQL: AWS AppSync Deep Dive - MBL402 - r...
 
Developing Sophisticated Serverless Applications with AI
Developing Sophisticated Serverless Applications with AIDeveloping Sophisticated Serverless Applications with AI
Developing Sophisticated Serverless Applications with AI
 
ABD208_Cox Automotive Empowered to Scale with Splunk Cloud & AWS and Explores...
ABD208_Cox Automotive Empowered to Scale with Splunk Cloud & AWS and Explores...ABD208_Cox Automotive Empowered to Scale with Splunk Cloud & AWS and Explores...
ABD208_Cox Automotive Empowered to Scale with Splunk Cloud & AWS and Explores...
 
RET302-Delight your Retail Customers with an Interactive Customer Service Exp...
RET302-Delight your Retail Customers with an Interactive Customer Service Exp...RET302-Delight your Retail Customers with an Interactive Customer Service Exp...
RET302-Delight your Retail Customers with an Interactive Customer Service Exp...
 
Women in Big Data
Women in Big DataWomen in Big Data
Women in Big Data
 
Supercharge your Machine Learning Solutions with Amazon SageMaker
Supercharge your Machine Learning Solutions with Amazon SageMakerSupercharge your Machine Learning Solutions with Amazon SageMaker
Supercharge your Machine Learning Solutions with Amazon SageMaker
 
GAM301-Migrating the League of Legends Platform into AWS Cloud.pdf
GAM301-Migrating the League of Legends Platform into AWS Cloud.pdfGAM301-Migrating the League of Legends Platform into AWS Cloud.pdf
GAM301-Migrating the League of Legends Platform into AWS Cloud.pdf
 
ALX315_Test Automation for Alexa Skills
ALX315_Test Automation for Alexa SkillsALX315_Test Automation for Alexa Skills
ALX315_Test Automation for Alexa Skills
 
MCL204_How Washington County Sherriff’s Office is using Amazon AI to Identify...
MCL204_How Washington County Sherriff’s Office is using Amazon AI to Identify...MCL204_How Washington County Sherriff’s Office is using Amazon AI to Identify...
MCL204_How Washington County Sherriff’s Office is using Amazon AI to Identify...
 

Similar a Serverless Text Analytics with Amazon Comprehend

AWS의 새로운 언어, 음성, 텍스트 처리 인공지능 서비스::Vikram Anbazhagan::AWS Summit Seoul 2018
AWS의 새로운 언어, 음성, 텍스트 처리 인공지능 서비스::Vikram Anbazhagan::AWS Summit Seoul 2018AWS의 새로운 언어, 음성, 텍스트 처리 인공지능 서비스::Vikram Anbazhagan::AWS Summit Seoul 2018
AWS의 새로운 언어, 음성, 텍스트 처리 인공지능 서비스::Vikram Anbazhagan::AWS Summit Seoul 2018
Amazon Web Services Korea
 

Similar a Serverless Text Analytics with Amazon Comprehend (20)

Sviluppare applicazioni voice-first con AWS e Amazon Alexa
Sviluppare applicazioni voice-first con AWS e Amazon AlexaSviluppare applicazioni voice-first con AWS e Amazon Alexa
Sviluppare applicazioni voice-first con AWS e Amazon Alexa
 
BDA302 Building Intelligent Apps with AWS Machine Learning Language Services
BDA302 Building Intelligent Apps with AWS Machine Learning Language ServicesBDA302 Building Intelligent Apps with AWS Machine Learning Language Services
BDA302 Building Intelligent Apps with AWS Machine Learning Language Services
 
Building Text Analytics Solutions with AWS ML Services
Building Text Analytics Solutions with AWS ML ServicesBuilding Text Analytics Solutions with AWS ML Services
Building Text Analytics Solutions with AWS ML Services
 
Build Intelligent Apps with Amazon ML
Build Intelligent Apps with Amazon ML Build Intelligent Apps with Amazon ML
Build Intelligent Apps with Amazon ML
 
Build Intelligent Apps with Amazon ML - Language Services - BDA302 - Chicago ...
Build Intelligent Apps with Amazon ML - Language Services - BDA302 - Chicago ...Build Intelligent Apps with Amazon ML - Language Services - BDA302 - Chicago ...
Build Intelligent Apps with Amazon ML - Language Services - BDA302 - Chicago ...
 
AWS의 새로운 언어, 음성, 텍스트 처리 인공지능 서비스::Vikram Anbazhagan::AWS Summit Seoul 2018
AWS의 새로운 언어, 음성, 텍스트 처리 인공지능 서비스::Vikram Anbazhagan::AWS Summit Seoul 2018AWS의 새로운 언어, 음성, 텍스트 처리 인공지능 서비스::Vikram Anbazhagan::AWS Summit Seoul 2018
AWS의 새로운 언어, 음성, 텍스트 처리 인공지능 서비스::Vikram Anbazhagan::AWS Summit Seoul 2018
 
Create Advanced Text Analytics Solutions with NLP - BDA310 - New York AWS Sum...
Create Advanced Text Analytics Solutions with NLP - BDA310 - New York AWS Sum...Create Advanced Text Analytics Solutions with NLP - BDA310 - New York AWS Sum...
Create Advanced Text Analytics Solutions with NLP - BDA310 - New York AWS Sum...
 
Add Intelligence to Applications with AWS ML Services
Add Intelligence to Applications with AWS ML ServicesAdd Intelligence to Applications with AWS ML Services
Add Intelligence to Applications with AWS ML Services
 
AWS Machine Learning Week SF: Build Intelligent Applications with AWS ML Serv...
AWS Machine Learning Week SF: Build Intelligent Applications with AWS ML Serv...AWS Machine Learning Week SF: Build Intelligent Applications with AWS ML Serv...
AWS Machine Learning Week SF: Build Intelligent Applications with AWS ML Serv...
 
Add Intelligence to Applications with AWS ML Services
Add Intelligence to Applications with AWS ML ServicesAdd Intelligence to Applications with AWS ML Services
Add Intelligence to Applications with AWS ML Services
 
Add Intelligence to Applications with AWS ML Services: Machine Learning Week ...
Add Intelligence to Applications with AWS ML Services: Machine Learning Week ...Add Intelligence to Applications with AWS ML Services: Machine Learning Week ...
Add Intelligence to Applications with AWS ML Services: Machine Learning Week ...
 
Improving Customer Experience: Enhanced Customer Insights Using Natural Langu...
Improving Customer Experience: Enhanced Customer Insights Using Natural Langu...Improving Customer Experience: Enhanced Customer Insights Using Natural Langu...
Improving Customer Experience: Enhanced Customer Insights Using Natural Langu...
 
AI and Machine Learning - AWS Public Sector Summit Singapore 2017
AI and Machine Learning - AWS Public Sector Summit Singapore 2017AI and Machine Learning - AWS Public Sector Summit Singapore 2017
AI and Machine Learning - AWS Public Sector Summit Singapore 2017
 
Mike Gillespie - Build Intelligent Applications with AWS ML Services (200).pdf
Mike Gillespie - Build Intelligent Applications with AWS ML Services (200).pdfMike Gillespie - Build Intelligent Applications with AWS ML Services (200).pdf
Mike Gillespie - Build Intelligent Applications with AWS ML Services (200).pdf
 
Add Intelligence to Applications with AWS ML: Machine Learning Workshops SF
Add Intelligence to Applications with AWS ML: Machine Learning Workshops SFAdd Intelligence to Applications with AWS ML: Machine Learning Workshops SF
Add Intelligence to Applications with AWS ML: Machine Learning Workshops SF
 
Darin_Briskman_AWS_Machine_Learning_Beyond_the_Hype
Darin_Briskman_AWS_Machine_Learning_Beyond_the_HypeDarin_Briskman_AWS_Machine_Learning_Beyond_the_Hype
Darin_Briskman_AWS_Machine_Learning_Beyond_the_Hype
 
Natural Language Processing for Data Analytics - Tel Aviv Summit 2018
Natural Language Processing for Data Analytics - Tel Aviv Summit 2018Natural Language Processing for Data Analytics - Tel Aviv Summit 2018
Natural Language Processing for Data Analytics - Tel Aviv Summit 2018
 
AI and Machine Learning Services
AI and Machine Learning ServicesAI and Machine Learning Services
AI and Machine Learning Services
 
AWS 機器學習 I ─ 人工智慧 AI
AWS 機器學習 I ─ 人工智慧 AIAWS 機器學習 I ─ 人工智慧 AI
AWS 機器學習 I ─ 人工智慧 AI
 
MCL331_Building a Virtual Assistant with Amazon Polly and Amazon Lex Pollexy
MCL331_Building a Virtual Assistant with Amazon Polly and Amazon Lex PollexyMCL331_Building a Virtual Assistant with Amazon Polly and Amazon Lex Pollexy
MCL331_Building a Virtual Assistant with Amazon Polly and Amazon Lex Pollexy
 

Más de Donnie Prakoso

Más de Donnie Prakoso (6)

Programming Infrastructure with AWS CDK
Programming Infrastructure with AWS CDKProgramming Infrastructure with AWS CDK
Programming Infrastructure with AWS CDK
 
Modern Application Development for Startups
Modern Application Development for StartupsModern Application Development for Startups
Modern Application Development for Startups
 
Operating Microservices at Hyperscale — Tech in Asia PDC 2019
Operating Microservices at Hyperscale — Tech in Asia PDC 2019Operating Microservices at Hyperscale — Tech in Asia PDC 2019
Operating Microservices at Hyperscale — Tech in Asia PDC 2019
 
How to Use AWS Lambda Layers and Lambda Runtime
How to Use AWS Lambda Layers and Lambda RuntimeHow to Use AWS Lambda Layers and Lambda Runtime
How to Use AWS Lambda Layers and Lambda Runtime
 
More Containers Less Operations
More Containers Less OperationsMore Containers Less Operations
More Containers Less Operations
 
Building Serverless Microservices with AWS
Building Serverless Microservices with AWSBuilding Serverless Microservices with AWS
Building Serverless Microservices with AWS
 

Último

Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 

Último (20)

How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
Spring Boot vs Quarkus the ultimate battle - DevoxxUK
Spring Boot vs Quarkus the ultimate battle - DevoxxUKSpring Boot vs Quarkus the ultimate battle - DevoxxUK
Spring Boot vs Quarkus the ultimate battle - DevoxxUK
 
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistan
 
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
 
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfRising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf
 
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 

Serverless Text Analytics with Amazon Comprehend

  • 1. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Donnie Prakoso, MSc AWS Technology Evangelist, ASEAN Text Analytics Workload with Amazon Comprehend AWS User Group Meetup @donnieprakoso
  • 2. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Hello, World. Donnie Prakoso, MSc AWS Technology Evangelist, ASEAN @donnieprakoso donnieprakoso • Speak in Go and Python • Machine Learning and Serverless • I AWS User Groups
  • 3. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Let’s Discuss Something • Why do we need text analytics? • What are the examples of the use cases? • How Amazon Comprehend can help you? • Demo + API and architecture diagram example https://bit.ly/aws-donnie-serverless-text-analytics
  • 4. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Why do we need text analytics?
  • 5. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Enabling The Possibility for These Use Cases • News Media • Brand trends, correlating events • Customer engagement • Call center, issue triage, social media analytics • Records and research • Actionable document-centric processes, understand patterns
  • 6. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. AWS Machine Learning Services
  • 7. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. FRAMEWORKS AND INTERFACES AI for data scientists KERAS Frameworks Interfaces APPLICATION SERVICES AI for everyone P O L L Y R E K O G N I T I O N C O M P R E H E N DL E X R E K O G N I T I O N V I D E O T R A N S C R I B E T R A N S L A T E PLATFORM SERVICES AI for engineers AMAZON SAGEMAKER
  • 8. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. G e t S t a r t e d w i t h A W S M L A p p l i c a t i o n S e r v i c e s POLLY REKOGNITION COMPREHENDLEX REKOGNITION VIDEO TRANSCRIBE TRANSLATE
  • 9. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Sentiment Entities Languages Key phrases Topic modeling POWERED BY DEEP LEARNING Amazon Comprehend Discover insights and relationships in text
  • 10. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Entities Key Phrases Language Sentiment Amazon Comprehend Amazon Comprehend Discover insights and relationships in text
  • 11. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. A m a z o n . c o m , I n c . i s l o c a t e d i n S e a t t l e , W A a n d w a s f o u n d e d J u l y 5 t h , 1 9 9 4 b y J e f f B e z o s . O u r c u s t o m e r s l o v e b u y i n g e v e r y t h i n g f r o m b o o k s t o b l e n d e r s a t g r e a t p r i c e s N a m e d E n t i t i e s • A m a z o n . c o m : O r g a n i z a t i o n • S e a t t l e , W A : L o c a t i o n • J u l y 5 t h , 1 9 9 4 : D a t e • J e f f B e z o s : P e r s o n K e y p h r a s e s • O u r c u s t o m e r s • b o o k s • b l e n d e r s • g r e a t p r i c e s S e n t i m e n t • P o s i t i v e L a n g u a g e • E n g l i s h Text Analysis
  • 12. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Synchronous • DetectDominantLanguage and BatchDetectDominantLanguage – to detect the dominant language in a document. We can detect up to 100 languages. • DetectEntities and Batch DetectEntities – to detect the entities, such as persons or places, in the document. • DetectKeyPhrases and Batch DetectKeyPhrases – to detect key noun phrases that are most indicative of the content. • DetectSentiment and Batch DetectSentiment – to detect the emotional sentiment, positive, negative, mixed, or neutral, of a document. API Summary - Synchronous
  • 13. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Demo Twitter Sentiment Analysis w/ Amazon Comprehend
  • 14. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Twitter Search API Analyze social media postings and comments AWS Lambda Amazon S3 AWS IoT Amazon DynamoDB
  • 15. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Twitter Stream API Organize and classify customer feedback and look for common patterns. Visualize results in Amazon QuickSight Amazon Kinesis Amazon Athena Amazon S3 AWS Lambda
  • 16. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Comprehend Customer Feedback Analytics
  • 17. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Comprehend STORM WORLD SERIES STOCK MARKET WASHINGTON LIBRARY OF NEWS ARTICLES Amazon Comprehend Topic Modelling
  • 18. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Topic Modeling Document Topic Proportion Doc.txt 0 .89 Doc.txt 1 .67 Doc.txt 2 .91 Topic Term Weight 0 Washington .89 1 Silicon Valley .67 2 Roasting .91 Keywords Topic Groups Document Relationship to Topics
  • 19. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Asynchronous • StartTopicDetection – to start a topic modeling job • ListTopicDetection – to list all your submitted jobs • DescribeTopicDetection –to get progress status and information about each submitted job API Summary - Asynchronous
  • 20. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Demo Classifying Customer Feedback
  • 21. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Comprehend + AWS = Scale Text Analytics Amazon Kinesis Amazon EMR Amazon Redshift Amazon EMR • Semantic • Rich Filtering • Grouping, Trends • Joining, Correlating • Clustering • Graph, Search • Near real-time • Alerts Amazon S3 Articles, Documents Social Media, Support Amazon Aurora
  • 22. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Comprehend Knowledge Management and Discovery
  • 23. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Ideas Are Welcome Content Personalization: Customers are using Comprehend NLP output to understand related documents based on entities, phrases or even topic similarities for trends analysis, to drive content personalization and recommendations Semantic Search: Customers using Amazon Comprehend to index entities for boosting and ranking search results. Intelligent data warehouse: Customers are using Amazon Comprehend to query unstructured data in relational databases, processing data within the data lake (S3) and then inserting it back into the data warehouse Social Analytics: Customers are using Amazon Comprehend to ingest, process and analyze trends from entities and sentiment from social media posts across Twitter and Facebook. Information management: Customers are using Amazon Comprehend for indexing and finding related content for enterprise information management and various internal business processes including compliance and IT.
  • 24. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Lex Scale Business Logic SecurityAnalytics Text to Speech Speech to Intent End to End Native support & maintains context One-click deployment Completely managed service Native integration with AWS Lambda Encrypted data in transit & at rest Monitor and improve Amazon Polly integrated into API ASR + NLU integrated into one API Dialog Management Deployment
  • 25. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Lex Informational Bots Chatbots for everyday consumer requests Application Bots Build powerful interfaces to mobile applications News updates Weather information Game scores …. Book tickets Order food Manage bank accounts …. Enterprise Productivity Bots Streamline enterprise work activities and improve efficiencies Check sales numbers Marketing performance Inventory status …. Internet of Things (IoT) Bots Enable conversational interfaces for device interactions Wearables Appliances Auto …. Contact Center Bots Chatbots for customer service IVR Account inquiries Bill payment Service update …. Use cases
  • 26. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Intents A particular goal that the user wants to achieve Utterances Spoken or typed phrases that invoke your intent Slots Data the user must provide to fulfill the intent Prompts Questions that ask the user to input data Fulfillment The business logic required to fulfill the user’s intent BookHotel
  • 27. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Lex Customers
  • 28. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Build On! Donnie Prakoso @donnieprakoso