For Data by the Bay Conference, Data Ninja Services explained how to use text analytics to extract any free texts to produce structured data. The two major benefits: Structured data for further analysis such as in machine learning and data mining, and automated natural language understanding between machines.

1. TEXT ANALYTICS SIMPLIFIED
Trung Diep and Ronald Sujithan
DOCOMO Innovations, Inc.
May 18, 2016
1
Copyright © 2016 DOCOMO Innovations, Inc. All Rights Reserved.

2. Talk Outline
• Using text analytics to extract any free-form texts to
produce structured data
– Structured data useful for further analysis such as in
machine learning and data mining
– Automated natural language understanding between
machines
• Live demonstration of text analytics for analyzing
news and trending
– Step #1: Harvesting of URLs
– Step #2: Text extraction
– Step #3: Text analytics
– Step #4: Topic clustering
– Step #5: User-Interface Visualization
• Summary
© 2016 DOCOMO Innovations, Inc.
All Rights Reserved.
2

3. Text Analytics API
© 2016 DOCOMO Innovations, Inc.
All Rights Reserved.
3
Free-form Texts
Structured Data
DocumentsTweets
News
Concepts Categories Entities Keywords
• Cloud-based web services
• Daily updated knowledge base
• Support for customization
• Scalable performance
Text Analytics API

4. Text Analytics Example
© 2016 DOCOMO Innovations, Inc.
All Rights Reserved.
4
Text Analytics API
Structured Data
In February, the World Health Organization declared a global health emergency based on its
association with thousands of cases in Brazil of microcephaly, a birth defect marked by small
head size that can cause severe developmental problems.
Scientists have been scrambling to understand how a mosquito-borne virus that generally
causes mild symptoms in adults could do so much such damage to a developing fetus.
Concepts
Zika virus
outbreak
Microcephaly
Zika fever
Categories
Flavivirus
Diseases and
disorders
Health
Entities
Brazil
World Health
Organization
Keywords
mosquito-
borne virus
birth defect
Results from Smart
Content Service

5. Text Analytics for Many
© 2016 DOCOMO Innovations, Inc.
All Rights Reserved.
5
Article Texts
Article TextsArticle Texts
Structured Data
Machine Learning
Visualization
News Topic Analysis
based on Text Analytics of
Concepts, Categories,
Entities, and Sentiments
Text Analytics API

6. Live Demonstration
• Step #1: Harvesting of URLs
• Step #2: Text extraction
• Step #3: Text analytics
• Step #4: Topic clustering
• Step #5: User-Interface Visualization
© 2016 DOCOMO Innovations, Inc.
All Rights Reserved.
6

7. Summary
• Text analytics useful for extracting any free-
form texts to produce structured data
• Call to action
– Download the IPython Notebook and Java SDKs at
https://dataninja.net/resources/developer-sdks
– Get your API key at https://dataninja.net to learn
more about Data Ninja Text Analysis APIs
– Try the services demos at
https://dataninja.net/resources/demos
– Sign up to use at
https://newsbot.dataninja.net for free 30-day trial
© 2016 DOCOMO Innovations, Inc.
All Rights Reserved.
7