Example of Natural Language Processing (sentiment analysis) with Google Cloud Platform. Case study: hotel reviews sentiment analysis.

1. Michał Bryś, Data Scientist @ Allegro, Complexity Garage @ Kraków, 05.02.2016Michal Brys, Senior Data Scientist @ Mezzobit, DevFestPL 2016
Michal Brys
Senior Data Scientist @ Mezzobit
DevFestPL | Warsaw, 26th November 2016
Cloud
Machine Learning
Introduction

2. Michał Bryś, Data Scientist @ Allegro, Complexity Garage @ Kraków, 05.02.2016Michal Brys, Senior Data Scientist @ Mezzobit, DevFestPL 2016
Michał Bryś
Senior Data Scientist @ Mezzobit
michalbrys.com
@michalbrys

3. Michał Bryś, Data Scientist @ Allegro, Complexity Garage @ Kraków, 05.02.2016Michal Brys, Senior Data Scientist @ Mezzobit, DevFestPL 2016

4. Michał Bryś, Data Scientist @ Allegro, Complexity Garage @ Kraków, 05.02.2016Michal Brys, Senior Data Scientist @ Mezzobit, DevFestPL 2016
Machine Learning - basics
Supervised
i.e. classify object to
known pattern.
Unsupervised
i.e. divide set with prior
unknown pattern
Reinforcement
algorithm
learns to react

5. Michał Bryś, Data Scientist @ Allegro, Complexity Garage @ Kraków, 05.02.2016Michal Brys, Senior Data Scientist @ Mezzobit, DevFestPL 2016
https://www.wired.com/2016/03/two-moves-alphago-lee-sedol-redefined-future/

6. Michał Bryś, Data Scientist @ Allegro, Complexity Garage @ Kraków, 05.02.2016Michal Brys, Senior Data Scientist @ Mezzobit, DevFestPL 2016
http://spectrum.ieee.org/cars-that-think/transportation/self-driving/new-pedestrian
-detector-from-google-could-make-selfdriving-cars-cheaper

7. Michał Bryś, Data Scientist @ Allegro, Complexity Garage @ Kraków, 05.02.2016Michal Brys, Senior Data Scientist @ Mezzobit, DevFestPL 2016

8. Michał Bryś, Data Scientist @ Allegro, Complexity Garage @ Kraków, 05.02.2016Michal Brys, Senior Data Scientist @ Mezzobit, DevFestPL 2016
Academic / Research
Industry / Applications
Source: Google Next Conference London 2016
Tensor Flow Cloud Machine Learning Machine Learning APIs

9. Michał Bryś, Data Scientist @ Allegro, Complexity Garage @ Kraków, 05.02.2016Michal Brys, Senior Data Scientist @ Mezzobit, DevFestPL 2016 Source: Google Next Conference London 2016

10. Michał Bryś, Data Scientist @ Allegro, Complexity Garage @ Kraków, 05.02.2016Michal Brys, Senior Data Scientist @ Mezzobit, DevFestPL 2016
How can I use it
in my projects?

11. Michał Bryś, Data Scientist @ Allegro, Complexity Garage @ Kraków, 05.02.2016Michal Brys, Senior Data Scientist @ Mezzobit, DevFestPL 2016
Academic / Research
Industry / Applications
Source: Google Next Conference London 2016
Tensor Flow Cloud Machine Learning Machine Learning APIs

12. Michał Bryś, Data Scientist @ Allegro, Complexity Garage @ Kraków, 05.02.2016Michal Brys, Senior Data Scientist @ Mezzobit, DevFestPL 2016

13. Michał Bryś, Data Scientist @ Allegro, Complexity Garage @ Kraków, 05.02.2016Michal Brys, Senior Data Scientist @ Mezzobit, DevFestPL 2016
All you need to start:
Natural Language API
Jobs API
Speech API
Translate API
Vision API
Cloud Machine
Learning Platform
+
Compute engine
Cloud Storage
Big Query
Cloud Datalabs

14. Michał Bryś, Data Scientist @ Allegro, Complexity Garage @ Kraków, 05.02.2016Michal Brys, Senior Data Scientist @ Mezzobit, DevFestPL 2016
Natural Language API
Case study:
Sentiment analysis
of hotel reviews

15. Michał Bryś, Data Scientist @ Allegro, Complexity Garage @ Kraków, 05.02.2016Michal Brys, Senior Data Scientist @ Mezzobit, DevFestPL 2016
Sentiment analysis
Review:
The staff was very friendly and I was pleasantly surprised at
how clean and refreshing our room was. Great stay!
Score: 0.9
ranges between -1.0 (negative) and 1.0 (positive)
Magnitude: 0.9
overall strength of emotion within the given text, between 0.0 and +inf

16. Michał Bryś, Data Scientist @ Allegro, Complexity Garage @ Kraków, 05.02.2016Michal Brys, Senior Data Scientist @ Mezzobit, DevFestPL 2016
Collect hotel reviews (1)
scrapy crawl tripadvisor -o hotels.txt -s CLOSESPIDER_ITEMCOUNT=15000
The staff was very friendly and I was pleasantly surprised at how clean and
refreshing our room was. Great stay!
Really large apartment fitted out with full size kitchen and appliances (stove,
oven, microwave and full size fridge freezer)
...
https://goo.gl/84rTkT
Compute engine
+ Python, Scrapy

17. Michał Bryś, Data Scientist @ Allegro, Complexity Garage @ Kraków, 05.02.2016Michal Brys, Senior Data Scientist @ Mezzobit, DevFestPL 2016
Score sentiment of review (2)
python sentiment_analysis.py ./resources/hotels.txt
Sentence 0 has a sentiment score of 0.1
Sentence 1 has a sentiment score of -0.3
Sentence 2 has a sentiment score of 0.2
Sentence 3 has a sentiment score of 0.5
Sentence 4 has a sentiment score of 0.6
Sentence 5 has a sentiment score of 0.4
...
Overall Sentiment: score of 0.5 with magnitude of 72.8
https://goo.gl/DQzkZd
Compute engine
+ Python, Natural Language API

18. Michał Bryś, Data Scientist @ Allegro, Complexity Garage @ Kraków, 05.02.2016Michal Brys, Senior Data Scientist @ Mezzobit, DevFestPL 2016
Save results (3)

19. Michał Bryś, Data Scientist @ Allegro, Complexity Garage @ Kraków, 05.02.2016Michal Brys, Senior Data Scientist @ Mezzobit, DevFestPL 2016
Analyze (4)

20. Michał Bryś, Data Scientist @ Allegro, Complexity Garage @ Kraków, 05.02.2016Michal Brys, Senior Data Scientist @ Mezzobit, DevFestPL 2016
Analyze (4)

21. Michał Bryś, Data Scientist @ Allegro, Complexity Garage @ Kraków, 05.02.2016Michal Brys, Senior Data Scientist @ Mezzobit, DevFestPL 2016
● GCP - Powerful platform for data analysis
Summary
● Out-of-the-box trained Machine Learning models
○ Natural Language
○ Speech
○ Computer Vision
● Use Machine Learning in your apps!

22. Michał Bryś, Data Scientist @ Allegro, Complexity Garage @ Kraków, 05.02.2016Michal Brys, Senior Data Scientist @ Mezzobit, DevFestPL 2016
quickdraw.withgoogle.com

23. Michał Bryś, Data Scientist @ Allegro, Complexity Garage @ Kraków, 05.02.2016Michal Brys, Senior Data Scientist @ Mezzobit, DevFestPL 2016
Michal Brys
michal.brys@gmail.com
@michalbrys
[E-book]: Using Google Analytics with R
michalbrys.com/book