This document provides instructions for using the MobileFirst Quality Assurance tool on Bluemix to perform sentiment analysis. It first gives a brief overview of MobileFirst Quality Assurance and its capabilities. It then outlines the steps to set up a Mobile Quality Assurance service instance on Bluemix and link it to an iOS app. Finally, it describes how to view the sentiment analysis results in production, including overall sentiment scores, attribute dashboards, comparison to other apps, and attribute trend statistics.
2.
CONTENTSLAB
3B
..........................
USING
SENTIMENT
ANALYSIS
IN
MOBILEFIRST
QUALITY
ASSURANCE
4
3.1
QUICK
OVERVIEW
OF
MOBILEFIRST
QUALITY
ASSURANCE
ON
BLUEMIX
............................................................................
4
3.2
MOBILE
QUALITY
ASSURANCE
SETUP
ON
BLUEMIX
................................................................................................................
5
3.2.1
Register
for
Bluemix
Trial
.......................................................................................................................................................
5
3.2.2
Create
a
MQA
service
in
Bluemix
.........................................................................................................................................
5
3.3
LOOKING
AT
THE
SENTIMENT
ANALYSIS
IN
PRODUCTION
..................................................................................................
13
4. IBM Software
Contents Page 4
Lab 4 Using Sentiment Analysis in MobileFirst Quality
Assurance
In this lab, you will use the MobileFirst Quality Assurance to perform a sentiment analysis. As you might
already know that almost all of the apps are being rated and users are actively using the app store rating
system to provide their feedback. Sentiment analysis can evaluate the feedbacks that the millions have
provided through the app store rating system.
3.1 Quick overview of MobileFirst Quality Assurance on Bluemix
MobileFirst Quality Assurance can be run on premise or off premise (on BlueMix).
IBM® Bluemix™ is a software as a service (SAAS) platform. It has a growing number of IBM software
and non-IBM software on the BlueMix platform. The Bluemix SAAS platform is open standard and cloud
based - it enables any vendors to expose their software as SAAS. Without the hassle of installing and
configuring any hardware and software, you can use the Bluemix platform to support your project. The
capabilities on the Bluemix platform covers a wide range from development, management, operation,
performance, monitoring and deployed runtimes and it is not limited to just IBM software. Some example
of the continuous growing capabilities in Bluemix include:
• Workflow
• WAS Liberty for Java
• Cloudant Mobile Data
• PHP (community)
• SDK for Node JS
• Twilio (3rd party)
• BlazeMeter (3rd party)
• Dev/Op
• Mobile Quality Assurance
• And a lot more!!
We will be using the Mobile Quality Assurance capability on Bluemix for this lab.
Mobile Quality Assurance enables mobile app testing, user validation, and streamlined quality
feedback with sentiment analysis, over-the-air build distribution, automated crash reporting, in-
app bug reporting and user feedback.
Over the Air Build Distribution
Get the latest in the hands of the testers
as soon as it is available.
Automated Crash Reporting
Get aggregated crash logs from pre-
production and production environments
automatically.
In-app Bug Reporting
Submit defects in seconds while using
the application from your mobile device.
User Feedback and Sentiment Analysis
Get feedback about your app straight from
your customers, and mine app ratings and
reviews to extract actionable insights.
5. IBM Software
Contents Page 5
3.2 Mobile Quality Assurance Setup on Bluemix
3.2.1 Register for Bluemix Trial
1. Now you will register for a Bluemix account. Open the Chrome browser, navigate to
Bluemix.net, and click Log In.
2. The Log In screen will prompt you for IBM ID and password. IBM IDs are used to access
many of IBM’s online resources by our customers and partners. They’re free and create no
obligation on your part. You may already have an IBM ID, in which case you can enter it here
and this will automatically enroll you in a 30 day free trial of Bluemix. If you don’t have an IBM
ID you can create one now by clicking the “Create IBM ID” button. When done creating an
IBM ID return to here.
3. Enter your IBM ID and sign in to Bluemix.
3.2.2 Create a MQA service in Bluemix
1. Open a new browser and enter bluemix.net as the url.
2. Follow the instructions to create a new free account.
3. Once you are logged into Bluemix, you will see your Dashboard, which indicates the Apps
and Services that you have created and their state (running/stopped/etc.). The following
screen shot is your dashboard.
6. IBM Software
Contents Page 6
4. Scroll down to the the Services area of the dashboard click the plus sign to ADD A SERVICE.
5. Scroll down to locate the Mobile section. Click on the Mobile Quality Assurance icon.
9. IBM Software
Contents Page 9
9. Click Add Platforms.
10. Select iOS and click Submit.
11. Click on the Configure now for the App Store link. This will link up the MQA with the app
store released version. Note that if there is an error about the popup. Remember to enable
the browser to allow popups for this site.
12. IBM Software
Contents Page 12
14. Now you can choose the app of your choice to do the sentiment analysis on. The country
dropdown box is to select the country’s specific app store. And search for any apps name.
15. After you enter the app name of your choice than select the app. Note that sentiment
analysis cannot be done on apps with only a few feedbacks.
16. Once you selected the app. Click Save Settings in the bottom of the page.
13. IBM Software
Contents Page 13
3.3 Looking at the Sentiment Analysis in Production
1. In the top menu, expand Production > Select User Sentiment.
14. IBM Software
Contents Page 14
2. You will be brought to the summary page. There is an overall score for the app. We have to
know that the score is a reflection of the content in the feedbacks from users. In other words,
if the user doesn’t leave many words in their feedback, that feedback will be evaluated with
lower priorities.
3. Scroll down to see a dashboard of attributes being evaluated. Click on any of them to drill
down. You can see the trend per day. Also there is a date range that you can change the
analysis on.
15. IBM Software
Contents Page 15
4. Click on Compare to compare your app to another app.
5. Search for any other app and select it. The black dotted line is the average in the app store.