Introduction to android testing

introduction to android
testing
a hands-on approach

Copyright (C) 2011 Diego Torres Milano All rights reserved

diego torres milano
android system engineer
ﬂextronics

http://dtmilano.blogspot.com


“Never test the depth of
the water with both feet.”
-- Anonymous


agenda

android testing background

test driven development

code coverage

continuous integration

behavior driven development


operating systems
July 2011

Android
150M

iOS
222M


android testing
background


?

Why
?

What Why
?

What Why
When ?

What Why
When
how
?

types of test
tests

unit
functional

performance
integration


types of test
unit


types of test
by programmers for programmers
unit


types of test
unit
in a programming language


types of test
unit

JUnit is the de-facto standard


types of test
unit


test objects in isolation


types of test
unit



in a repeatable way


types of test
unit



in a repeatable way

usually rely on mock objects


types of test
functional


types of test
by business & QA people functional


types of test
in a business domain language


types of test

test completeness & correctness


types of test


BDD has gained some popularity


types of test


BDD has gained some popularity

FitNesse can help


types of test
integration


types of test
how components work together integration


types of test
modules have been unit tested


types of test

android components need integration
with the system


types of test

android components need integration
with the system

testing framework facilitates
integration


types of test
performance


types of test
measure performance in a
performance repeatable way


types of test

if cannot be measure cannot be
improved


types of test

improved

premature optimization does more
harm than good


types of test

improved

premature optimization does more
harm than good

measure-change-measure


class diagram
Assert
<<iface>>
TestCase
Test

InstrumentationTestCase AndroidTestCase

ActivityInstrumentationTestCase2

ActivityUnitTestCase


InstrumentationTestCase


instrumentation instantiated
before application


before application

allows for monitoring
interaction


before application

interaction

send keys and input events


before application

interaction


manual lifecycle


before application

interaction


manual lifecycle

direct or indirect base
class of other tests


isolated testing of single
Activity


Activity

minimal connection to
the system


Activity

the system

uses mocks for
dependencies


Activity

the system

uses mocks for
dependencies

some Activity methods
should not be called


functional
testing of a single Activity


functional

has access to Instrumentation


functional


creates the AUT using system
infrastructure


functional


creates the AUT using system
infrastructure

custom intent can be provided


AndroidTestCase


access to Context AndroidTestCase



access to Resources



access to Resources

base class for Application, Provider
and Service test cases



access to Resources


Context stored in mContext ﬁeld



access to Resources


Context stored in mContext ﬁeld

can start more than one Activity


test driven development


test driven development advantages:

•the tests are written
one way or another

•developers take more
responsibility for the
quality of their work



one way or another


strategy of writing tests along development



one way or another



test cases written prior to the code



one way or another



test cases written prior to the code

single test added, then the code to satisfy it


activity diagram
design decisions are
taken in single steps
and ﬁnally the code
write test satisfying the tests is
improved by
refactoring it

run
[fails]

code
[passes]

refactor


temperature converter
Title
celsius
100
autoupdate
32
fahrenheit

keyboard


requirements


requirements
converts between temperature
units
one temperature is entered and
the other is updated
error is displayed in the ﬁeld
right aligned, 2 decimal digits
entry ﬁelds start empty


understanding
requirements


understanding
requirements

to write a test you must understand the
requirement


understanding
requirements

requirement

destination is quickly identiﬁed


understanding
requirements

requirement

destination is quickly identiﬁed

if requirement change, changing the
corresponding test helps verify it


github

$ mkdir myworkdir
$ cd myworkdir
$ git clone git@github.com:dtmilano/
TemperatureConverter.git

$ git clone git://github.com/dtmilano/
TemperatureConverterTests.git


creating the
main project
TemperatureConverter uses
conventional settings


creating the test
project
Automatically selected values
for TemperatureConverterTest
project


creating the test
case
Use:
as the base class
TemperatureConverterActivity as
the class under test


warning
due to the
parameterized base
class

creating the test
case
Use:
as the base class
TemperatureConverterActivity as
the class under test


constructor
/**
* Constructor
* @param name
*/
public TemperatureConverterActivityTests(String name) {
super(TemperatureConverterActivity.class);
setName(name);
}


fixture
protected void setUp(String name) throws Exception {
super.setUp();

mActivity = getActivity(); reference the
assertNotNull(mActivity); main package

mCelsius = (EditText)mActivity.findViewById(com...);
assertNotNull(mCelsius);
mFahrenheit = (EditText)mActivity.findViewById(com...);
assertNotNull(mFahrenheit);
}


layout
satisfy the test needs


ui tests: visibility

@SmallTest
public void testFieldsOnScreen() {
ﬁnal View origin =
mActivity.getWindow().getDecorView();
ViewAsserts.assertOnScreen(origin, mCelsius);
ViewAsserts.assertOnScreen(origin, mFahrenheit);
}


ui tests: alignment

@SmallTest
public void testAlignment() {
! ! ViewAsserts.assertRightAligned(mCelsius,
mFahrenheit);
! ! ViewAsserts.assertLeftAligned(mCelsius,
mFahrenheit);
}


ui tests: initialization

@SmallTest
public void testFieldsShouldStartEmpty() {
! ! assertTrue("".equals(mCelsius.getText()
.toString()));
! ! assertTrue("".equals(mFahrenheit.getText()
.toString()));
}


ui tests: justification
@SmallTest
public void testJustification() {
! ! final int expected =
Gravity.RIGHT|Gravity.CENTER_VERTICAL;
! ! assertEquals(expected,
mCelsius.getGravity());
! ! assertEquals(expected,
mFahrenheit.getGravity());
}

running the tests
video plays on
click >>>


gravity
add right and
center_vertical gravity
for celsius and
fahrenheit


temperature conversion
! @UiThreadTest
! public void testFahrenheitToCelsiusConversion() {
! ! mCelsius.clear();
! ! mFahrenheit.clear(); errors are
underlined in red
! ! final double f = 32.5;
! ! mFahrenheit.requestFocus();
! ! mFahrenheit.setNumber(f);
! ! mCelsius.requestFocus();
! ! final double expected =
TemperatureConverter.fahrenheitToCelsius(f);
! ! final double actual = mCelsius.getNumber();
! ! final double delta = Math.abs(expected - actual);
! ! assertTrue(delta < 0.005);
! }

temperature conversionrun in the ui
! @UiThreadTest thread

underlined in red
! }

temperature conversionrun in the ui

specialized
class
underlined in red
! }

temperature conversion run in the ui

specialized
class
underlined in red
! ! mFahrenheit.setNumber(f); converter
! ! mCelsius.requestFocus(); helper
! }

EditNumber class
EditNumber class
extends EditText


TemperatureCon
verter
TemperatureConverter
is a helper class


exception
java.lang.ClassCastException:
android.widget.EditText at
com.example.i2at.tc.test.
TemperatureConverterActivityTests.setUp
(TemperatureConverterActivityTests.java: 44)


exception
java.lang.ClassCastException:
android.widget.EditText at
com.example.i2at.tc.test.
TemperatureConverterActivityTests.setUp
(TemperatureConverterActivityTests.java: 44)

44:!! mCelsius = (EditNumber)
mActivity.ﬁndViewById(
com.example.i2at.tc.R.id.celsius);

layout
<com.example.i2at.tc.EditNumber
android:layout_height="wrap_content"
! ! android:layout_width="match_parent"
android:inputType="numberDecimal"
! ! android:id="@+id/celsius"
android:gravity="right|center_vertical">
! ! <requestFocus />
</com.example.i2at.tc.EditNumber>


running the tests


running the tests

what?


celsius to fahrenheit
Fahrenheit

150
112.5
75
37.5
0
-37.5
-75
-40 -30 -20 -10 0 10 20 30 40
Celsius


celsius to fahrenheit
Fahrenheit

150
112.5
75
f = 9/5 * c + 32
37.5
0
c = (f-32) * 5/9
-37.5
-75
-40 -30 -20 -10 0 10 20 30 40
Celsius


converter

public class TemperatureConverter {

! public static double fahrenheitToCelsius(double f) {
/ TODO Auto-generated method stub
/
! ! return 0;
! }

}


TemperatureConv
erterTests
Test case as base class
create method stubs
TemperatureConverter as
CUT


method stubs
select the methods you want
stubs created for


conversion test

public void testFahrenheitToCelsius() {
! ! for (double c: sConversionTableDouble.keySet()) {
! ! ! final double f = sConversionTableDouble.get(c);
! ! ! final double ca =
! ! ! final double delta = Math.abs(ca - c);
! ! ! assertTrue(delta < 0.005);
! ! }
! }


conversion table
private static ﬁnal HashMap<Double, Double>
sConversionTableDouble =
! ! ! new HashMap<Double, Double>();
!
static {
! ! sConversionTableDouble.put(0.0, 32.0);
! ! sConversionTableDouble.put(-1.0, 30.20);
! ! sConversionTableDouble.put(-100.0, -148.0);
}

run the tests


run the tests

this
assertion fails


creating test
case
use AndroidTestCase as base
class
use EditNumber as CUT


method stubs
select the Context constructor
select other methods


test

public final void testClear() {
! ! final String value = "123.45";
! ! mEditNumber.setText(value);
! ! mEditNumber.clear();
! ! final String expected = "";
! ! final String actual =
mEditNumber.getText().toString();
! ! assertEquals(expected, actual);
}


implementation
public class EditNumber extends EditText {

/ ...
/

! public void clear() {
! ! setText("");
! }

}


test
public final void testSetNumber() {
! ! final double d = 123.45;
! ! mEditNumber.setNumber(d);
! ! final String expected = Double.toString(d);
! ! final String actual =
mEditNumber.getText().toString();
}


test
public final void testGetNumber() {
! ! final double expected = 123.45;
! ! mEditNumber.setNumber(expected);
! ! final double actual =
mEditNumber.getNumber();
}


implementation
public class EditNumber extends EditText {

/ ...
/

! public void getNumber() {
ﬁnal String s = getText().toString();
if ( "".equals(s) ) {
return Double.NaN;
}
! ! return Double.valueOf(s);
! }
}

run the tests NO video


what’s the problem ?


what’s the problem ?
clear() works

requestFocus() works

setNumber() works

fahrenheitToCelsius() works

getNumber() works

so ?


temperature converter
Title
celsius
100

32
fahrenheit

keyboard


TemperatureChan
geWatcher
create it as an inner class
implements TextWatcher
inherited abstract methods
create 2 ﬁelds mSource &
mDest


generate
constructor
use the ﬁelds
omit call to super()


the watcher
public abstract class TemperatureChangeWatcher
implements TextWatcher {
! ! private EditNumber mSource;
! ! private EditNumber mDest;
! !
! ! public TemperatureChangeWatcher(
EditNumber source, EditNumber dest) {
! ! ! this.mSource = source;
! ! ! this.mDest = dest;
! ! }
/ ...
/
}

on text changed
@Override
public void onTextChanged(CharSequence s, int start, int before, int count) {
! if ( !mDest.hasWindowFocus() || mDest.hasFocus() || s == null ) return;
! ﬁnal String str = s.toString();
! if ( "".equals(str) ) {
! ! mDest.setText(""); return;
! }
! try {
! ! ﬁnal double result = convert(Double.parseDouble(str));
! ! mDest.setNumber(result);
! }
! catch (NumberFormatException e) {
! ! / WARNING: this is thrown while a number is entered, for example just a '-'
/
! }
! catch (Exception e) {
! ! mSource.setError("ERROR: " + e.getLocalizedMessage());
! }
}

on text changed
@Override
public void onTextChanged(CharSequence s, int start, int before, int count) {
! if ( !mDest.hasWindowFocus() || mDest.hasFocus() || s == null ) return;
! final String str = s.toString();
! if ( "".equals(str) ) {
! ! mDest.setText(""); return;
we should
! }
define it
! try {
! ! final double result = convert(Double.parseDouble(str));
! ! mDest.setNumber(result);
! }
! catch (NumberFormatException e) {
! ! / WARNING: this is thrown while a number is entered, for example just a '-'
/
! }
! catch (Exception e) {
! ! mSource.setError("ERROR: " + e.getLocalizedMessage());
! }
}

abstract convert method
public abstract class TemperatureChangeWatcher
implements TextWatcher {
//...

protected abstract double convert(double temp);

//...
}


find views
@Override
public void onCreate(Bundle savedInstanceState) {
super.onCreate(savedInstanceState);
setContentView(R.layout.main);

mCelsius =
(EditNumber) findViewById(R.id.celsius);
mFahrenheit =
(EditNumber) findViewById(R.id.fahrenheit);
}


add change listeners
@Override
public void onCreate(Bundle savedInstanceState) {
/ ...
/
mCelsius.addTextChangedListener(
we should
new TemperatureChangeWatcher(mCelsius, mFahrenheit) {
create it
! ! ! @Override protected double convert(double temp) {
! ! ! ! return TemperatureConverter.celsiusToFahrenheit(temp);
! ! ! }!
});
mFahrenheit.addTextChangedListener(
new TemperatureChangeWatcher(mFahrenheit, mCelsius) {
! ! ! @Override protected double convert(double temp) {
! ! ! ! return TemperatureConverter.fahrenheitToCelsius(temp);
! ! ! }
});
}


add conversion

! ! return (f-32) * 5/9.0;
! }

! public static double celsiusToFahrenheit(double c) {
! ! / TODO Auto-generated method stub
/
! ! return 0;
! }
}


adding test
public class TemperatureConverterTests extends TestCase {
/ ...
/
! /**
! * Test method for {@link TemperatureConverter#fahrenheitToCelsius(double)}.
! */
! public void testCelsiusToFahrenheit() {
! ! for (double c: sConversionTableDouble.keySet()) {
! ! ! final double f = sConversionTableDouble.get(c);
! ! ! final double fa = TemperatureConverter.celsiusToFahrenheit(c);
! ! ! final double delta = Math.abs(fa - f);
! ! ! assertTrue("delta=" + delta + " for f=" + f + " fa=" + fa, delta < 0.005);
! ! }
! }
}


implementing conversion

! ! return (f-32) * 5/9.0;
! }

! ! return 9/5.0 * c + 32;
! }
}


code coverage


code coverage
measures the amount of source code tested


code coverage

android relies on emma (http://emma.sf.net)


code coverage

android relies on emma (http://emma.sf.net)

supported coverage types:
class

method

line

block


coverage report


coverage report

overall coverage summary


coverage report


overall stats summary


coverage report


overall stats summary

coverage breakdown by package


building with ant

disable project’s Build Automatically in Eclipse

convert project to ant

$ android update project --path $PWD --name
TemperatureConverter --target android-10

$ android update test-project --main ../
TemperatureConverter --path $PWD


run
conﬁguration coverage
run build.xml as Ant build...
use coverage target


ant 1.8
specify ant 1.8 home

Ant home...


coverage

run build.xml coverage

coverage analysis report is generated

get coverage ﬁle

$ adb pull /data/data/com.example.i2at.tc/ﬁles/
coverage.ec coverage.ec


importing
coverage ﬁle
import the coverage session
into Eclipse


coverage
session
select the project folders


convert not covered


adding missing test
@UiThreadTest
public void testCelsiusToFahrenheitConversion() {
! mCelsius.clear();
! ! mFahrenheit.clear();
! ! final double c = 32.5;
! ! mCelsius.setNumber(c);
! ! final double expected = TemperatureConverter.celsiusToFahrenheit(c);
! ! final double actual = mFahrenheit.getNumber();
! ! assertTrue("delta=" + delta, delta < 0.005);
}


coverage


constructor not covered


private constructor
! private TemperatureConverter() {
! ! / do nothing
/
! }
! ! return (f-32) * 5/9.0;
! }
! ! return 9/5.0 * c + 32;
! }
}

access private
constructor
public ﬁnal void testPrivateConstructor() throws SecurityException,
NoSuchMethodException,
! ! ! IllegalArgumentException, InstantiationException,
IllegalAccessException, InvocationTargetException {
! Constructor<TemperatureConverter> ctor =
! ! ! TemperatureConverter.class.getDeclaredConstructor();
! ctor.setAccessible(true);
! TemperatureConverter tc = ctor.newInstance((Object[])null);
! assertNotNull(tc);
}


access private
constructor
public ﬁnal void testPrivateConstructor() throws SecurityException,
NoSuchMethodException,
! ! ! IllegalArgumentException, InstantiationException,
IllegalAccessException, InvocationTargetException {
! Constructor<TemperatureConverter> ctor =
circumvent
! ! ! TemperatureConverter.class.getDeclaredConstructor();
restriction
! ctor.setAccessible(true);
! TemperatureConverter tc = ctor.newInstance((Object[])null);
! assertNotNull(tc);
}


ﬁnished
application
this is the ﬁnal result



agile technique for software engineering

received broad adoption in recent years

prevents “integration hell”

integrate changes frequently


requirements

version control system

automated build

self tested

artifacts and tests results easy to ﬁnd


installation

download war from http://hudson-ci.org

$ java -jar hudson.war


hudson home


android plugin


android sdk root


new job


ant properties


build artifacts


build dependency
these are the
TemperatureConverterTest
project options. This depends on
TemperatureConverter.


android emulator


build with ant


xml test results

download xmlinstrumentationtestrunner.jar

replace instrumentation by
android:name="com.neenbedankt.android.test.
XMLInstrumentationTestRunner"

customize build.xml


junit test result


test report


behavior driven
development


behavior driven
development

evolution of Test Driven Development

inclusion of business participant

common vocabulary

based on Neuro Linguistics Programming


ﬁtnesse


test suite


slim test fixture
package com.example.i2at.tc.test.fitnesse.fixture;
import com.example.i2at.tc.TemperatureConverter;

public class TemperatureConverterCelsiusToFahrenheitFixture {
! private double celsius;

! public void setCelsius(double celsius) {
! ! this.celsius = celsius;
! }

! public String fahrenheit() throws Exception {
! ! try {
! ! ! return String.valueOf(TemperatureConverter.celsiusToFahrenheit(celsius));
! ! } catch (RuntimeException e) {
! ! ! return e.getLocalizedMessage();
! ! }
! }
}

test run


questions ?


android application
testing guide


android application
testing guide
Apply testing techniques and tools
• Learn the nuances of Unit and
Functional testing
• Understand different development
methodologies such as TDD and BDD
• Apply Continuous Integration
• Improve applications using
performance tests
• Expose your application to a wide
range of conditions


thank you


Introduction to android testing

Recomendados

Recomendados

Más contenido relacionado

La actualidad más candente

La actualidad más candente (20)

Destacado

Destacado (20)

Similar a Introduction to android testing

Similar a Introduction to android testing (11)

Último

Último (20)

Introduction to android testing

Notas del editor