Kristian Karl's (@kristiankarl) presentation from MeetUI 2013, SoapUI's first user conference, in Stockholm, Sweden. Kristian is a test manager at Spotify.

1. May 24, 2013
How Spotify Does Test Automation
Kristian Karl

2. The 20 minutes agenda
• Separation of Test Design and Implementation
• Automation of Mobiles, Desktop and Web
Clients
• Handling of Test Data and Test Results.
• Demos

3. API Tests
Integration Tests
Component Tests
System Tests
Unit Tests
Performance Tests
GUI Tests

4. Separation of Test Design
and Implementation

5. Test
Automation
Test
Implementation
Test Design
AbstractionLayer

6. Model-based testing
• Models are the abstraction layer in
the test automation.
• QA uses models to design the tests.
• Devs implements the code
executing the tests.

7. Login dialog
’What’s New’
Login using valid
credentials
Client not
running
Start client
Log out
Close
Exit
Login using invalid
credentialsToggle
’Remember me’
Start client

8. public interface SimpleLogin {
public void e_Close();
public void e_Exit();
public void e_Init();
public void e_InvalidCredentials();
public void e_Logout();
public void e_StartClient();
public void e_ToggleRememberMe();
public void e_ValidPremiumCredentials();
public void v_ClientNotRunning();
public void v_LoginPrompted();
public void v_WhatsNew();
}

10. Automation of Mobiles,
Desktop and Web Clients

11. • yEd – Editing graphml models [www.yworks.com]
• GraphWalker – Generating test sequences online/offline
[graphwalker.org]
• python-graphwalker – Generating test sequences
[https://github.com/spotify/python-graphwalker]
• Sikuli – Image recognition (desktop) [www.sikuli.org]
• Selenium – Web testing [seleniumhq.org]
• NuRemote – In-process testing (iOS) [github.com/nevyn/NuRemoting]
• TestNG – Unit test framework [testng.org]
• Jenkins – Schedules and launches tests 24/7 [jenkins-ci.org]
• VirtualBox – Virtualization [www.virtualbox.org]

12. Handling of Test Data and
Test Results.

23. Done! Demo! Q&A!
Spotify is hiring: https://www.spotify.com/se/jobs/