Presentation delivered by Craig Smith at Agile Australia 2011. Ensuring that the approach to testing and quality is understood and appropriately valued in an Agile world can be a struggle for many organisations, especially when resources are limited and our customers are expecting business value in a timely manner. In this session Craig Smith will define what quality means, share a number of tools for measuring it as well as discussing approaches to improving the skills, empowerment and role of testing in the organisation and share why testing is the coolest role on the team and why it is everyone's responsibility.

1. The
Speed to Cool:
Valuing Testing
& Quality
in Agile Teams
Craig Smith

2. Welcome…
Image: © Peanuts Worldwide LLC http://www.todoavatar.com/wp-content/uploads/2009/08/snoopy.jpg

3. The
speed
to
cool…
Image: Pineapples101 (Flickr) http://www.flickr.com/photos/pineapples101/4292778673/in/set-72157623131356129/

4. Thumbs
up…
Cool!
Image: http://brainsyndicate.files.wordpress.com/2011/05/tumblr_lkp6t8505s1qe4wjro1_400.jpg?w=300&h=355

5. Choke...
Image:http://blog.vidyagamez.com/wp-content/uploads/2010/06/tumbleweed.jpg

6. So, What is a
Tester?
Image: http://rnstechnologies.com/content_images/small_image_2.jpg/

7. Look
left…
Look
right…

8. Look
up…
Image: http://3.bp.blogspot.com/_RdF7S0TNAHY/TOqn8MLYajI/AAAAAAAAAJI/QDBFdixiq0E/s1600/2006-06-17%252520Falling-piano.gif

9. CSI:
Software
Image: © Jerry Bruckheimer Television http://images2.fanpop.com/images/photos/4700000/CSI-Las-Vegas-9x18-Mascara-csi-4772098-2000-1333.jpg

10. Testers
in an Analyst /
agile
team Customer
Project
Elaboration /
Specification
Acceptance
Criteria
Manager
High
Performing
AGILE
Developer Automation
Tester

11. Testers in
an agile
team Analysts need more
testing involvement
Analyst
Testers need more
technical involvement Tester
Developer Developers need
more testing involvement
More Less
Requirements
Functional /
Exploratory
Technical Technical
Automated
Customer
Specialist
Unit Test
Manual
Design
Collab.
Code
Tests
Test
Test

12. Definition of
Quality…
(noun) the standard of something as measured
against other things of a similar kind; the degree
of excellence of something oxforddictionaries.com
Image: http://www.naccho.org/topics/infrastructure/accreditation/images/Quality-Definition.jpg /

13. Implicit /
Explicit
Quality
Image: http://s3.amazonaws.com/integral-life-home/iceberg.jpg

14. Quality
means
different
things
Image: http://upload.wikimedia.org/wikipedia/commons/b/b9/Steve_Jobs_Headshot_2010-CROP.jpg

15. Testing
≠
Quality

16. Building
Quality
In
Image: http://www.cupojoy.com/images/image/Quality%20Inn%20Exterior.jpg

17. Quality is
everyone’s
responsibility
Image: © AP http://i.telegraph.co.uk/multimedia/archive/01893/schumaker-dummies_1893704i.jpg

18. Everyone
likes to be
seen to
value
quality
Image: © Reveille Productions http://blogs.ubc.ca/kdergous/files/2010/10/body-language-the-office.jpg

19. Agile &
Testing
Image: http://3.bp.blogspot.com/_ZdyzysU1QPo/TA0kjLMP43I/AAAAAAAABPk/5ckzpw6OVmk/s1600/Peas+and+Carrots.JPG

20. To Do Analysis Develop Test Done
We
reflect
work
like
this...

21. To Do
Analysis
Develop
Test
Done
Which is
really
working
like this...

22. Remind you
of
something?
Image: Craig Smith

23. Let’s
ponder
the
Agile
Manifesto
Responding to
change
over
following a
plan

24. Time to play the
“Agile Manifesto
Tester’s Challenge”
Image: © Sony Computer Entertainment Europe http://www.ultimateps3.fr/images/jeux/buzz-quiz-tv/buzz-quiz-tv_1216759203.jpg

25. Challenge
#1
Individuals and interactions over
processes and tools
Image: © The Curiosity Company http://images2.fanpop.com/images/photos/3200000/fry-bender-futurama-3295254-1024-768.jpg

26. Challenge
#2
Working software over
comprehensive documentation
Image: http://blog.agafonov.net.ua/image.axd?picture=2011%2F5%2FvNext+Visual+Studio+2011.jpg

27. Challenge
#3
Customer collaboration over
contract negotiation
Image: © Touchstone Pictures http://cdn.mymovies.ge/backdrops/ce6/4bc922b5017a3c57fe00dce6/metro-original.jpg

28. Challenge Responding to change over
#4 following a plan
Image: http://www.kruellcom.com/images/puzzle.jpg

29. Measuring
Quality
Image: http://wheelofcreativity.com/blog/wp-content/uploads/2010/11/P1070942b2.jpg

30. Success
sliders
Cost Scope Quality Time
Fixed
1 X
2 X
3 X
Flexible 4 X

31. Correctness

32. Quality
Interoperability
Maintainability
Robustness
Trade-
Reusability
Availability
Testability
Portability
Efficiency
Reliability
Flexibility
Usability
Integrity
offs
Reliability
+ + + + - + +
Robustness
+ + + -
Availability
+ +
Integrity
- - - - -
Flexibility
+ - - + + +
Usability
+ - -
Interoperability
- + - +
Efficiency
- - - - - - - -
Testability
+ + + + - +
Maintainability
+ + + - +
Reusability
- - + + - + + +
Portability
+ - + - + - +

33. Shared
understanding
of quality
Image: © 2008 Melissa McKenney http://www.kernel.org/pub/linux/kernel/people/paulmck/Confessions/Elephant_Team_03.jpg

34. Quality
Assessment

35. Quality
Assessment

36. Reporting
& metrics
Image: © Sesame Workshop http://images.wikia.com/muppet/images/9/95/Sesame-english-do-you-like-it-apple_count.jpg

37. Understand
continuous
integration
Image: http://confluence.atlassian.com/download/attachments/229837908/bamboo-dashboard.png?version=2&modificationDate=1297756308930

38. Understand
code
metrics
Image: http://docs.codehaus.org/download/attachments/111706381/dashboard.png?version=2&modificationDate=1267794480088

39. Report
how
testing
is going
Image: http://1.bp.blogspot.com/-46_MdfmjelA/TVa-kb3lTJI/AAAAAAAAABU/JU38qkUXf2c/s1600/half-full-glass.jpg

40. BVC
PROJECT TESTING
9 25
7 5
8
New Risks & Issues Raised
Number of Risks & Issues
6 7 20
Number of Defects
Number of Tests
4
5 6
15
3 5
4
4
3 10
2 3
2 2 5
1
1 1
0 0 0 0
1 2 3 4 5 6 7 8
1 2 3 4 5 6 7 8
HEALTH TEST
Iteration Iteration
COVERAGE
OVERALL
DEVELOPMENT USER
5700 1800 9 $30
5600 1600 8
5500 $25
1400
Number of Features
7
Lines of Test Code
Business Value
5400
Lines of Code
1200 6 $20
5300
1000 5
5200 $15
800 4
5100
600 3 $10
5000
4900 400 2
$5
4800 200 1
4700 0 0 $-
1 2 3 4 5 6 7 8 1 2 3 4 5 6 7 8
MAINTAINABILITY PERFORMANCE
Iteration Iteration

41. ATDD /
Specification
by
example
Image: http://www.treehugger.com/maker-shed-book.jpg

42. Specification
by
example
Image: http://concordion.org/image/example/online-shop/AcceptanceTest.png

43. ROBOCOP: THE FUTURE OF LAW ENFORCEMENT ROBOCOP: THE FUTURE OF LAW ENF
Empowering
RCEMENT ROBOCOP: THE FUTURE OF LAW ENFORCEMENT ROBOCOP: THE FUTURE O
F LAW ENFORCEMENT ROBOCOP: THE FUTURE OF LAW ENFORCEMENT ROBOCOP: TH
Testing
Image: © Orion Pictures http://sadair.com/wp-content/uploads/2010/07/Robocop_Final012-1024x768.jpg

44. Testing
Skills
Image: http://houndbound.com/dogblog/wp-content/uploads/2009/09/pug_graduate1.jpg

45. Architecture
Skills
Image: http://www.invermodels.co.uk/portfolios/sheriff.jpg

46. Technical
Skills
Image: http://www.logicalnetworking.net/wp-content/uploads/2010/02/TuxInSchoolComputerLab.jpg

47. Share
with
community
Image: http://www.linkline.org.uk/poster/images/Banner.png

48. Tools &
Automation
Image: Martha (Picasa) http://lh3.ggpht.com/_9kYHVyqm3zs/S70g1BiNILI/AAAAAAAADho/A4vuRNMTs50/IMG_7956.JPG

49. Get
Involved
Early
Image: http://eventstrategysolutions.com/wp-content/uploads/2010/10/early-bird.jpg

50. Queue
To
Join
Image: http://blogs.jcvi.org/wp-content/uploads/2009/11/emperor-queue.jpg

51. Wrap
Up
Image: © Chuck Lorre Productions http://24.media.tumblr.com/tumblr_ksvfroko3J1qa88nco1_500.jpg

52. Do you have a
testing skillset
(or are you
just doing
testing)?
Image: © Jerry Bruckheimer Television http://photos.telestrekoza.com/var/resizes/Current_shows/CSI/Stills/CSI-Trilogy-Crossover/Miami_8x07/CSI-Miami-Episode-8-07-Bone-Voyage-Promotional-Phot

53. Does
everybody
understand
their role in
quality?
Image: http://www.swotti.com/tmp/swotti/cacheDMLSBGFNZSBWZW9WBGU=/imgVILLAGE%20PEOPLE1.jpg

54. Is testing
bringing
your agile
process
down?
Image: © 20th Century Fox http://bigbluetechnews.files.wordpress.com/2009/11/titanic-sinking.jpg

55. Are you
thinking
differently
about
measurement
Image: © Talent Associates http://confoundedinterest.files.wordpress.com/2011/06/maxwellsmart_missed_it_by_that_much.jpg?w=600&h=423

56. Are you
testers
empowered?
Image: © DC Comics http://collider.com/wp-content/uploads/superman_alex_ross2.jpg

57. Testing
is cool…
Image: © Miller-Milkis Productions http://imagetime.co.gp/key/henry%20winkler%20ron%20howard#

58. ...but I love it
when quality
comes
together
Image: © Universal Television http://30.media.tumblr.com/tumblr_l6g4d631K31qzp4mwo1_r1_500.jpg

59. Craig Smith
http://www.suncorp.com.au Questions
http://www.agileacademy.com.au
http://www.craigsmith.id.au ???
craig.smith@suncorp.com.au
@smithcdau
http://www.slideshare.net/smithcdau/
http://www.agileacademy.com.au
Suncorp is one of Australia and New Zealand's largest diversified financial services
providers, supplying banking, insurance and wealth management products to around 9
million customers through well-established and recognised brands such as AAMI,
Australian Pensioners Insurance Agency, Shannons, Vero, Asteron and Tyndall, as well as
Suncorp and GIO. Today, Suncorp is Australia's fifth largest bank and second largest
domestic general insurance group, with over 16,000 staff. Suncorp has representation in
450 offices, branches and agencies throughout Australia and New Zealand.
(http://www.suncorp.com.au)
The Agile Academy is the next wave in Agile learning and collaboration. Designed for IT
professionals, the Agile Academy is a knowledge hub that promotes Agile related learning,
knowledge sharing and capability development across the IT industry. We offer an
integrated curriculum of leading edge courses across the entire solution development life
cycle, covering all roles at varying levels. (http://www.agileacademy.com.au)