מצגת מתוך כנס אוטומציה - חברת טאקט בדיקות תוכנה

1. Open Source Automation tools
overview
Lior Kinsbruner
February 2011
RSA

2. • RSA company overview
• Automation Challenges
• RSA In-Use tools
• Introduction to JSYSTEM
• Introduction to Selenium
Table of Contents • Introduction to BadBoy
•Introduction to AutoIT
• Introduction to FIT
• Introduction to JEMMY
• How they all work together?
•Automation process in RSA
• DEMO
• Q&A
2

3. RSA in a nutshell J
RSA, The Security Division of EMC, provides Secure Data, Compliance,
SIM, SEM, SIEM, PCI, Consumer Identity, Two-Factor Authentication,
Custom Applications, Consulting, Assessment, and other security solutions
and services to over 90% of the Fortune 500
qLine of products in IL:
q3DS
qAAOP
qAAH
qIDV
qFraud Action
qCRE
3

4. Why use automation tools?
• Time consuming ü Speed
• Low reliability ü Repeatability
• Human resources ü Programming
• Inconsistent capabilities
ü Coverage
ü Reliability
ü Reusability
4

5. Challenges
Multiple environments and platforms
• OS
• DBs
• Application Servers
Frequent changes in SUT – quick response required!
Working with various technologies
• Web Services – SOAP
• Java API
• Web applications
• CLI
5

6. Guidelines for choosing our automation framework
•Data driven capabilities a
•Support for Client-Server and Web based applications a
•Platform/OS independent a
•Reporting capabilities a
•Email notification support a
•Ease of use a
•Documentation a
•Forums exposure a
•Ease of debugging and logging a
•Version control integration a
•Cost a
•Disadvantages:
•Requires development skills for framework implementation and structural changes X
•Bug tracking integration support X requires in-house coding
•Product support – Open source tool…you implement your feature requests OR pay for
outsourcing to do that for you… X
6

7. Introduction to JSYSTEM
þ JSystem is a framework for writing and running automated
tests. The Jsystem Automation Framework is written in Java
and based on open source java projects and custom code.
þ http://www.jsystemtest.org/
7

8. Automation life cycle
8
8

9. Introduction to SELENIUM
ØWeb testing framework
ØRuns in a browser
ØHTML & Javascript
ØOpen source
Ø:‫כתובת האתר הרשמי‬
http://seleniumhq.org
ØEasy record and playback
ØIntelligent field selection will use IDs,
names, or XPATH as needed
ØAuto-complete for all common Selenium
commands
ØDebug and set breakpoints
ØSave tests as HTML, Java, Ruby scripts, or
any other format
Web 1.0 Web 2.0
Static content Dynamic content
HTML AJAX, FLEX, FLASH
Company oriented Community oriented
Web forms Web applications
Explorer Firefox, Opera, Chrome
9

10. Selenium Features
ü Supports a variety of browsers
ü Runs on multiple platforms
ü Supports Flex and Flash
ü Record & Export variety of languages
10

11. Selenium Add-ons and Tips
Working with XPATH tips:
•Don’t use things that might change:
•Div
•Table cells
•Language specific elements
•Use IDs
•Notice search speed when using long XPATH expressions
Firefox Add-on/s:
• Selenium IDE - http://seleniumhq.org
• XPATH checker - http://slesinsky.org/brian/code/xpath_checker.html
• Firebug & IE Developer toolbar - http://getfirebug.com
• Javascript debugger -https://addons.mozilla.org/en-US/firefox/addon/216
11

12. Introduction to BadBoy
Freeware tool which helps Web Application automation testing with Record & Replay
capabilities.
Some of the tools capabilities:
• Reports – Clear display of where failures are as well as values of variables when they occurred
• Log Views – A viewer for log files.
• AJAX Form Population - Form Populators which send DOM events for better AJAX playback
• Error Handlers and Retries - You can configure how Badboy responds to items that fail,
including retrying them.
• External JavaScript Files - You can include JScript items that load scripts from external files
• Waitable Assertions - You can configure Assertions to wait a period of time for conditions to
become true.
• Manual Review Support – You can add manual review checkpoints to your scripts for pages
that should be inspected manually after a script has run
• Documentation Export – You can save a complete outline of your script including
documentation in HTML format
•Official Web Site: http://www.badboy.com.au/
12

13. Introduction to AutoIT
AutoIt v3 is a freeware BASIC-like scripting language designed for
automating the Windows GUI and general scripting. It uses a combination
of simulated keystrokes, mouse movement and window/control
manipulation in order to automate tasks
•Easy to learn BASIC-like syntax
•Simulate keystrokes and mouse movements
•Manipulate windows and processes
•Interact with all standard windows controls
•Scripts can be compiled into standalone executables
•Create Graphical User Interfaces (GUIs)
•Regular expressions
•Directly call external DLL and Windows API functions
•Detailed help file and large community-based support forums
•Compatible with Windows 2000 / XP / 2003 / Vista / 2008 / Windows 7 / 2008 R2
•Unicode and x64 support
http://www.autoitscript.com/site/autoit/
13

14. Introduction to FIT and Fitnesse
The fully integrated standalone wiki, and acceptance testing framework
üFitNesse is a wiki, which is a style of web server that allows any visitor to
make any edits, including changing existing pages and creating new pages.
ü serves us in :
It
üDefining Acceptance Tests
üRun those tests and see the results
ü – is the engine that actually processes each FitNesse test table.
FIT
ü provides easy way to write ‘executable’ acceptance tests using simple
Fit
HTML tables.
•FIT - See it in action soon….
•FitNesse (run it using java -jar fitnesse.jar –p 8080)
http://localhost:8080/FitTest?test
14

15. Introduction to JEMMY
üFree, open source testing toolkit for Swing/JFC applications, supported by
the developers of the NetBeans IDE
JEMMY Main objectives:
§Java library used to create UI automated tests
§Provides support covering all Swing components
§Can be easily extended for custom component support
§Two modes of action reproducing (Robot and event dispatching)
§Pre/post verification methods
§When test fails? – Jemmy exceptions and timeouts
JEMMY Operators:
§Find a window – JFrameOperator, JDialogOperator
§Find a component inside container
§by text
§By index
§by component name
§using Component-Chooser
§Interact with component
§simulate user actions
§call component API
JEMMY ààà See it in action J
15

16. How they all work together?
• Test plan and test labs - QC
• Execution and Reporting - Jsystem
• Defect tracking - JIRA
• Continuous Integration
•Hudson - http://hudson-ci.org/
•Provides an easy-to-use so-called continuous integration system,
making it easier for developers to integrate changes to the project
•Monitoring executions of externally-run jobs
•Reports build results and sends alerts on failures of build using
Email/RSS
•MAVEN - http://maven.apache.org/
•Manages a project's build, reporting and documentation
•Handle resources repositories and projects dependencies.
•Assists with testing
•Runs web applications
•Produce reports on projects
•Any number of other tasks provided by plug-ins.
16

17. Automation process in RSA from A-Z
17

18. 18