SlideShare una empresa de Scribd logo
1 de 26
Descargar para leer sin conexión
With TFS and Visual Studio
Angela Dugan
ALM Practice Manager
Polaris Solutions
Angela Dugan
Continuous integrations
Build | Deploy | Test

Testing toolbox

Manual testing
 User testing
 Ad-hoc exploratory testing
 Planned manual testing

Role tailored tools

User
Interface

Automated testing
 Keyword testing
 UI automation testing
 Performance testing

Services
Business Processes
Business Rules and Logic
Service integrations
Data access
Identity

Data

Automated testing
 Unit testing
 Integration testing
 Performance testing
 Load testing
Lab
manager

Lab management
services

Test runners

Diagnostic data
collectors

Test execution
services

Build engines

Pluggable components

Build
services

Lab
environments
Virtualization reduces cost to
provision environments
Modern apps run in diverse
environments
Difficult to repro issues found
Replicating environments for
test is time-consuming, costly

Dramatically reduced hardware
and maintenance expenses

Templates allow a wide range
of baselines to be spun up
quickly and on demand

Improved quality and reliability
of apps across platforms

Snapshots capture states for
reproducing test conditions
and verifying defects

Operations engaged in earlier
phases of testing
On-premise | Cloud
Create and manage virtual or physical environments for
Dev/Test
Take snapshots or revert to existing snapshots for any
virtual machine
Deploy current or any build to environment
Interact with virtual machines through the environment
viewer
Define test settings for environments
Test Controllers and Agents

Test agent controller
manages test agents

Web Server
Test Agent
Test Agent
Controller

Collect Intellitrace
Information

Client

Test Agent
Run Tests

Test Agent

Test Agent
Run Tests
Collect Test Impact
Data

Team
Foundation
Server

Collect System
Information

Network Emulation

Client

Register with Team
Project Collection

Database Server

Where to
run Tests?

Collect
Data?

Test agents run tests and collect
data or impact the system

Affect
Machine
Installed on the “client” machines
Three types of agents
Test Agent-Enables automated testing
Build Agent-Enables automated
deployment
Lab Agent-Enables network isolation

Install from the Lab Management
or TFS media
Can be installed/maintained using
the VMPrepTool
Create new multi-machine
environment choices
Create a new
environment using virtual
machine templates in
SCVMM

Create new
environments on
existing machines

Create an
environment using
machines running on
SCVMM
Quickly choose multiple
test suites to run after
deployment

Choose your environment,
and build, deploy and test in
that environment from a
single dialog
Spin up virtual test environments
from within Test Manager, or attach a
virtual environment to a manual
testing session

Snapshot environments
during manual testing to
increase reproducibility
Thumbnail view of each
machine in the environment
Developers can quickly debug
issues on the exact same
testing environment

Environment snapshot
taken and attached as a
link with bug
Test run results are attached to
specific builds and environments

Collect all the data required
to recreate bugs from virtual
environments
SCVMM Environment
Build-Deploy-Test
Snapshot / Restore
Share Bug Snapshots

Network Fencing
3rd Party Virtualization
Physical Machines

Standard Environment
Lab Management is included with Visual Studio Premium/Test
Pro
SCVMM license for dev/test is included

MSDN
Headless Hyper-V as the host OS
Guest OS license is part of MSDN subscription
Each person accessing the Virtual Machine Host (or accessing
a virtual machine on that host) must have an MSDN
subscription
ULTIMATE
Premium
Professional

Office
Web Access
SharePoint
Team Explorer
Everywhere

Test
Professional
Creating VMs
Create and store VMs - MSDN doc
Prepare a domain controller VM

Manage virtual environments
Creating virtual envs - MSDN doc
Creating and working with virtual envs
Concepts and guidelines
Creating network isolated environments

Networking
Networking basics
Network isolation
Topology 1 - Multiple AT, Load Balancer and Test network with firewall settings, controlling
the test traffic in and out of Corp network
Network load balancer
Firewall rules

Topology 2 - Multiple ATs and DTs without load balancers and Test network with SAN based
library and host
SAN support

Topology 3 - TMG, Windows NLB and with Test apps having DB tier outside of virtual
environment
Setting up rules in Threat Management Gateway

Deployment and testing on a shared machine outside the envt

Topology 4 - Multiple ATs and DTs, load balancers and environments joined to a different
domain
DNS conditional forwarding
Microsoft Testing Tour - Setting up a Test Environment

Más contenido relacionado

La actualidad más candente

Top Chrome Extensions for Software Testing
Top Chrome Extensions for Software TestingTop Chrome Extensions for Software Testing
Top Chrome Extensions for Software TestingKanoah
 
Regression and performance testing
Regression and performance testingRegression and performance testing
Regression and performance testingHimanshu
 
Test Case Prioritization Techniques
Test Case Prioritization TechniquesTest Case Prioritization Techniques
Test Case Prioritization TechniquesKanoah
 
What is Ad-Hoc Testing
What is Ad-Hoc TestingWhat is Ad-Hoc Testing
What is Ad-Hoc TestingExforsys Inc
 
Importance of a Test Management Tool for Your Project
Importance of a Test Management Tool for Your ProjectImportance of a Test Management Tool for Your Project
Importance of a Test Management Tool for Your ProjectSarah Elson
 
Risk based regression testing approach
Risk based regression testing approachRisk based regression testing approach
Risk based regression testing approachAsim Ali
 
Smoke Testing
Smoke TestingSmoke Testing
Smoke TestingKanoah
 
Load and Performance tests in agile scrum framework SGI 2013
Load and Performance tests in agile scrum framework SGI 2013Load and Performance tests in agile scrum framework SGI 2013
Load and Performance tests in agile scrum framework SGI 2013Subrahmaniam S.R.V
 
Nuevosoft Test Manager Overview
Nuevosoft Test Manager OverviewNuevosoft Test Manager Overview
Nuevosoft Test Manager OverviewSuhas Patil
 
Regression testing
Regression testingRegression testing
Regression testingHarsh verma
 
What is sanity testing
What is sanity testingWhat is sanity testing
What is sanity testingpooja deshmukh
 
Defect Prevention & Predictive Analytics - XBOSoft Webinar
Defect Prevention & Predictive Analytics - XBOSoft WebinarDefect Prevention & Predictive Analytics - XBOSoft Webinar
Defect Prevention & Predictive Analytics - XBOSoft WebinarXBOSoft
 
Benefits Of Implementing Test Management Tools
Benefits Of Implementing Test Management ToolsBenefits Of Implementing Test Management Tools
Benefits Of Implementing Test Management ToolsKovair
 
Performance Testing
Performance TestingPerformance Testing
Performance TestingSelin Gungor
 
risk based testing and regression testing
risk based testing and regression testingrisk based testing and regression testing
risk based testing and regression testingToshi Patel
 
T19 performance testing effort - estimation or guesstimation revised
T19   performance testing effort - estimation or guesstimation revisedT19   performance testing effort - estimation or guesstimation revised
T19 performance testing effort - estimation or guesstimation revisedTEST Huddle
 
ISTQB - CTFL Summary v1.0
ISTQB - CTFL Summary v1.0ISTQB - CTFL Summary v1.0
ISTQB - CTFL Summary v1.0Samer Desouky
 
ISTQB / ISEB Foundation Exam Practice - 2
ISTQB / ISEB Foundation Exam Practice - 2ISTQB / ISEB Foundation Exam Practice - 2
ISTQB / ISEB Foundation Exam Practice - 2Yogindernath Gupta
 

La actualidad más candente (20)

Top Chrome Extensions for Software Testing
Top Chrome Extensions for Software TestingTop Chrome Extensions for Software Testing
Top Chrome Extensions for Software Testing
 
Regression and performance testing
Regression and performance testingRegression and performance testing
Regression and performance testing
 
Test Case Prioritization Techniques
Test Case Prioritization TechniquesTest Case Prioritization Techniques
Test Case Prioritization Techniques
 
What is Ad-Hoc Testing
What is Ad-Hoc TestingWhat is Ad-Hoc Testing
What is Ad-Hoc Testing
 
Importance of a Test Management Tool for Your Project
Importance of a Test Management Tool for Your ProjectImportance of a Test Management Tool for Your Project
Importance of a Test Management Tool for Your Project
 
Risk based regression testing approach
Risk based regression testing approachRisk based regression testing approach
Risk based regression testing approach
 
Smoke Testing
Smoke TestingSmoke Testing
Smoke Testing
 
Load and Performance tests in agile scrum framework SGI 2013
Load and Performance tests in agile scrum framework SGI 2013Load and Performance tests in agile scrum framework SGI 2013
Load and Performance tests in agile scrum framework SGI 2013
 
Nuevosoft Test Manager Overview
Nuevosoft Test Manager OverviewNuevosoft Test Manager Overview
Nuevosoft Test Manager Overview
 
Regression testing
Regression testingRegression testing
Regression testing
 
Performance Testing - Keytorc Approach
Performance Testing - Keytorc ApproachPerformance Testing - Keytorc Approach
Performance Testing - Keytorc Approach
 
What is sanity testing
What is sanity testingWhat is sanity testing
What is sanity testing
 
Defect Prevention & Predictive Analytics - XBOSoft Webinar
Defect Prevention & Predictive Analytics - XBOSoft WebinarDefect Prevention & Predictive Analytics - XBOSoft Webinar
Defect Prevention & Predictive Analytics - XBOSoft Webinar
 
Benefits Of Implementing Test Management Tools
Benefits Of Implementing Test Management ToolsBenefits Of Implementing Test Management Tools
Benefits Of Implementing Test Management Tools
 
Getting Ready for UAT
Getting Ready for UATGetting Ready for UAT
Getting Ready for UAT
 
Performance Testing
Performance TestingPerformance Testing
Performance Testing
 
risk based testing and regression testing
risk based testing and regression testingrisk based testing and regression testing
risk based testing and regression testing
 
T19 performance testing effort - estimation or guesstimation revised
T19   performance testing effort - estimation or guesstimation revisedT19   performance testing effort - estimation or guesstimation revised
T19 performance testing effort - estimation or guesstimation revised
 
ISTQB - CTFL Summary v1.0
ISTQB - CTFL Summary v1.0ISTQB - CTFL Summary v1.0
ISTQB - CTFL Summary v1.0
 
ISTQB / ISEB Foundation Exam Practice - 2
ISTQB / ISEB Foundation Exam Practice - 2ISTQB / ISEB Foundation Exam Practice - 2
ISTQB / ISEB Foundation Exam Practice - 2
 

Destacado

Data Provisioning & Optimization
Data Provisioning & OptimizationData Provisioning & Optimization
Data Provisioning & OptimizationAmbareesh Kulkarni
 
Dev/Test in the Cloud - F
Dev/Test in the Cloud - FDev/Test in the Cloud - F
Dev/Test in the Cloud - FChris Riley ☁
 
WMworld Europe 2014: Hybrid Sandboxing – Create the Ultimate On and Off Premi...
WMworld Europe 2014: Hybrid Sandboxing – Create the Ultimate On and Off Premi...WMworld Europe 2014: Hybrid Sandboxing – Create the Ultimate On and Off Premi...
WMworld Europe 2014: Hybrid Sandboxing – Create the Ultimate On and Off Premi...VMworld
 
Why You Should Move Dev and Test to the Cloud
Why You Should Move Dev and Test to the CloudWhy You Should Move Dev and Test to the Cloud
Why You Should Move Dev and Test to the CloudRightScale
 
Heterogeneous Self-Service Automation for SDN Dev/Test
Heterogeneous Self-Service Automation for SDN Dev/TestHeterogeneous Self-Service Automation for SDN Dev/Test
Heterogeneous Self-Service Automation for SDN Dev/TestQualiQuali
 
Dev & Test on AWS - Journey Through the Cloud
Dev & Test on AWS - Journey Through the CloudDev & Test on AWS - Journey Through the Cloud
Dev & Test on AWS - Journey Through the CloudAmazon Web Services
 
Oracle application testing suite (OATS)
Oracle application testing suite (OATS)Oracle application testing suite (OATS)
Oracle application testing suite (OATS)Koushik Arvapally
 
Big data architectures and the data lake
Big data architectures and the data lakeBig data architectures and the data lake
Big data architectures and the data lakeJames Serra
 

Destacado (10)

Data Provisioning & Optimization
Data Provisioning & OptimizationData Provisioning & Optimization
Data Provisioning & Optimization
 
Dev/Test in the Cloud - F
Dev/Test in the Cloud - FDev/Test in the Cloud - F
Dev/Test in the Cloud - F
 
WMworld Europe 2014: Hybrid Sandboxing – Create the Ultimate On and Off Premi...
WMworld Europe 2014: Hybrid Sandboxing – Create the Ultimate On and Off Premi...WMworld Europe 2014: Hybrid Sandboxing – Create the Ultimate On and Off Premi...
WMworld Europe 2014: Hybrid Sandboxing – Create the Ultimate On and Off Premi...
 
Why You Should Move Dev and Test to the Cloud
Why You Should Move Dev and Test to the CloudWhy You Should Move Dev and Test to the Cloud
Why You Should Move Dev and Test to the Cloud
 
Heterogeneous Self-Service Automation for SDN Dev/Test
Heterogeneous Self-Service Automation for SDN Dev/TestHeterogeneous Self-Service Automation for SDN Dev/Test
Heterogeneous Self-Service Automation for SDN Dev/Test
 
Enterprise Dev and Test on AWS
Enterprise Dev and Test on AWSEnterprise Dev and Test on AWS
Enterprise Dev and Test on AWS
 
Dev & Test on AWS - Journey Through the Cloud
Dev & Test on AWS - Journey Through the CloudDev & Test on AWS - Journey Through the Cloud
Dev & Test on AWS - Journey Through the Cloud
 
Oracle application testing suite (OATS)
Oracle application testing suite (OATS)Oracle application testing suite (OATS)
Oracle application testing suite (OATS)
 
Test & Dev on the AWS Cloud
Test & Dev on the AWS CloudTest & Dev on the AWS Cloud
Test & Dev on the AWS Cloud
 
Big data architectures and the data lake
Big data architectures and the data lakeBig data architectures and the data lake
Big data architectures and the data lake
 

Similar a Microsoft Testing Tour - Setting up a Test Environment

Overview of Lab Management and TFS
Overview of Lab Management and TFSOverview of Lab Management and TFS
Overview of Lab Management and TFSChris Kadel, MBA
 
qawithmicrosofttestmanagerandlabmanagement
qawithmicrosofttestmanagerandlabmanagementqawithmicrosofttestmanagerandlabmanagement
qawithmicrosofttestmanagerandlabmanagementsunil singh
 
QA with Microsoft Test Manager and Lab Management
QA with Microsoft Test Manager and Lab ManagementQA with Microsoft Test Manager and Lab Management
QA with Microsoft Test Manager and Lab ManagementRofiqi Setiawan
 
Tips to achieve continuous integration/delivery using HP ALM, Jenkins, and S...
 Tips to achieve continuous integration/delivery using HP ALM, Jenkins, and S... Tips to achieve continuous integration/delivery using HP ALM, Jenkins, and S...
Tips to achieve continuous integration/delivery using HP ALM, Jenkins, and S...Skytap Cloud
 
03 test specification and execution
03   test specification and execution03   test specification and execution
03 test specification and executionClemens Reijnen
 
2015-01-12 TechTalk - Continuous Delivery and Release Management
2015-01-12 TechTalk - Continuous Delivery and Release Management2015-01-12 TechTalk - Continuous Delivery and Release Management
2015-01-12 TechTalk - Continuous Delivery and Release ManagementMicrosoft Switzerland (DX)
 
No More No Repro
No More No ReproNo More No Repro
No More No ReproAnna Russo
 
DevOps Roadshow - continuous delivery and release management
DevOps Roadshow - continuous delivery and release managementDevOps Roadshow - continuous delivery and release management
DevOps Roadshow - continuous delivery and release managementMicrosoft Developer Norway
 
Anatomy of a Build Pipeline
Anatomy of a Build PipelineAnatomy of a Build Pipeline
Anatomy of a Build PipelineSamuel Brown
 
[DevDay 2017] Automation Testing - Speaker: Nghia Khuong - Project Manager at...
[DevDay 2017] Automation Testing - Speaker: Nghia Khuong - Project Manager at...[DevDay 2017] Automation Testing - Speaker: Nghia Khuong - Project Manager at...
[DevDay 2017] Automation Testing - Speaker: Nghia Khuong - Project Manager at...DevDay.org
 
The state of testing @ Microsoft
The state of testing @ MicrosoftThe state of testing @ Microsoft
The state of testing @ MicrosoftRobert MacLean
 
Microsoft Testing Tour - Functional and Automated Testing
Microsoft Testing Tour - Functional and Automated TestingMicrosoft Testing Tour - Functional and Automated Testing
Microsoft Testing Tour - Functional and Automated TestingAngela Dugan
 
Too Dependent on Shared Test Environments? Kick Start Local Workstation Testing!
Too Dependent on Shared Test Environments? Kick Start Local Workstation Testing!Too Dependent on Shared Test Environments? Kick Start Local Workstation Testing!
Too Dependent on Shared Test Environments? Kick Start Local Workstation Testing!ThoughtWorks
 
Visual Studio ALM and DevOps Tools Walkthrough
Visual Studio ALM and DevOps Tools WalkthroughVisual Studio ALM and DevOps Tools Walkthrough
Visual Studio ALM and DevOps Tools WalkthroughAngela Dugan
 
Automated Testing Of EPiServer CMS Sites
Automated Testing Of EPiServer CMS SitesAutomated Testing Of EPiServer CMS Sites
Automated Testing Of EPiServer CMS Sitesjoelabrahamsson
 
[GWAB] Testing Scenarios with Windows Azure and Visual Studio Online
[GWAB] Testing Scenarios with Windows Azure and Visual Studio Online[GWAB] Testing Scenarios with Windows Azure and Visual Studio Online
[GWAB] Testing Scenarios with Windows Azure and Visual Studio OnlineVitor Tomaz
 
Dev ops developer (session 3)
Dev ops developer (session 3)Dev ops developer (session 3)
Dev ops developer (session 3)MSDEVMTL
 
Best Selenium Framework for Testing Web Application - A Mindtree Article
Best Selenium Framework for Testing Web Application - A Mindtree ArticleBest Selenium Framework for Testing Web Application - A Mindtree Article
Best Selenium Framework for Testing Web Application - A Mindtree Articledevraajsingh
 

Similar a Microsoft Testing Tour - Setting up a Test Environment (20)

Overview of Lab Management and TFS
Overview of Lab Management and TFSOverview of Lab Management and TFS
Overview of Lab Management and TFS
 
qawithmicrosofttestmanagerandlabmanagement
qawithmicrosofttestmanagerandlabmanagementqawithmicrosofttestmanagerandlabmanagement
qawithmicrosofttestmanagerandlabmanagement
 
05 test infrastructure
05   test infrastructure05   test infrastructure
05 test infrastructure
 
QA with Microsoft Test Manager and Lab Management
QA with Microsoft Test Manager and Lab ManagementQA with Microsoft Test Manager and Lab Management
QA with Microsoft Test Manager and Lab Management
 
Tips to achieve continuous integration/delivery using HP ALM, Jenkins, and S...
 Tips to achieve continuous integration/delivery using HP ALM, Jenkins, and S... Tips to achieve continuous integration/delivery using HP ALM, Jenkins, and S...
Tips to achieve continuous integration/delivery using HP ALM, Jenkins, and S...
 
03 test specification and execution
03   test specification and execution03   test specification and execution
03 test specification and execution
 
2015-01-12 TechTalk - Continuous Delivery and Release Management
2015-01-12 TechTalk - Continuous Delivery and Release Management2015-01-12 TechTalk - Continuous Delivery and Release Management
2015-01-12 TechTalk - Continuous Delivery and Release Management
 
No More No Repro
No More No ReproNo More No Repro
No More No Repro
 
DevOps Roadshow - continuous delivery and release management
DevOps Roadshow - continuous delivery and release managementDevOps Roadshow - continuous delivery and release management
DevOps Roadshow - continuous delivery and release management
 
Anatomy of a Build Pipeline
Anatomy of a Build PipelineAnatomy of a Build Pipeline
Anatomy of a Build Pipeline
 
[DevDay 2017] Automation Testing - Speaker: Nghia Khuong - Project Manager at...
[DevDay 2017] Automation Testing - Speaker: Nghia Khuong - Project Manager at...[DevDay 2017] Automation Testing - Speaker: Nghia Khuong - Project Manager at...
[DevDay 2017] Automation Testing - Speaker: Nghia Khuong - Project Manager at...
 
The state of testing @ Microsoft
The state of testing @ MicrosoftThe state of testing @ Microsoft
The state of testing @ Microsoft
 
Microsoft Testing Tour - Functional and Automated Testing
Microsoft Testing Tour - Functional and Automated TestingMicrosoft Testing Tour - Functional and Automated Testing
Microsoft Testing Tour - Functional and Automated Testing
 
Too Dependent on Shared Test Environments? Kick Start Local Workstation Testing!
Too Dependent on Shared Test Environments? Kick Start Local Workstation Testing!Too Dependent on Shared Test Environments? Kick Start Local Workstation Testing!
Too Dependent on Shared Test Environments? Kick Start Local Workstation Testing!
 
Visual Studio ALM and DevOps Tools Walkthrough
Visual Studio ALM and DevOps Tools WalkthroughVisual Studio ALM and DevOps Tools Walkthrough
Visual Studio ALM and DevOps Tools Walkthrough
 
Automated Testing Of EPiServer CMS Sites
Automated Testing Of EPiServer CMS SitesAutomated Testing Of EPiServer CMS Sites
Automated Testing Of EPiServer CMS Sites
 
[GWAB] Testing Scenarios with Windows Azure and Visual Studio Online
[GWAB] Testing Scenarios with Windows Azure and Visual Studio Online[GWAB] Testing Scenarios with Windows Azure and Visual Studio Online
[GWAB] Testing Scenarios with Windows Azure and Visual Studio Online
 
Test automation
Test automationTest automation
Test automation
 
Dev ops developer (session 3)
Dev ops developer (session 3)Dev ops developer (session 3)
Dev ops developer (session 3)
 
Best Selenium Framework for Testing Web Application - A Mindtree Article
Best Selenium Framework for Testing Web Application - A Mindtree ArticleBest Selenium Framework for Testing Web Application - A Mindtree Article
Best Selenium Framework for Testing Web Application - A Mindtree Article
 

Más de Angela Dugan

VSL Las Vegas 2023 - Measuring Up! How To Choose Agile Metrics
VSL Las Vegas 2023 - Measuring Up! How To Choose Agile MetricsVSL Las Vegas 2023 - Measuring Up! How To Choose Agile Metrics
VSL Las Vegas 2023 - Measuring Up! How To Choose Agile MetricsAngela Dugan
 
VSL MSHQ 2022 - Supercharged Feedback Techniques in 20 minutes - Dugan.pdf
VSL MSHQ 2022 - Supercharged Feedback Techniques in 20 minutes - Dugan.pdfVSL MSHQ 2022 - Supercharged Feedback Techniques in 20 minutes - Dugan.pdf
VSL MSHQ 2022 - Supercharged Feedback Techniques in 20 minutes - Dugan.pdfAngela Dugan
 
VS Liv MSHQ 2022 - Measuring Up! How To Choose Agile Metrics - Dugan.pdf
VS Liv MSHQ 2022 - Measuring Up! How To Choose Agile Metrics - Dugan.pdfVS Liv MSHQ 2022 - Measuring Up! How To Choose Agile Metrics - Dugan.pdf
VS Liv MSHQ 2022 - Measuring Up! How To Choose Agile Metrics - Dugan.pdfAngela Dugan
 
Adaptability Quotient - DevUp 2022.pdf
Adaptability Quotient  - DevUp 2022.pdfAdaptability Quotient  - DevUp 2022.pdf
Adaptability Quotient - DevUp 2022.pdfAngela Dugan
 
Measuring Up - Agile Team Metrics - DevUp 2022.pdf
Measuring Up - Agile Team Metrics - DevUp 2022.pdfMeasuring Up - Agile Team Metrics - DevUp 2022.pdf
Measuring Up - Agile Team Metrics - DevUp 2022.pdfAngela Dugan
 
Measuring Up - PMI Agile Conference 2022.pdf
Measuring Up - PMI Agile Conference 2022.pdfMeasuring Up - PMI Agile Conference 2022.pdf
Measuring Up - PMI Agile Conference 2022.pdfAngela Dugan
 
VS Live 2021 Orlando - vst14 feedback skills
VS Live 2021 Orlando - vst14 feedback skillsVS Live 2021 Orlando - vst14 feedback skills
VS Live 2021 Orlando - vst14 feedback skillsAngela Dugan
 
VS Live 2021 VST09 agile team metrics Fast Focus - angela dugan
VS Live 2021   VST09 agile team metrics Fast Focus - angela duganVS Live 2021   VST09 agile team metrics Fast Focus - angela dugan
VS Live 2021 VST09 agile team metrics Fast Focus - angela duganAngela Dugan
 
THAT Conference 2021 - Level up your Feedback Game
THAT Conference 2021 - Level up your Feedback GameTHAT Conference 2021 - Level up your Feedback Game
THAT Conference 2021 - Level up your Feedback GameAngela Dugan
 
APLN 2021 - Adaptability Quotient keynote - Sara Caldwell and Angela Dugan
APLN 2021 - Adaptability Quotient keynote - Sara Caldwell and Angela DuganAPLN 2021 - Adaptability Quotient keynote - Sara Caldwell and Angela Dugan
APLN 2021 - Adaptability Quotient keynote - Sara Caldwell and Angela DuganAngela Dugan
 
Agile midwest 2019 tap, tap, tap communication
Agile midwest 2019   tap, tap, tap communicationAgile midwest 2019   tap, tap, tap communication
Agile midwest 2019 tap, tap, tap communicationAngela Dugan
 
That conference tap, tap, tap communication
That conference tap, tap, tap communicationThat conference tap, tap, tap communication
That conference tap, tap, tap communicationAngela Dugan
 
Agile days chicago 2018 - how do you measure up?
Agile days chicago 2018 -  how do you measure up?Agile days chicago 2018 -  how do you measure up?
Agile days chicago 2018 - how do you measure up?Angela Dugan
 
VS Live Chicago 2018 - how do you measure up
VS Live Chicago 2018 - how do you measure upVS Live Chicago 2018 - how do you measure up
VS Live Chicago 2018 - how do you measure upAngela Dugan
 
Chicago Code Camp 2018 - Building strong teams
Chicago Code Camp 2018 - Building strong teamsChicago Code Camp 2018 - Building strong teams
Chicago Code Camp 2018 - Building strong teamsAngela Dugan
 
APLN Conference 2018 - Getting your agile team unstuck
APLN Conference 2018 - Getting your agile team unstuckAPLN Conference 2018 - Getting your agile team unstuck
APLN Conference 2018 - Getting your agile team unstuckAngela Dugan
 
Dev up 2017 - Half Day Workshop: Getting your agile team unstuck
Dev up 2017 - Half Day Workshop: Getting your agile team unstuckDev up 2017 - Half Day Workshop: Getting your agile team unstuck
Dev up 2017 - Half Day Workshop: Getting your agile team unstuckAngela Dugan
 
Dev up 2017 - how do you measure up
Dev up 2017 - how do you measure upDev up 2017 - how do you measure up
Dev up 2017 - how do you measure upAngela Dugan
 
That conference 2017 - Getting your Agile Team Unstuck
That conference 2017 - Getting your Agile Team UnstuckThat conference 2017 - Getting your Agile Team Unstuck
That conference 2017 - Getting your Agile Team UnstuckAngela Dugan
 
Chicago Coders Conference 2017 - Metrics that matter
Chicago Coders Conference 2017 - Metrics that matterChicago Coders Conference 2017 - Metrics that matter
Chicago Coders Conference 2017 - Metrics that matterAngela Dugan
 

Más de Angela Dugan (20)

VSL Las Vegas 2023 - Measuring Up! How To Choose Agile Metrics
VSL Las Vegas 2023 - Measuring Up! How To Choose Agile MetricsVSL Las Vegas 2023 - Measuring Up! How To Choose Agile Metrics
VSL Las Vegas 2023 - Measuring Up! How To Choose Agile Metrics
 
VSL MSHQ 2022 - Supercharged Feedback Techniques in 20 minutes - Dugan.pdf
VSL MSHQ 2022 - Supercharged Feedback Techniques in 20 minutes - Dugan.pdfVSL MSHQ 2022 - Supercharged Feedback Techniques in 20 minutes - Dugan.pdf
VSL MSHQ 2022 - Supercharged Feedback Techniques in 20 minutes - Dugan.pdf
 
VS Liv MSHQ 2022 - Measuring Up! How To Choose Agile Metrics - Dugan.pdf
VS Liv MSHQ 2022 - Measuring Up! How To Choose Agile Metrics - Dugan.pdfVS Liv MSHQ 2022 - Measuring Up! How To Choose Agile Metrics - Dugan.pdf
VS Liv MSHQ 2022 - Measuring Up! How To Choose Agile Metrics - Dugan.pdf
 
Adaptability Quotient - DevUp 2022.pdf
Adaptability Quotient  - DevUp 2022.pdfAdaptability Quotient  - DevUp 2022.pdf
Adaptability Quotient - DevUp 2022.pdf
 
Measuring Up - Agile Team Metrics - DevUp 2022.pdf
Measuring Up - Agile Team Metrics - DevUp 2022.pdfMeasuring Up - Agile Team Metrics - DevUp 2022.pdf
Measuring Up - Agile Team Metrics - DevUp 2022.pdf
 
Measuring Up - PMI Agile Conference 2022.pdf
Measuring Up - PMI Agile Conference 2022.pdfMeasuring Up - PMI Agile Conference 2022.pdf
Measuring Up - PMI Agile Conference 2022.pdf
 
VS Live 2021 Orlando - vst14 feedback skills
VS Live 2021 Orlando - vst14 feedback skillsVS Live 2021 Orlando - vst14 feedback skills
VS Live 2021 Orlando - vst14 feedback skills
 
VS Live 2021 VST09 agile team metrics Fast Focus - angela dugan
VS Live 2021   VST09 agile team metrics Fast Focus - angela duganVS Live 2021   VST09 agile team metrics Fast Focus - angela dugan
VS Live 2021 VST09 agile team metrics Fast Focus - angela dugan
 
THAT Conference 2021 - Level up your Feedback Game
THAT Conference 2021 - Level up your Feedback GameTHAT Conference 2021 - Level up your Feedback Game
THAT Conference 2021 - Level up your Feedback Game
 
APLN 2021 - Adaptability Quotient keynote - Sara Caldwell and Angela Dugan
APLN 2021 - Adaptability Quotient keynote - Sara Caldwell and Angela DuganAPLN 2021 - Adaptability Quotient keynote - Sara Caldwell and Angela Dugan
APLN 2021 - Adaptability Quotient keynote - Sara Caldwell and Angela Dugan
 
Agile midwest 2019 tap, tap, tap communication
Agile midwest 2019   tap, tap, tap communicationAgile midwest 2019   tap, tap, tap communication
Agile midwest 2019 tap, tap, tap communication
 
That conference tap, tap, tap communication
That conference tap, tap, tap communicationThat conference tap, tap, tap communication
That conference tap, tap, tap communication
 
Agile days chicago 2018 - how do you measure up?
Agile days chicago 2018 -  how do you measure up?Agile days chicago 2018 -  how do you measure up?
Agile days chicago 2018 - how do you measure up?
 
VS Live Chicago 2018 - how do you measure up
VS Live Chicago 2018 - how do you measure upVS Live Chicago 2018 - how do you measure up
VS Live Chicago 2018 - how do you measure up
 
Chicago Code Camp 2018 - Building strong teams
Chicago Code Camp 2018 - Building strong teamsChicago Code Camp 2018 - Building strong teams
Chicago Code Camp 2018 - Building strong teams
 
APLN Conference 2018 - Getting your agile team unstuck
APLN Conference 2018 - Getting your agile team unstuckAPLN Conference 2018 - Getting your agile team unstuck
APLN Conference 2018 - Getting your agile team unstuck
 
Dev up 2017 - Half Day Workshop: Getting your agile team unstuck
Dev up 2017 - Half Day Workshop: Getting your agile team unstuckDev up 2017 - Half Day Workshop: Getting your agile team unstuck
Dev up 2017 - Half Day Workshop: Getting your agile team unstuck
 
Dev up 2017 - how do you measure up
Dev up 2017 - how do you measure upDev up 2017 - how do you measure up
Dev up 2017 - how do you measure up
 
That conference 2017 - Getting your Agile Team Unstuck
That conference 2017 - Getting your Agile Team UnstuckThat conference 2017 - Getting your Agile Team Unstuck
That conference 2017 - Getting your Agile Team Unstuck
 
Chicago Coders Conference 2017 - Metrics that matter
Chicago Coders Conference 2017 - Metrics that matterChicago Coders Conference 2017 - Metrics that matter
Chicago Coders Conference 2017 - Metrics that matter
 

Último

Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)Zilliz
 
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot ModelMcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot ModelDeepika Singh
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Jeffrey Haguewood
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAndrey Devyatkin
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FMESafe Software
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoffsammart93
 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistandanishmna97
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyKhushali Kathiriya
 
Vector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptxVector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptxRemote DBA Services
 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusZilliz
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodJuan lago vázquez
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Victor Rentea
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FMESafe Software
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024The Digital Insurer
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingEdi Saputra
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...apidays
 
Spring Boot vs Quarkus the ultimate battle - DevoxxUK
Spring Boot vs Quarkus the ultimate battle - DevoxxUKSpring Boot vs Quarkus the ultimate battle - DevoxxUK
Spring Boot vs Quarkus the ultimate battle - DevoxxUKJago de Vreede
 
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...apidays
 

Último (20)

Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)
 
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot ModelMcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistan
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
Vector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptxVector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptx
 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with Milvus
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 
Spring Boot vs Quarkus the ultimate battle - DevoxxUK
Spring Boot vs Quarkus the ultimate battle - DevoxxUKSpring Boot vs Quarkus the ultimate battle - DevoxxUK
Spring Boot vs Quarkus the ultimate battle - DevoxxUK
 
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
 

Microsoft Testing Tour - Setting up a Test Environment

  • 1. With TFS and Visual Studio Angela Dugan ALM Practice Manager Polaris Solutions
  • 3. Continuous integrations Build | Deploy | Test Testing toolbox Manual testing  User testing  Ad-hoc exploratory testing  Planned manual testing Role tailored tools User Interface Automated testing  Keyword testing  UI automation testing  Performance testing Services Business Processes Business Rules and Logic Service integrations Data access Identity Data Automated testing  Unit testing  Integration testing  Performance testing  Load testing
  • 4. Lab manager Lab management services Test runners Diagnostic data collectors Test execution services Build engines Pluggable components Build services Lab environments
  • 5. Virtualization reduces cost to provision environments Modern apps run in diverse environments Difficult to repro issues found Replicating environments for test is time-consuming, costly Dramatically reduced hardware and maintenance expenses Templates allow a wide range of baselines to be spun up quickly and on demand Improved quality and reliability of apps across platforms Snapshots capture states for reproducing test conditions and verifying defects Operations engaged in earlier phases of testing
  • 7. Create and manage virtual or physical environments for Dev/Test Take snapshots or revert to existing snapshots for any virtual machine Deploy current or any build to environment Interact with virtual machines through the environment viewer Define test settings for environments
  • 8.
  • 9. Test Controllers and Agents Test agent controller manages test agents Web Server Test Agent Test Agent Controller Collect Intellitrace Information Client Test Agent Run Tests Test Agent Test Agent Run Tests Collect Test Impact Data Team Foundation Server Collect System Information Network Emulation Client Register with Team Project Collection Database Server Where to run Tests? Collect Data? Test agents run tests and collect data or impact the system Affect Machine
  • 10. Installed on the “client” machines Three types of agents Test Agent-Enables automated testing Build Agent-Enables automated deployment Lab Agent-Enables network isolation Install from the Lab Management or TFS media Can be installed/maintained using the VMPrepTool
  • 12. Create a new environment using virtual machine templates in SCVMM Create new environments on existing machines Create an environment using machines running on SCVMM
  • 13. Quickly choose multiple test suites to run after deployment Choose your environment, and build, deploy and test in that environment from a single dialog
  • 14. Spin up virtual test environments from within Test Manager, or attach a virtual environment to a manual testing session Snapshot environments during manual testing to increase reproducibility
  • 15. Thumbnail view of each machine in the environment
  • 16. Developers can quickly debug issues on the exact same testing environment Environment snapshot taken and attached as a link with bug
  • 17. Test run results are attached to specific builds and environments Collect all the data required to recreate bugs from virtual environments
  • 18.
  • 19.
  • 20. SCVMM Environment Build-Deploy-Test Snapshot / Restore Share Bug Snapshots Network Fencing 3rd Party Virtualization Physical Machines Standard Environment
  • 21. Lab Management is included with Visual Studio Premium/Test Pro SCVMM license for dev/test is included MSDN Headless Hyper-V as the host OS Guest OS license is part of MSDN subscription Each person accessing the Virtual Machine Host (or accessing a virtual machine on that host) must have an MSDN subscription
  • 23.
  • 24. Creating VMs Create and store VMs - MSDN doc Prepare a domain controller VM Manage virtual environments Creating virtual envs - MSDN doc Creating and working with virtual envs Concepts and guidelines Creating network isolated environments Networking Networking basics Network isolation
  • 25. Topology 1 - Multiple AT, Load Balancer and Test network with firewall settings, controlling the test traffic in and out of Corp network Network load balancer Firewall rules Topology 2 - Multiple ATs and DTs without load balancers and Test network with SAN based library and host SAN support Topology 3 - TMG, Windows NLB and with Test apps having DB tier outside of virtual environment Setting up rules in Threat Management Gateway Deployment and testing on a shared machine outside the envt Topology 4 - Multiple ATs and DTs, load balancers and environments joined to a different domain DNS conditional forwarding