Lab Management with TFS 2010
•
8 recomendaciones•2,873 vistas
Discusses the Visual Studio Lab Management features available in Visual Studio 2010 and Team Foundation Server 2010.
![About Ed Blankenship ,[object Object]](data:image/gif;base64,R0lGODlhAQABAIAAAAAAAP///yH5BAEAAAAALAAAAAABAAEAAAIBRAA7)
Recomendados
Más contenido relacionado
La actualidad más candente
La actualidad más candente (20)
Destacado
Destacado (9)
Similar a Lab Management with TFS 2010
Similar a Lab Management with TFS 2010 (20)
Último
Último (20)
Lab Management with TFS 2010
- 1. Virtual Lab Management Team Foundation Server 2010 Ed Blankenship Microsoft MVP (TFS, Visual Studio ALM, and VSTS) Notion Solutions, Inc. www.notionsolutions.com
- 3. ALM/TFS Consultant at Notion Solutions
- 4. Live in Charleston, SC
- 9. Customer Challenges QA is not aligned with lifecycle Developers and testers work in silos QA is not leveraged
- 10. Goals for 2010 Release - Testing Align QA with the Lifecycle Create tighter Dev/Test interaction Enable highly leveraged QA teams
- 11. Visual Studio 2010 Test Capabilities specialist generalist coded ui test unit testing web performance test test runner load test test case management virtual lab management data diagnostic adapters (video, action log, event log etc) team foundation server with reporting (bugs, requirements, user stories, source control, build)
- 13. Test Planning Test Process Requirement Requirement Test Writing Requirement Test Automation Test Execution Report Results
- 15. Work Item based test case management, test planning and status tracking
- 17. Identification of high-priority tests
- 18. Robust manual testing functionality
- 19. Test definition
- 20. User-friendly Manual Test Runner
- 21. Defect data capture tools
- 25. Test Recording
- 26. Data Collectors
- 29. Load Testing
- 30. Generic Tests
- 31. Ordered Tests
- 33. 12 Test Case is first class work item in TFS Detailed steps along with expected results
- 34. 13 Data drive a test case Specify data in parameter table
- 35. 14 Select common steps and convert to Shared Steps
- 36. 15 Shared Steps allows for common steps to be reused across test cases
- 37. 16 Organize Tests using Static (folder) suite
- 38. 17 Or create new test cases & add to suite Add existing Test cases to suite
- 39. 18 Organize Tests using Requirements based suite
- 40. 19 Select requirement and add to plan
- 41. 20 Tests already linked to requirement are added to plan
- 42. 21 Assign tests to team members
- 43. 22 Organize Tests using Query Based (dynamic) suite
- 44. 23 Specify a Query
- 45. 24 Tests matching query are added to suite
- 46. 25 Rich Bug and Test Runner
- 48. Eliminates the “ping pong” effect
- 50. 28 Microsoft Test Runner starts up
- 51. 29 Mark steps (pass/fail) during testing Error free data entry of parameters using CTRL+V
- 52. 30 Mark step as fail – bug found
- 53. 31 Add comment
- 55. 33 Click on Create Bug
- 58. Event Logs
- 59. IntelliTrace
- 60. Test Impact
- 61. Video Recorder
- 63. 36 Indexed Video links
- 64. 37 Data collector logs auto attached
- 65. 38 Exact actions performed for each step
- 66. 39 System Info across all VMs in environment
- 67. 40 Link to test case auto-created
- 68. 41 Just enter Title and save the bug
- 70. Start Debug
- 71. Encounter defect
- 73. Move back through execution history to locate defect
- 74. Historical debug trace enables debugging offline test runs
- 78. Coded UI Testing Enables verification of UI functionality. Record test actions and VS will generate the resulting code. Assertions can be added to verify functionality. Like all VS tests, results can be stored in TFS.
- 79. 47 From Test->new test, click Coded UI test, specify test name and project name
- 80. 48 Use existing action recording to generate code
- 81. 49 Specify test case which has action recording and click OK
- 82. 50 Code generated from action recording – datasource as TestCase
- 83. 51 Code generated handles data parameterization
- 84. 52 Invoke Coded UI Test Builder for adding assertions
- 85. 53 Drag cross-hair onto the control you want to add assertions on
- 86. 54 Properties of selected control and its UIMap is shown
- 87. 55 Select property to assert on and right click to add assertion
- 88. 56 Add the assert
- 89. 57 Specify Assert method name and generate code
- 90. 58 Code generated for assert method
- 91. 59 Add solution to source control
- 92. 60 Check-in pending changes
- 93. 61 Go to test case that you want to associate the newly created automation
- 94. 62 Specify test method and click OK; save test case
- 95. 63 Newly automated test case will be picked up by dynamic query based suite and run as part of build-deploy-test workflow
- 97. 65 Virtual Environment Provisioning
- 99. Simplifies testing multiple configurations
- 100. Enables reverting to baseline configuration
- 101. Provides checkpoints to aid defect resolution
- 103. Lower technical requirements for test environment creation
- 106. One “golden” VM in a specific configuration
- 107. i.e. Win 7 x64, with SQL 2008 R2 & Office
- 108. Environment Template
- 110. 71 Specify name and location for environment
- 111. 72 Pick role for VM Select VM from template library
- 112. 73 Specify capabilities – “Run Tests” ; “Run Workflows” ; “Network Isolation”
- 113. 74 Environment (collection of VMs) created
- 114. 75 Manage snapshots for environment Access environment using Lab Environment Viewer
- 115. 76 Take environment snapshot
- 116. 77 Dev clicks on lvr link & selects connect to snapshot of the environment
- 117. 78 Dev is able to access the snapshot’ed environment via LE viewer
- 118. Lab Management 2010 Capability/Features Virtual Environments (Hyper-V) Physical environments Virtual environments (non Hyper-V e.g. VMWare) Visual Studio 2010 Capability/Feature Testing Running unit tests Running manual tests Running automated, load, and coded UI tests Filing rich bugs with diagnostic adapters Build deployment Automated build-deploy-test workflow Environment creation and management Create environment from VM templates Start/stop/snapshot environment Connect to environment using Environment Viewer Clone environments using network isolation Supported out of box Not supported, but possible with customization Not Supported N/A
- 119. 80 Automated Build – Deploy - Test
- 120. 81 Create new build workflow
- 121. 82 Provide a name
- 122. 83 Specify Build Controller and output drop folder
- 124. 85 Specify workflow settings
- 125. 86 Select environment Revert to a specific snapshot
- 126. 87 Select build definition to build the application
- 127. 88 Specify deploy scripts Take snapshot after deployment
- 128. 89 Specify tests to run post deployment
- 129. 90 Detailed Build report
- 131. By Requirement
- 132. By Automated Build
- 133. Quality Dashboard
- 140. Dashboards Excel Services Reports Team Web Access Sharepoint Web Parts
- 141. Questions?
Notas del editor
- We found that customers pain points bucketed themselves into three things areasTesters are not aligned with the lifecycle. Finding out a code change is impacting their day at work (test more, go home late, miss the time with kids). Testers and developers work in silo’s often causing significant dis-satisfaction and un-happiness and creating an environment of lack of respect across the two teams. Testers are smart, developers often don’t give them the respect they deserve because they see testers filing poor defects, not really impacting quality. Testing teams are not really leveraged well as they waste so much time doing the basic things. Just getting their bugs looked at take so much time that they cannot spend quality time doing what they love and provide better service to the broader teams.
- The 2010 release for Microsoft is a very big release with a lot of rich capabilities. Quality is a key pillars for the release planning efforts and we aspired to achieve the above goals with the test offerings in the 2010 release by taking a fresh look at the problems.We want to align QA with the lifecycle to ensure that testers can add more value to the application lifecycle and are not looked at “necessary evil”. Having test assets co-located with the dev assets & project assets ensures visibility across the entire team.Create tighter integration across development & test teams to ensure that we can eliminate waste across the hand shake (or lack there of) that happens across devs & tests when it comes to bugs, builds, recreation of bugs etc. Enable highly leveraged QA teams ensures that teams are most efficient and are driving up productivity by focusing on key tasks and eliminating a lot of the waste that spans from boring repetitive tasks.
- This is the fully animated slide.
- Test Case Management using Microsoft Test and Lab Manager, a centralized testing toolProvisioning of multi-tier test environments and integrating it with build workflowFiling rich & actionable bug with minimal effort on the provisioned environmentCreating Coded UI Test using Action Log from Manual Testing & adding it run as part of build workflow on provisioned test environment
- Test Case Management using Microsoft Test and Lab Manager, a centralized testing toolProvisioning of multi-tier test environments and integrating it with build workflowFiling rich & actionable bug with minimal effort on the provisioned environmentCreating Coded UI Test using Action Log from Manual Testing & adding it run as part of build workflow on provisioned test environment
- Test Case Management using Microsoft Test and Lab Manager, a centralized testing toolProvisioning of multi-tier test environments and integrating it with build workflowFiling rich & actionable bug with minimal effort on the provisioned environmentCreating Coded UI Test using Action Log from Manual Testing & adding it run as part of build workflow on provisioned test environment
- Test Case Management using Microsoft Test and Lab Manager, a centralized testing toolProvisioning of multi-tier test environments and integrating it with build workflowFiling rich & actionable bug with minimal effort on the provisioned environmentCreating Coded UI Test using Action Log from Manual Testing & adding it run as part of build workflow on provisioned test environment
- Test Case Management using Microsoft Test and Lab Manager, a centralized testing toolProvisioning of multi-tier test environments and integrating it with build workflowFiling rich & actionable bug with minimal effort on the provisioned environmentCreating Coded UI Test using Action Log from Manual Testing & adding it run as part of build workflow on provisioned test environment
- Test Case Management using Microsoft Test and Lab Manager, a centralized testing toolProvisioning of multi-tier test environments and integrating it with build workflowFiling rich & actionable bug with minimal effort on the provisioned environmentCreating Coded UI Test using Action Log from Manual Testing & adding it run as part of build workflow on provisioned test environment
- Test Case Management using Microsoft Test and Lab Manager, a centralized testing toolProvisioning of multi-tier test environments and integrating it with build workflowFiling rich & actionable bug with minimal effort on the provisioned environmentCreating Coded UI Test using Action Log from Manual Testing & adding it run as part of build workflow on provisioned test environment
- Test Case Management using Microsoft Test and Lab Manager, a centralized testing toolProvisioning of multi-tier test environments and integrating it with build workflowFiling rich & actionable bug with minimal effort on the provisioned environmentCreating Coded UI Test using Action Log from Manual Testing & adding it run as part of build workflow on provisioned test environment
- http://www.wintellect.com/CS/blogs/jrobbins/archive/2009/06/16/how-does-vs2010-historical-debugging-work.aspxhttp://blogs.msdn.com/habibh/default.aspx
- This would normally go in the Testing section but want to demonstrate it here during the build process.
- http://blogs.msdn.com/mathew_aniyan
- Test Case Management using Microsoft Test and Lab Manager, a centralized testing toolProvisioning of multi-tier test environments and integrating it with build workflowFiling rich & actionable bug with minimal effort on the provisioned environmentCreating Coded UI Test using Action Log from Manual Testing & adding it run as part of build workflow on provisioned test environment
- Test Case Management using Microsoft Test and Lab Manager, a centralized testing toolProvisioning of multi-tier test environments and integrating it with build workflowFiling rich & actionable bug with minimal effort on the provisioned environmentCreating Coded UI Test using Action Log from Manual Testing & adding it run as part of build workflow on provisioned test environment
- Test Case Management using Microsoft Test and Lab Manager, a centralized testing toolProvisioning of multi-tier test environments and integrating it with build workflowFiling rich & actionable bug with minimal effort on the provisioned environmentCreating Coded UI Test using Action Log from Manual Testing & adding it run as part of build workflow on provisioned test environment
- http://blogs.msdn.com/gautamg/archive/2010/01/07/platform-support-for-coded-ui-test-and-fast-forward-feature-of-test-runner.aspx
- Test Case Management using Microsoft Test and Lab Manager, a centralized testing toolProvisioning of multi-tier test environments and integrating it with build workflowFiling rich & actionable bug with minimal effort on the provisioned environmentCreating Coded UI Test using Action Log from Manual Testing & adding it run as part of build workflow on provisioned test environment
- Test Case Management using Microsoft Test and Lab Manager, a centralized testing toolProvisioning of multi-tier test environments and integrating it with build workflowFiling rich & actionable bug with minimal effort on the provisioned environmentCreating Coded UI Test using Action Log from Manual Testing & adding it run as part of build workflow on provisioned test environment
- Test Case Management using Microsoft Test and Lab Manager, a centralized testing toolProvisioning of multi-tier test environments and integrating it with build workflowFiling rich & actionable bug with minimal effort on the provisioned environmentCreating Coded UI Test using Action Log from Manual Testing & adding it run as part of build workflow on provisioned test environment
- Test Case Management using Microsoft Test and Lab Manager, a centralized testing toolProvisioning of multi-tier test environments and integrating it with build workflowFiling rich & actionable bug with minimal effort on the provisioned environmentCreating Coded UI Test using Action Log from Manual Testing & adding it run as part of build workflow on provisioned test environment
- Test Case Management using Microsoft Test and Lab Manager, a centralized testing toolProvisioning of multi-tier test environments and integrating it with build workflowFiling rich & actionable bug with minimal effort on the provisioned environmentCreating Coded UI Test using Action Log from Manual Testing & adding it run as part of build workflow on provisioned test environment