Wait, That's Not Right by Troy Walsh

•

0 recomendaciones•181 vistas

This SauceCon 2019 presentation from Troy Walsh focuses on creating automated tests that fail better. He discusses logging and how it can make our failures valuable; explores error handling and how it can be both a blessing and a curse, and also covers test data management and how it can make failing far more useful.

Software

Wait, That’s Not
Right!
AKA - Failing better
Troy Walsh
04.25.19

3
Effective Test Data Management
» Sufficient
» Representative
» Reproducible
» Automated
» Deterministic?
» *Legal/ethical/safe
» Credible

4
» Collaboration
› QA
› Dev
› Operations
» *Tools
› Informatica - Test Data Management
› CA - Datamaker
› Compuware - Test Data Management
› IBM - InfoSphere Optim Test Data Management
› Many many more
What Does It Take

6
» Is it a bug
› “Works as designed”
› “Cannot reproduce”
› “Works on my machine”
» What caused it
› Data
› Application
› Integrations
› Etc.
» Is this really the problem
› Root cause
Challenges

7
» Summary
» Context
› Browser, OS, Resolution, Time (UTC), user, etc.
» Steps to reproduce
» Expected results
» Actual results
» Artifacts
› Screenshots, videos, logs, etc.
Reporting

10
Logging
» Built in logging
» Context
» Useful messages
» Testing artifact

11
Event Logging
» Captures interactions
» Readable logs
» Very powerful

12
» Can be taken at
any/multiple times
» Multiple formats
» *Integrates with
many reporting
frameworks
Screenshots

13
Browser Logs
» Script errors
» Nonvisible errors
» Developer console
*Does not work with every browser

15
» Videos
» Extended
debugging
» Build server
integration
Even Better With Sauce

18
» Have a test data management strategy
» Write automation as though you expect it to fail
» Have logging
» Take advantage of advanced logging capabilities
› Event firing
› Screenshots
› Console logs
» If you have a service like Sauce Labs, take advantage of it
› DevOps integration
› Video
› Extended debugging
Takeaways

19
» https://docs.microsoft.com/en-
us/dotnet/api/microsoft.visualstudio.testtools.unittesting.testcontext.writeline?view=mstest-net-
1.3.2#Microsoft_VisualStudio_TestTools_UnitTesting_TestContext_WriteLine_System_String_
» https://docs.microsoft.com/en-
us/dotnet/api/microsoft.visualstudio.testtools.unittesting.testcontext.addresultfile?view=mstest-net-1.3.2
» https://testng.org/doc/documentation-main.html#logging
» https://github.com/SeleniumHQ/selenium/blob/db1c2add0b47d845b7d0d7d67b65cee92d9bb323/ja
va/client/test/org/openqa/selenium/support/events/EventFiringWebDriverTest.java#L161
» https://github.com/SeleniumHQ/selenium/blob/07a18746ff756e90fd79ef253a328bd7dfa9e6dc/dotn
et/test/support/Events/EventFiringWebDriverTest.cs#L38
» https://wiki.saucelabs.com/display/DOCS/Platform+Configurator#/
» https://wiki.saucelabs.com/display/DOCS/Test+Configuration+Options
» https://wiki.saucelabs.com/display/DOCS/Setting+Up+CI+Platform+Integrations+with+Sauce+Plugins
» https://github.com/Magenic/MAQS
Helpful links

877.277.1044 / magenic.com // 21
THANK YOU

Más contenido relacionado

Similar a Wait, That's Not Right by Troy Walsh

Optimizing Java

Adam Feldscher

DockerCon Europe 2018 Monitoring & Logging Workshop

Brian Christner

Treating operational aspects of software as 'non-functional requirements' and 'an Ops problem' rather than a core part of the software product leads to poor live service and unexplained errors in Production. Traceability, deployability, recoverability, diagnosability, monitorability, and high quality logging are key features of a software system, along with user-visible features surfaced via the UI, or a capability of an API endpoint. However, many Product Owners understandably feel uneasy about taking on the (necessary) responsibility for prioritising operational features alongside user-visible and API features. This session brings Scrum Masters and Product Owners up to speed on operational features and covers proven practices for improving operability in an Agile context, empowering Product Owners to make effective prioritisation choices about all kinds of product features, whether user-visible or operational.

How to address operational aspects effectively with Agile practices - Matthew...

Skelton Thatcher Consulting Ltd

Support critical enterprise initiatives without burdening your mainframe staff. In today's always-on digital world, downtime isn’t an option. Applications span multiple platforms and networks, requiring an enterprise-wide view of security, critical incidents and outages that can bring business to a halt. Organizations are investing in Splunk and ServiceNow for real-time enterprise-wide visibility for faster identification, mitigation and resolution of issues that can impact the business. However, without the mainframe, these solutions have a glaring blind spot. Learn how leading IT organizations support critical security and operational enterprise initiatives by integrating the mainframe with these platforms, without disrupting the mainframe, or the teams that support it. We’ll cover: - Top use cases and benefits for including mainframe data in Splunk and ServiceNow - What happens to your mainframe data in each of these platforms - Challenges of integration… and how to solve them

Downtime is Not an Option: Integrating IBM Z into ServiceNow and Splunk

Precisely

Big Events Cause Network Mayhem

PacketTrap Msp

Why new hardware may not make SQL Server faster

SolarWinds

Leveling the playing field

Aaron Bedra

In today’s increasingly digital world, the stakes are higher than ever before for IT to support mission-critical business services 24x7x365. At the same time, the IT landscape is more complex, and staff can be dispersed across the country – or around the world. Downtime is not an option – but how do you avoid it? As they say, the best defense is a good offense. And that’s what ServiceNow delivers. ServiceNow Event Management uses machine-learning driven AI Ops to dramatically reduce the time it takes to identify and resolve problems by providing a single source of truth and cutting through the noise. But, if you still rely on siloed tools to monitor your mainframe and IBM i systems, you’ll find yourself back in the IT war room when things go wrong – wasting valuable time assembling the team and piecing together disconnected views just to understand the root cause – let alone fix it. With Precisely Ironstream, you can support business service health with dramatically lower mean-time-to-resolution by seamlessly integrating these legacy IBM systems into your ServiceNow Event Management dashboards. Join our webcast as we discuss: - Benefits of ServiceNow Event Management - Challenges integrating legacy systems into ServiceNow - How Ironstream integrates mainframe and IBM i machine data into ServiceNow Event Management

Avoid the IT War Room: Integrate Mainframe and IBM i into ServiceNow

Precisely

Securely Exchange CATIA Data Outside Your Enterprise

Joseph Lopez, M.ISM

Become an Information Intelligence Genius: 5 Steps to Make Your Life Easier

Jim Merrifield, IGP, CIP

Presented by Alex Kozaris, IXIASOFT IT Specialist at the IXIASOFT User Conference 2016. Murphy’s Law says that if something can go wrong, it will. But don’t let Murphy tell you what to do; instead come to this presentation where Alex will take you through effective troubleshooting procedures for the issues that he commonly sees with his extensive experience of solving issues involving the IXIASOFT DITA CMS.

Troubleshooting: The Two Laws - IXIASOFT User Conference 2016

IXIASOFT

Windows 7 client performance talk - Jeff Stokes

Jeff Stokes

This year's data breaches make it clearer than ever – organizations are in desperate need of an effective, consistent, and compliant incident response (IR) process that stops attacks in their tracks. To help companies like yours prepare for incidents, assess their impact, execute the response, and manage the process to closure, we made a bunch of enhancements to our platform this year. This webinar will feature some of the latest features, many of which came from customer requests, your peers in the industry: -Integrated threat intelligence provides team members the information they need, when they need it. -SIEM integrations and incident automation turbo-charge plan creation and execution. -Easy customization yields a finely-tuned response process without requiring programming expertise. Our featured speakers for this webinar will be: - Tim Armstrong, Sales Engineering Manager, Co3 Systems - Ted Julian, Chief Marketing Officer, Co3 Systems

By Popular Demand: Co3's Latest and Greatest Features

Resilient Systems

Proper logging can catch breaches like retail PoS

Michael Gough

Proper logging can catch breaches like retail PoS

Michael Gough

Common SQL Server Backup Problems

Grant Fritchey

Netpod - The Merging of NPM & APM

Boni Bruno

SRE in Apiary

Ladislav Prskavec

DBTA Data Summit : Eliminating the data constraint in Application Development

Kyle Hailey

Is your Automation Infrastructure ‘Well Architected’?

Adam Goucher

Similar a Wait, That's Not Right by Troy Walsh (20)

Optimizing Java

DockerCon Europe 2018 Monitoring & Logging Workshop

How to address operational aspects effectively with Agile practices - Matthew...

Downtime is Not an Option: Integrating IBM Z into ServiceNow and Splunk

Big Events Cause Network Mayhem

Why new hardware may not make SQL Server faster

Leveling the playing field

Avoid the IT War Room: Integrate Mainframe and IBM i into ServiceNow

Securely Exchange CATIA Data Outside Your Enterprise

Become an Information Intelligence Genius: 5 Steps to Make Your Life Easier

Troubleshooting: The Two Laws - IXIASOFT User Conference 2016

Windows 7 client performance talk - Jeff Stokes

By Popular Demand: Co3's Latest and Greatest Features

Proper logging can catch breaches like retail PoS

Common SQL Server Backup Problems

Netpod - The Merging of NPM & APM

SRE in Apiary

DBTA Data Summit : Eliminating the data constraint in Application Development

Is your Automation Infrastructure ‘Well Architected’?

Más de Sauce Labs

Testing Salesforce Apps presents numerous challenges for enterprise organizations. Teams have to navigate complex architecture, integration workflows, and continuous changes in the customized SFDC implementation, as well as a wide range of different applications hosted on Salesforce Cloud. If left unchecked, these challenges can hamper critical enterprise processes like the revenue-generating Quote to Cash process. During this webinar, you will learn how to automate functional testing and thoroughly test both the UIs and the APIs in your Salesforce applications using AutonomIQ’s AI-driven codeless tool. We’ll discuss how Aryaka Networks, a global leader in WAN transformation solutions, uses AutonomIQ to autonomously test critical business processes like Quote to Cash in their customized Salesforce application, and we’ll show you how to streamline UI testing to improve test creation, execution, and maintenance, and easily add API testing to your strategy for better coverage. Key Takeaways: Simplify the creation of your test scripts using plain English statements and a codeless studio Learn how to autonomously create UI and API tests for Salesforce and integrations with other applications Ensure the health of your end-to-end SFDC applications for key business processes like quote to cash

Simplify Salesforce Testing with AI-Driven Codeless Tools

Sauce Labs

During this webinar we look into location services on Android and iOS real devices, as well as emulators and simulators. We provide you with tips and tricks on when to change the mobile Geo-IP and when to change the mobile GPS, how to use ADB commands to enable the device location, and how to handle the location services permission alerts. We also discuss Appium capabilities for Location Services, using GeoLocation with Appium Desktop, and more. Key takeaways: - Understand what Location Services are - Understand GPS compare to Geo-IP - Know the Appium commands for Location Services - The differences in the use of Location Services between Android and iOS - Learn how to automate tests that involve Location Services

Testing on Mobile Devices with Location Services

Sauce Labs

There are countless ways to set up your automated testing environment. When it comes to stability and maintainability, it’s crucial to choose the right frameworks at the beginning of the journey, to set yourself up for success and save yourself time and headaches further down the road. In addition to traditional WebDriver-based JavaScript frameworks like Selenium or WebdriverIO, many new projects have popped up in recent years that provide even more capabilities, particularly for web UI testing. With the emergence of new frameworks like Puppeteer, Playwright, Cypress, and others, how do you choose which one’s right for you and your team? And how do you integrate the chosen framework into your testing practice, to shift testing left and speed up your software delivery lifecycle? In this webinar, Sauce Labs experts will provide an overview of the JavaScript framework landscape for automated functional testing, with a focus on Cypress, TestCafe, and Playwright. They will explore the differences between these frameworks, and discuss how to choose and implement the right tool for your project. Key Takeaways: - Understand how browser automation emerged over the last decade - Learn about the technical differences of traditional and new frameworks - Learn to pick the right JavaScript framework for your project Speakers: Christian Bromann | Staff Software Engineer, Sauce Labs Daniel Graham | Senior Software Engineer, Sauce Labs

Your Framework for Success: introduction to JavaScript Testing at Scale

Sauce Labs

When creating a mobile application, organisations have a few options to choose from; mobile web, native or a hybrid application. Where web apps are just websites that can be accessed on the internet via a mobile browser like Chrome or Safari, native apps are applications that are developed for a specific platform such as Android or iOS. Hybrid apps are different because they possess elements from native apps and web apps. When automating web applications, Selenium commands are used. Nine out of ten times the same automation script can be used for mobile web applications as our desktop web applications. With native apps however, we need to look deeper into the differences between Android and iOS apps before we can use Appium commands. But how should you automate hybrid apps, can or do you need to choose one of the two automation strategies or is there also a hybrid approach for automating hybrid apps? That’s what we are going to talk about during this webinar. We will be looking into how to detect a hybrid application for Android and iOS, the do’s and the don’ts when it comes to automating a hybrid application and we will provide you with tips and tricks on how to make this work for both Android and iOS. By the end of this webinar, you’ll be able to create your own Appium scripts to automate Android and iOS hybrid mobile applications. Key Takeaways: - Understand what a hybrid mobile application is - How to detect a hybrid mobile application - Learn how iOS and Android handle hybrid mobile applications - Learn how to automate hybrid mobile applications

Automating Hybrid Applications with Appium

Sauce Labs

Whether your company is a digital native or you’re just starting or well on your way to digital transformation, you know that your web services, mobile apps, and API programs need faster time-to-market without increasing risk. More full-stack and backend developers as well as QA/testing, architecture, and DevOps leaders are trying to inject rocket fuel into their agile development by doing more API testing. But how much UI testing can be moved over to much faster API testing? And then, how short can you make your testing sprints with API testing? With the right provisioning of UI, visual, and API testing, your organization can measurably improve DevOps metrics as you begin to do far more testing in much less time - without increasing on-hand IT resources. In this webinar, Sauce Labs experts will clarify what parts of the “quality spectrum” are better covered by UI testing vs. API testing. Learn why API testing can be much faster and more reliable than UI testing, and how you can leverage API testing to achieve quality at speed. Key Takeaways: - Easily extend your Selenium and Appium UI testing suite with API testing automation for much faster, more reliable functional, integration, and load/performance testing - Implement a CI/CD pipeline and DevOps workflows safely and securely with Sauce Labs full quality spectrum testing - Achieve quality at speed with significant improvements in time to market and quality to market

Quality at Speed: More API Testing, Less UI Testing

Sauce Labs

Engineering teams understand the importance of a comprehensive continuous testing strategy to build digital confidence, improve user experience, and accelerate release velocity. However, when beginning on the journey to continuous testing, the task of building and executing a strategy that provides clear value can be challenging. Whether it’s designing automation from scratch, understanding where you can scale the value of your tests throughout the pipeline and across teams, or demonstrating the value that quality brings to larger business objectives, building a test automation strategy sometimes creates a web that is seemingly too complex to untangle. In this webinar, Yoosuf Maktoum, Senior Manager of Quality Engineering at Sysco Corporation, will share a test automation design and implementation strategy that helped his own team achieve success. Yoosuf will discuss a unique test automation design pattern that both supports and accelerates automation efforts. This framework, leveraging open source technologies, enables reusability, smarter and faster automation, and is suitable in both a DevOps and Agile workflow. He will then demonstrate how this framework can be applied to a single test automation script for functional and nonfunctional tests, test data management, and test environment management, as well as how it can support testing for both legacy and modern applications. Through these methods, his team is able to provide quality as a service across the organization. Attendees of this session will learn: - Basic design principles to consider when building out automation, and how open source can augment your strategy - How to apply a single automation framework across various types of testing (web, mobile, API, and standalone automation) - Strategies for aligning testing with business objectives to demonstrate value to leadership

Creating Digital Confidence with Test Automation

Sauce Labs

The challenge for every product is to ship bug-free code as often as possible. Whether you are an early stage startup with a pilot application or a large corporation with myriad services, you’re dealing with this problem every day. We usually end up with either too little or too much testing and it’s hard to find the sweet spot. Too little testing and you have bugs and application instability, leading to time spent fixing bugs and manually regression testing your apps. You’re asking yourself, “isn’t there an easier way to do this?” Too much testing and you have slow release times and high automation maintenance costs. In this scenario, you’re asking yourself, “are the bugs I’m catching worth the time I’m spending maintaining this code?” In this webinar, software engineer Kate Green will go over a framework for evaluating your testing situation in order to find your organization’s sweet spot. Key Takeaways - Understanding where you are today - Identifying weak, brittle, or buggy parts of your application - Figuring out where to test first, and with what types of tests - How to pare down an excessively large automation suite Measuring test effectiveness

Just Enough (Automated) Testing

Sauce Labs

Accessibility is no longer a nice to have but rather a must have for many applications. Luckily there are things like the W3C’s WCAG (Web Content Accessibility Guidelines) that help testers understand accessibility standards. But wait, it gets better for teams that are using Selenium. This is because adding accessibility checks to your automation is both quick and easy. In this webinar, Magenic Practice Lead Troy Walsh will show how to leverage Axe, an accessibility testing engine, to add accessibility checks to your existing Selenium test suite. You will see just how easy it is, and be left wondering why it took you so long to get started. Key Takeaways - Why accessibility has become a must have for many applications - How to use the W3C’s Web Content Accessibility Guidelines to understand accessibility standards - How to easily add accessibility checks to your existing Selenium suite using Axe

Using Axe to Add Accessibility Checks to Your Existing Selenium Tests

Sauce Labs

When a company relies heavily on open source, it is a common practice to develop strategies and long term goals to manage the relationship between the company’s products and the open source ecosystem. We created the Open Source Program Office to: - Make sure the important open source projects for Sauce are in a healthy state - Motivate all Sauce Labs employees to consume and contribute to OSS in a simple, secure and healthy way - Facilitate communication between product and the open source ecosystem - Bring developers closer to the community to enable innovation and product obsession - Shape and build important standards for Sauce Labs, such as WebDriver, in collaboration with other open source groups This talk will show how we are doing all this in small steps, planning for the long run and involving all teams to increase the sense of belonging of OSS. And more importantly, it will show why having an open source strategy matters, and how can this benefit everyone in the long term. Key Takeaways - Why Sauce Labs created the Open Source Program Office, current projects and vision for the future - Why having a healthy open source ecosystem matters and how that can help your organization down the road - How open source can motivate teams to develop a product obsession

How Open Source Helps to Bring Back Product Obsession

Sauce Labs

Selenium 4 is coming. What’s in it? In this webinar, Simon Stewart, creator of WebDriver and core-contributor to the Selenium project, will talk about the next major Selenium release. - How is Selenium 4 different from Selenium 3? - What are the most relevant features? - Can you really deploy it into the Cloud? In this webinar, you will find out everything you ever wanted to know about Selenium 4, including demos of some of the new features! Watch the webinar: https://saucelabs.com/selenium-4

Webinar: A Sneak Peek at Selenium 4 with Simon Stewart

Sauce Labs

[Deu] Test Automatisierung Mit Web Driver.io

Sauce Labs

In this in-depth webcast, Joanna Schloss and Thomas Boyles of Sauce Labs will join Bloor Group analyst Eric Kavanaugh to examine the link between open source and successful DevOps. Drawing on their personal experience as engineers building technology within a DevOps framework, Schloss and Boyles will discuss: - Why open source technologies are often the missing link for businesses struggling to achieve their DevOps objectives - How progressive organizations are leveraging open source to optimize their shift-left initiatives, implement automated testing and accelerate innovation - How open source can simultaneously insulate your organization against risk while also encouraging exploration and innovation - The role and relevance of open source for different players in the DevOps world, from QAs and SDETs to developers and heads of engineering

Accelerating Innovation: Leveraging Open Source to Optimize Your Shift-Left I...

Sauce Labs

Presenting 2019 developer research, Diego Lo Giudice, Vice President, Principal Analyst at Forrester Research, will provide insight into how enterprise organizations are adopting and adapting for quality at great speed, while exploring: - How this increasing emphasis on speed and quality has put testing in the eye of the Agile+DevOps hurricane - What continuous testing means for testers, developers and business users today Diego will also present findings on the trends and practices poised to shape the testing market in 2019 and beyond.

Accelerating Your Digital Agenda with Continuous Testing ft. Forrester

Sauce Labs

In this webinar, Amir Rozenberg and Fernando Vidal will discuss the Sauce Labs Continuous Testing Benchmark Report, a new index based on insights gleaned from the more than 2 billion tests run on the Sauce Labs Continuous Testing platform. The index can be used by any organization to evaluate their progress towards continuous testing. Joining Amir and Fernando will be Phil Wells from the New York Times, a Sauce Labs customer that has achieved a nearly perfect 100 against the Continuous Testing Benchmark index. Key takeaways: - The components of the new continuous testing index - What makes those components such strong maturity indicators - How can organizations improve on each of the metrics - What happens organizationally when those metrics are improved - How the NY Times manages their continuous testing pipeline to deliver quality crosswords while driving constant improvements

How to Measure Success in Continuous Testing

Sauce Labs

Hear from Verizon Media’s Venu Narayanabhatla (Director, Software Development Engineering) and Sauce Labs’ Alissa Lydon (Continuous Testing SME/Product Marketing Manager) as they discuss: - Why Verizon Media decided to standardize their testing practices across a number of distributed teams, and how they implemented that change - The development of Screwdriver, now an open source CI tool, and how it solved internal challenges and enabled teams to embrace continuous integration - Their decision to integrate Screwdriver with Sauce Labs, and how it allowed for scaling to 2.7 million automated tests run per month against all of their applications

From Zero to 2.7 Million - How Verizon Media Embraced Open Source to Accelera...

Sauce Labs

With the acceleration of software creation and delivery, test activities must align to the new tempo. Developers need immediate feedback to be efficient and correct defects as those are introduced. The path to achieving this vision is to build a reliable and scalable continuous test solution. All beginnings are hard. Having a well-defined plan outlining the approach for your organization to create test automation is key to ensure long term success. Join Diego Molina, Senior Software Engineer at Sauce Labs as he discusses: The importance of setting up the team correctly from the start Choosing the right Testing Framework for your organization Identifying the right scenarios and workflows to test Learning to avoid common pitfalls at the beginning of the transformation journey

5 Steps to Jump Start Your Test Automation

Sauce Labs

Our own Marcus Merrell, Director of Technical Services in Customer Success and Thomas Boyles, Director of Engineering in Development, will speak with Aberdeen Research Director Jim Rapoza and discuss: - How testing is evolving to better meet the demands and current trends in DevOps and application development - The challenges organizations are facing when it comes to delivering high performing and reliable applications across platforms - Strategies leading organizations are following to shift testing left and right - How continuous testing can help you become a leader

Sauce Labs Webinar: Rising Importance of Software Testing

Sauce Labs

Selenide is an open source library that can make a huge impact and accelerate software delivery by introducing concise API, shorter expressions and many other capabilities. In this SauceCon 2019 presentation, Hima Bindu Peteti explains: - Key features of Selenide that can be used to make automation code simpler, easier to read and more maintainable - The most effective test automation design patterns with Selenide - Selenide support for Angular-based applications and other advanced Javascript libraries - How to use Selenide with Cucumber for BDD - Execution and generation of reports

BDD With Selenide by Hima Bindu Peteti

Sauce Labs

In this SauceCon 2019 presentation, Mario describes the practices that ABN AMRO adopted in mobile teams when it comes to testing native applications on real devices. Since using Espresso and XCUITest is still relatively uncommon for large apps and there are various unique challenges due to being in an EU-regulated industry with various security restrictions, Mario will share the ABN AMRO team’s experiences, including: - A brief architectural overview of the Mobile Banking app: why it is all native (Objective-C/Swift and Java/Kotlin), how it communicates with other apps and websites - Why ABN AMRO choose to adopt Espresso and XCUITest: the advantages and the limitations of this choice - How ABN AMRO runs their test pipelines to spread them across time and devices and prevent teams from being blocked

Closer To the Metal - Why and How We Use XCTest and Espresso by Mario Negro P...

Sauce Labs

When starting up a greenfield project, it’s easy to take advantage of the most modern development practices. But what about the rest of us, who are working on codebases greater than five minutes old? How do you take code that’s four years and hundreds of thousands of SLOC, and turn that into a lean, mean, continuous-deploying machine? In this SauceCon 2019 presentation, Melissa Benua walks through what continuous integration and deployment means for teams working on mature code bases, and what the roadmap looks like to get from a release cycle that may take weeks or months to one that deploys on-demand.

Continuous Delivery for "Mature" Codebases by Melisa Benua

Sauce Labs

Más de Sauce Labs (20)

Simplify Salesforce Testing with AI-Driven Codeless Tools

Testing on Mobile Devices with Location Services

Your Framework for Success: introduction to JavaScript Testing at Scale

Automating Hybrid Applications with Appium

Quality at Speed: More API Testing, Less UI Testing

Creating Digital Confidence with Test Automation

Just Enough (Automated) Testing

Using Axe to Add Accessibility Checks to Your Existing Selenium Tests

How Open Source Helps to Bring Back Product Obsession

Webinar: A Sneak Peek at Selenium 4 with Simon Stewart

[Deu] Test Automatisierung Mit Web Driver.io

Accelerating Innovation: Leveraging Open Source to Optimize Your Shift-Left I...

Accelerating Your Digital Agenda with Continuous Testing ft. Forrester

How to Measure Success in Continuous Testing

From Zero to 2.7 Million - How Verizon Media Embraced Open Source to Accelera...

5 Steps to Jump Start Your Test Automation

Sauce Labs Webinar: Rising Importance of Software Testing

BDD With Selenide by Hima Bindu Peteti

Closer To the Metal - Why and How We Use XCTest and Espresso by Mario Negro P...

Continuous Delivery for "Mature" Codebases by Melisa Benua

Último

%in Harare+277-882-255-28 abortion pills for sale in Harare

masabamasaba

VTU technical seminar 8Th Sem on Scikit-learn

AmarnathKambale

Craft an AI & Machine Learning Pitch with our Editable Professional PowerPoint Template. Ignite your AI & Machine Learning pitch with our cutting-edge PowerPoint template tailored for the industry. Perfect for AI conferences, investor presentations, sales pitches to tech-focused companies, training sessions, and educational programs. - 20+ editable slides: Get a variety of options to choose from for your presentation. - Time-saving solution: Download, replace text/images with a few clicks. - User-friendly customization: Easy to use and personalize. - Modern and attractive design: Captivating visuals, sleek layout. - Tailored to your requirements: Fully alterable for customization. - Well-organized slides: Complete control over content. - Thematic specificity: Reflects healthcare industry with relevant graphics. - Showcase your business idea: Communicate value proposition effectively.

AI & Machine Learning Presentation Template

Presentation.STUDIO

We specialize in Psychic Readings, Psychic Love Spells, Binding Love Spells, Obsession Spells, Voodoo Spells, Lottery Spells, Marriage Spells, Black Magic Spells, Palm Readings & much more. Are you depressed? We perform this come-to-me love spell that works instantly with the aim of Winnipeg back the victim to the person performing the magic. Have you lost your lover? We perform this come-to-me love spell that works instantly with the aim of bringing back the victim to the person performing the magic. Have you lost your lover? Do u need to solve any relationship problem? Contact the powerful spells caster chief kule with love spells that work overnight and love spells that really work. Have you found yourself infatuated with a special someone you think could be the one? Are you looking for a spell to provide them with a nudge in the right direction? Or maybe the spell you cast didn’t achieve the results you were hoping for? Whether you’re new or versed in the ways of spell casting, we’re here to help. Today we’re going to provide you with a detailed guide on the types of love spells to cast. Not only that but there’s something for those who wish to find outside advice from more advanced spell casters. We’re also going to provide you with the top sites available to help you with your dilemma. Let’s begin our journey by educating ourselves on love magic and what a real love caster looks like. Love Magic and Love Casters Love magic made its first appearance back in Ancient Egypt and has been an active practice since. This type of magic is a branch of traditional magic and can be practiced in various ways. Typically the more common use of love magic is through the work of spells, but other methods look like Charms Rituals-LOVE Potions-Dolls and even Amulets If you are interested in becoming a love caster, be prepared for what’s to come. A genuine love caster knows that the art of love casting is no easy feat and shouldn’t be done casually. You should know that not only does it require you to be gifted spiritually, but you must be ready to serve others. Someone who is considered a real love caster has experience in all manner of spells, no matter the difficulty. Training yourself in attraction, commitment, and marriage spells is an excellent place to start. But this by no means will make you a professional. Practice your craft and expand your knowledge; understand that you will possess the ability to help others in time truly. Types of Love Spells What better way to start broadening your experiences with love spells than by learning more about them? These spells work like just about any other spell. Simply apply your intention, use a medium (sigils, mantras, candles, or charm bags), and top it off with establishing the belief that you will receive what you want. So what kind of spells are available and which ones suit your needs the best? Let’s take a look at the many options you have at your disposal. Attraction Spells

%+27788225528 love spells in Knoxville Psychic Readings, Attraction spells,Br...

masabamasaba

%in kaalfontein+277-882-255-28 abortion pills for sale in kaalfontein

masabamasaba

This presentation covers the following topics: What is logging? The purpose of logging: Debugging The purpose of logging: Security The purpose of logging: Stats & analytics Traditional logging Traditional logging: Advantages Traditional logging: Disadvantages The solution: Large-scale logging Large-scale logging: Core principles Large-scale logging: Solution types Large-scale logging: Cloud vs on-prem Large-scale logging: Operational complexity Large-scale logging: Security Large-scale logging: Costs Large-scale logging: On-prem comparison - Elasticsearch - Grafana Loki - VictoriaLogs On-prem comparison: Setup and operation On-prem comparison: Costs On-prem comparison: Full-text search support On-prem comparison: How to efficiently query 100TB of logs? On-prem comparison: Integration with CLI tools VictoriaLogs for large-scale logging VictoriaLogs demo instance - Ingestion rate: 3600 messages / minute - The number of log messages: 1.1 billion - Uncompressed log messages’ size: 1.5TB - Compressed log messages’ size: 23GB - Compression ratio: 47x - Memory usage: 150MB VictoriaLogs CLI integration demo - Which errors have occurred in all the apps during the last hour? - How many errors have occurred during the last hour? - Which apps generated the most of errors during the last hour? - The number of per-minute errors for the last 10 minutes - Status codes for the last hour - Non-200 status codes for the last week - Top client IPs for the last 4 weeks with 404 and 500 response status codes - Per-month stats for the given IP across all the logs Large-scale logging solution MUST provide excellent CLI integration VictoriaLogs: (temporary) drawbacks VictoriaLogs: Recap - Easy to setup and operate - The lowest RAM usage and disk space usage (up to 30x less than Elasticsearch and Grafana Loki) - Fast full-text search - Excellent integration with traditional command-line tools for log analysis - Accepts logs from popular log shippers (Filebeat, Fluentbit, Logstash, Vector, Promtail, Grafana Agent) - Open source and free to use!

Large-scale Logging Made Easy: Meetup at Deutsche Bank 2024

VictoriaMetrics

MarTech Trend 2024 Book : Marketing Technology Trends (2024 Edition) How Data...

Jittipong Loespradit

We specialize in Psychic Readings, Psychic Love Spells, Binding Love Spells, Obsession Spells, Voodoo Spells, Lottery Spells, Marriage Spells, Black Magic Spells, Palm Readings & much more. Are you depressed? We perform this come-to-me love spell that works instantly with the aim of bringing back the victim to the person performing the magic. Have you lost your lover? We perform this come-to-me love spell that works instantly with the aim of bringing back the victim to the person performing the magic. Have you lost your lover? Do u need to solve any relationship problem? Contact the powerful spells caster chief kule with love spells that work overnight and love spells that really work. Have you found yourself infatuated with a special someone you think could be the one? Are you looking for a spell to provide them with a nudge in the right direction? Or maybe the spell you cast didn’t achieve the results you were hoping for? Whether you’re new or versed in the ways of spell casting, we’re here to help. Today we’re going to provide you with a detailed guide on the types of love spells to cast. Not only that but there’s something for those who wish to find outside advice from more advanced spell casters. We’re also going to provide you with the top sites available to help you with your dilemma. Let’s begin our journey by educating ourselves on love magic and what a real love caster looks like. Love Magic and Love Casters Love magic made its first appearance back in Ancient Egypt and has been an active practice since. This type of magic is a branch of traditional magic and can be practiced in various ways. Typically the more common use of love magic is through the work of spells, but other methods look like Charms Rituals-LOVE Potions-Dolls and even Amulets If you are interested in becoming a love caster, be prepared for what’s to come. A genuine love caster knows that the art of love casting is no easy feat and shouldn’t be done casually. You should know that not only does it require you to be gifted spiritually, but you must be ready to serve others. Someone who is considered a real love caster has experience in all manner of spells, no matter the difficulty. Training yourself in attraction, commitment, and marriage spells is an excellent place to start. But this by no means will make you a professional. Practice your craft and expand your knowledge; understand that you will possess the ability to help others in time truly. Types of Love Spells What better way to start broadening your experiences with love spells than by learning more about them? These spells work like just about any other spell. Simply apply your intention, use a medium (sigils, mantras, candles, or charm bags), and top it off with establishing the belief that you will receive what you want. So what kind of spells are available and which ones suit your needs the best? Let’s take a look at the many options you have at your disposal.

%+27788225528 love spells in new york Psychic Readings, Attraction spells,Bri...

masabamasaba

Crypto Cloud Review - How To Earn Up To $500 Per DAY Of Bitcoin 100% On AutoP...

SelfMade bd

%in ivory park+277-882-255-28 abortion pills for sale in ivory park

masabamasaba

Devoxx UK 2024 - Going serverless with Quarkus, GraalVM native images and AWS...

Bert Jan Schrijver

Data spaces in distributed environments should be allowed to evolve in agile ways providing data space owners with large flexibility about which data they store. Agility and heterogeneity, however, jeopardize data exchanges because representations may build on varying ontologies and data consumers may not rely on the semantic correctness of their queries in the context of semantically heterogeneous, evolving data spaces. Graph data spaces are one example of a powerful model for representing and querying data whose semantics may change over time. To assert and enforce conditions on individual graph data spaces, shape languages (e.g SHACL) have been developed. We investigate the question of how querying and programming can be guarded by reasoning over SHACL constraints in a distributed setting and we sketch a picture of how a future landscape based on semantically heterogeneous data spaces might look like.

Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...

Steffen Staab

Investing in AI transformation today The modern business advantage: Uncovering deep insights with AI Organizations around the world have come to recognize AI as the transformative technology that enables them to gain real business advantage. AI’s ability to organize vast quantities of data allows those who implement it to uncover deep business insights, augment human expertise, drive operational efficiency, transform their products, and better serve their customers

Microsoft AI Transformation Partner Playbook.pdf

Willy Marroquin (WillyDevNET)

The title is not connected to what is inside

shinachiaurasa2

%in kempton park+277-882-255-28 abortion pills for sale in kempton park

masabamasaba

The fast-paced world of Agile development just got a turbo boost! Dive into this engaging talk on "Innovation at Speed: ChatGPT & the AI Transformation in Agile Development." Over the last few months, AI, including notable tools like Google Bard and Microsoft Co-Pilot, has been leveraged to supercharge Agile workflows. In this session, attendees will get an overview of the current AI landscape and its impact on development. They will learn why AI is the game-changer needed to embrace in the Agile lifecycle, offering that elusive X factor to multiply productivity. Real-world examples will be presented, and the challenges of implementing AI tools like ChatGPT within corporate environments will be discussed.

Harnessing ChatGPT - Elevating Productivity in Today's Agile Environment

VictorSzoltysek

ADR, or Architecture Decision Record, is a valuable tool in software development for several reasons. It provides a centralized location for documenting and tracking architectural decisions, aiding both current and future team members. ADRs enhance communication among team members by documenting the rationale behind architectural decisions, especially beneficial during onboarding of new team members or when revisiting decisions. They serve as a knowledge base, enabling teams to learn from past decisions and refine their decision-making process. Additionally, ADRs contribute to transparency by helping stakeholders understand the reasons behind specific architectural choices. As with any other tool or process, introducing them into an organization can face several obstacles, and overcoming these challenges is crucial for successful implementation. In this talk I go through some common problems and our way of solving them.

Architecture decision records - How not to get lost in the past

Papp Krisztián

tonesoftg

lanshi9

(Vivek)Call Us, 8448380779,Call girls in Delhi NCr – We Offer best in class call girls. escort Service At Affordable Price At low Rate with Space Night 8000 We Are One Of The Oldest Escort and Call girls Agencies in Delhi. You Will Find That Our Female Escorts Are Full Of Fun, Sexy And They Would Love Enjoy Your Company. We Have A Fantastic Selection Of Escort Ladies Available For In-Calls As Well As Out-Calls. Our Escorts Are Not Only Beautiful But All Have Great Personalities Making Them The Perfect Companion For Any Occasion. In-Call:- You Can Come At Our Place in Delhi Our place Which Is Very Clean Hygienic 100% safe Accommodation. Out-Call:- You have To Come Pick The Girl From My Place We Are Also Provide Door Step Services (Delhi Ncr, Noida, Gurgaon, Faridabad, Ghaziabad Note:- Pic Collectors Time Passers Bargainers Stay Away As We Respect The Value For Your Money Time And Expect The Same From You Hygienic:- Full Ac room And Clean Rooms Available In Hotel 24 * 7 Hourly In Delhi NCR More Details, With WhatsApp Number, +91-8448380779

call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️

Delhi Call girls

+971565801893 Mtp-Kit (500MG) Prices » Dubai [(+971565801893**)] Abortion Pills For Sale In Dubai, UAE, Mifepristone and Misoprostol Tablets Available In Dubai, UAE CONTACT DR.Leen Whatsapp +971565801893 We Have Abortion Pills / Cytotec Tablets /Mifegest Kit Available in Dubai, Sharjah, Abudhabi, Ajman, Alain, Fujairah, Ras Al Khaimah, Umm Al Quwain, UAE, Buy cytotec in Dubai +971565801893''''Abortion Pills near me DUBAI | ABU DHABI|UAE. Price of Misoprostol, Cytotec” +971565801893' Dr.DEEM ''BUY ABORTION PILLS MIFEGEST KIT, MISOPROTONE, CYTOTEC PILLS IN DUBAI, ABU DHABI,UAE'' Contact me now via What's App…… abortion Pills Cytotec also available Oman Qatar Doha Saudi Arabia Bahrain Above all, Cytotec Abortion Pills are Available In Dubai / UAE, you will be very happy to do abortion in Dubai we are providing cytotec 200mg abortion pill in Dubai, UAE. Medication abortion offers an alternative to Surgical Abortion for women in the early weeks of pregnancy. We only offer abortion pills from 1 week-6 Months. We then advise you to use surgery if its beyond 6 months. Our Abu Dhabi, Ajman, Al Ain, Dubai, Fujairah, Ras Al Khaimah (RAK), Sharjah, Umm Al Quwain (UAQ) United Arab Emirates Abortion Clinic provides the safest and most advanced techniques for providing non-surgical, medical and surgical abortion methods for early through late second trimester, including the Abortion By Pill Procedure (RU 486, Mifeprex, Mifepristone, early options French Abortion Pill), Tamoxifen, Methotrexate and Cytotec (Misoprostol). The Abu Dhabi, United Arab Emirates Abortion Clinic performs Same Day Abortion Procedure using medications that are taken on the first day of the office visit and will cause the abortion to occur generally within 4 to 6 hours (as early as 30 minutes) for patients who are 3 to 12 weeks pregnant. When Mifepristone and Misoprostol are used, 50% of patients complete in 4 to 6 hours; 75% to 80% in 12 hours; and 90% in 24 hours. We use a regimen that allows for completion without the need for surgery 99% of the time. All advanced second trimester and late term pregnancies at our Tampa clinic (17 to 24 weeks or greater) can be completed within 24 hours or less 99% of the time without the need surgery. The procedure is completed with minimal to no complications. Our Women's Health Center located in Abu Dhabi, United Arab Emirates, uses the latest medications for medical abortions (RU-486, Mifeprex, Mifegyne, Mifepristone, early options French abortion pill), Methotrexate and Cytotec (Misoprostol). The safety standards of our Abu Dhabi, United Arab Emirates Abortion Doctors remain unparalleled. They consistently maintain the lowest complication rates throughout the nation. Our Physicians and staff are always available to answer questions and care for women in one of the most difficult times in their lives. The decision to have an abortion at the Abortion Clinic in Abu Dhabi, United Arab Emirates.+971565801893

+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...

Health

Wait, That's Not Right by Troy Walsh

1. Wait, That’s Not Right! AKA - Failing better Troy Walsh 04.25.19

2. 2

3. 3 Effective Test Data Management » Sufficient » Representative » Reproducible » Automated » Deterministic? » *Legal/ethical/safe » Credible

4. 4 » Collaboration › QA › Dev › Operations » *Tools › Informatica - Test Data Management › CA - Datamaker › Compuware - Test Data Management › IBM - InfoSphere Optim Test Data Management › Many many more What Does It Take

5. 5

6. 6 » Is it a bug › “Works as designed” › “Cannot reproduce” › “Works on my machine” » What caused it › Data › Application › Integrations › Etc. » Is this really the problem › Root cause Challenges

7. 7 » Summary » Context › Browser, OS, Resolution, Time (UTC), user, etc. » Steps to reproduce » Expected results » Actual results » Artifacts › Screenshots, videos, logs, etc. Reporting

8. 8

9. 9 Plan To Fail

10. 10 Logging » Built in logging » Context » Useful messages » Testing artifact

11. 11 Event Logging » Captures interactions » Readable logs » Very powerful

12. 12 » Can be taken at any/multiple times » Multiple formats » *Integrates with many reporting frameworks Screenshots

13. 13 Browser Logs » Script errors » Nonvisible errors » Developer console *Does not work with every browser

14. 14

15. 15 » Videos » Extended debugging » Build server integration Even Better With Sauce

16. 16 Azure DevOps Special Sauce

17. 17 Jenkins Special Sauce

18. 18 » Have a test data management strategy » Write automation as though you expect it to fail » Have logging » Take advantage of advanced logging capabilities › Event firing › Screenshots › Console logs » If you have a service like Sauce Labs, take advantage of it › DevOps integration › Video › Extended debugging Takeaways

19. 19 » https://docs.microsoft.com/en- us/dotnet/api/microsoft.visualstudio.testtools.unittesting.testcontext.writeline?view=mstest-net- 1.3.2#Microsoft_VisualStudio_TestTools_UnitTesting_TestContext_WriteLine_System_String_ » https://docs.microsoft.com/en- us/dotnet/api/microsoft.visualstudio.testtools.unittesting.testcontext.addresultfile?view=mstest-net-1.3.2 » https://testng.org/doc/documentation-main.html#logging » https://github.com/SeleniumHQ/selenium/blob/db1c2add0b47d845b7d0d7d67b65cee92d9bb323/ja va/client/test/org/openqa/selenium/support/events/EventFiringWebDriverTest.java#L161 » https://github.com/SeleniumHQ/selenium/blob/07a18746ff756e90fd79ef253a328bd7dfa9e6dc/dotn et/test/support/Events/EventFiringWebDriverTest.cs#L38 » https://wiki.saucelabs.com/display/DOCS/Platform+Configurator#/ » https://wiki.saucelabs.com/display/DOCS/Test+Configuration+Options » https://wiki.saucelabs.com/display/DOCS/Setting+Up+CI+Platform+Integrations+with+Sauce+Plugins » https://github.com/Magenic/MAQS Helpful links

20. 20

21. 877.277.1044 / magenic.com // 21 THANK YOU

Wait, That's Not Right by Troy Walsh

Recomendados

Recomendados

Más contenido relacionado

Similar a Wait, That's Not Right by Troy Walsh

Similar a Wait, That's Not Right by Troy Walsh (20)

Más de Sauce Labs

Más de Sauce Labs (20)

Último

Último (20)

Wait, That's Not Right by Troy Walsh