Why and how to test logging - DevOps Showcase North - Feb 2016 - Matthew Skelton

•

5 recomendaciones•5,364 vistas

Modern log aggregation & search tools provide significant new capabilities for teams building, testing, and running software systems. By treating logging as a core system component, and using techniques such as unique event IDs, transaction tracing, and structured log output, we gain rich insights into application behaviour and health. This talk explains why it is valuable to test aspects of logging and how to do this with modern log aggregation tooling.

Software

Why and how to test logging
DevOps Showcase North / Testing Showcase North
Manchester, UK - Unicom
Thursday 11th February 2015
Matthew Skelton
Skelton Thatcher Consulting

use logging as a
channel/vector to
make distributed
systems more testable

transforming technology
and teams
high impact expertise
Cloud, Agile, DevOps

Why we should test logging
How to test logging effectively

exceptional situations
edge cases
metrics
analytics
‘audits’
…
@evanphx

reduce time-to-detect
increase team engagement
increase configurability
enhance DevOps collaboration
#operability

(event sourcing)
(structured logging)
(CQRS)

using logging mainly for errors
inconsistent use of logging
“logging slows things down”

“logging pollutes my domain model”
“logging is just for Ops people”
log aggregation only in Production

logging assumed to be free
($0) to implement
logs not available to Tester or
Developers

distinct event IDs
transaction tracing
instrumentation
log aggregation & search

cross-component visibility
increased test coverage
programmatic assertions
deep insights

How many distinct event
types (state transitions) in
your application?

enum
Human-readable sets:
unique values, sparse, immutable
C#, Java, Python, node
(Ruby, PHP, …)

public enum EventID
{
// Badly-initialised logging data
NotSet = 0,
// An unrecognised event has occurred
UnexpectedError = 10000,
ApplicationStarted = 20000,
ApplicationShutdownNoticeReceived = 20001,
PageGenerationStarted = 30000,
PageGenerationCompleted = 30001,
MessageQueued = 40000,
MessagePeeked = 40001,
BasketItemAdded = 60001,
BasketItemRemoved = 60002,
CreditCardDetailsSubmitted = 70001,
// ...
}

Technical
Domain
public enum EventID
{
// Badly-initialised logging data
NotSet = 0,
// An unrecognised event has occurred
UnexpectedError = 10000,
ApplicationStarted = 20000,
ApplicationShutdownNoticeReceived = 20001,
PageGenerationStarted = 30000,
PageGenerationCompleted = 30001,
MessageQueued = 40000,
MessagePeeked = 40001,
BasketItemAdded = 60001,
BasketItemRemoved = 60002,
CreditCardDetailsSubmitted = 70001,
// ...
}

BasketItemAdded = 60001
BasketItemRemoved = 60002

Monolith to microservices:
debugger does not have the full view

Even with remote debugger, it’s
boring to attach and detach

‘Unique-ish’ identifier for each request
Passed through downstream layers

Web App
Doc store
Audit service
Msg queue

Transactional
sub-system
Log aggregation
sub-system

An action here… …results in log entry here

trace events in a
distributed,
asynchronous system

AuditRecordCreated
Search: AuditRecordCreated

Feature: User trades stocks
Scenario: User requests a sell before close of trading
Given I have 100 shares of MSFT stock
And I have 150 shares of APPL stock
And the time is before close of trading
When I ask to sell 20 shares of MSFT stock
Then I should have 80 shares of MSFT stock
And I should have 150 shares of APPL stock
And a sell order for 20 shares of MSFT stock should have been executed
http://martinfowler.com/bliki/GivenWhenThen.html - Pete Hodgson

Given I run a scenario as a Lawyer
And I create a document
[And I wait 5 seconds]
When I search the logs API
Then I should find a recent entry
for “AuditRecordCreated”

unique-ish event type IDs
transaction tracing
log aggregation & search
Stories: expected search results

‘Structured Logging’
TW: “Adopt” (May 2015)
https://www.thoughtworks.com/radar/techniques/structured-logging
http://gregoryszorc.com/
.NET: http://serilog.net/
Java: https://github.com/fluent/fluent-logger-java

More
Ditch the Debugger and Use Log
Analysis Instead
Matthew Skelton
https://blog.logentries.com/2015/07/ditch-
the-debugger-and-use-log-analysis-instead/

Thank you
http://skeltonthatcher.com/
enquiries@skeltonthatcher.com
@SkeltonThatcher
+44 (0)20 8242 4103
@matthewpskelton

Más contenido relacionado

La actualidad más candente

Template Plano de disponibilidade dos serviços

Fernando Palma

The field of AIOps, also known as Artificial Intelligence for IT Operations, uses advanced technologies to dramatically improve the monitoring, operation, and troubleshooting of distributed systems. Its main premise is that operations can be automated using monitoring data to reduce the workload of operators (e.g., SREs or production engineers). Our current research explores how AIOps – and many related fields such as deep learning, machine learning, distributed traces, graph analysis, time-series analysis, sequence analysis, advanced statistics, NLP and log analysis – can be explored to effectively detect, localize, predict, and remediate failures in large-scale cloud infrastructures (>50 regions and AZs) by analyzing service management data (e.g., distributed traces, logs, events, alerts, metrics). In particular, this talk will describe how a particular monitoring data structure, called distributed traces, can be analyzed using deep learning to identify anomalies in its spans. This capability empowers operators to quickly identify which components of a distributed system are faulty.

Distributed Trace & Log Analysis using ML

Jorge Cardoso

Incident Mgmt Process Guideand Standards

Edward Paul Pagsanhan

ITIL Practical Guide - Service Operation

Axios Systems

What's up with the Immersive Industry?!

Chaitanya Chinchlikar

MSC Digital transformation with Axway API Management products and SmartWave S...

SmartWave

Artificial Intelligence for IT Operations (AIOps) is a class of software which targets the automation of operational tasks through machine learning technologies. ML algorithms are typically used to support tasks such as anomaly detection, root-causes analysis, failure prevention, failure prediction, and system remediation. AIOps is gaining an increasing interest from the industry due to the exponential growth of IT operations and the complexity of new technology. Modern applications are assembled from hundreds of dependent microservices distributed across many cloud platforms, leading to extremely complex software systems. Studies show that cloud environments are now too complex to be managed solely by humans. This talk discusses various AIOps problems we have addressed over the years and gives a sketch of the solutions and algorithms we have implemented. Interesting problems include hypervisor anomaly detection, root-cause analysis of software service failures using application logs, multi-modal anomaly detection, root-cause analysis using distributed traces, and verification of virtual private cloud networks.

On the Application of AI for Failure Management: Problems, Solutions and Algo...

Jorge Cardoso

Dynatrace

Purnima Kurella

Chaos Engineering with Gremlin Platform

Anshul Patel

Tutorial at IEEE IM 2019. The tutorial will provide a comprehensive coverage of the Network Automation domain starting with the scope and definitions, introducing the challenges and then developing the different approaches to realize complete future network automation solutions. A special focus will be put on the newly created ETSI ISG ZSM "Zero Touch Network and Service Management" and the standardization landscape.

Next Generation Network Automation

Laurent Ciavaglia

Au cœur de la sécurité des systèmes d'information, la gestion et le contrôle des identités et des accès est devenu une des préoccupations majeures pour les directeurs des systèmes d'information. La vitesse avec laquelle l'entreprise doit s'adapter (fusions, acquisitions, repositionnements sur le cœur de métier, consolidations, externalisations, ...) sur un marché mondial hyperconcurrentiel a imposé le décloisonnement des systèmes d'information. Pour l'entreprise étendue, les services en réseau ou services web ouvrent la voie à une nouvelle forme d’urbanisation des systèmes d'information capable d'accompagner cette évolution frénétique (Voir l'entreprise en réseau s'expose) . La gestion des identités des acteurs internes comme externes de cette nouvelle architecture orientée service (SOA) est alors un enjeu majeur, pas uniquement sécuritaire mais aussi organisationnel.

LES SYSTEMES DE GESTION DES IDENTITES ET DES ACCES : MISE EN ŒUVRE ET APPORT ...

Danny Batomen Yanga

One of the largest Airline in the world chose Dynatrace, here is the customer case. Including: Vision and Goal / Challenges / Requirements / Why Dynatrace is Unique / ROI and TCO / Rollout Status / Solution Screenshots Dynatrace redefined monitoring with AI powered 3rd Generation APM, User Experience Monitoring & Continuous Improvement, Cloud-native, Full Stack, Auto Everything, End-to-End, Easiest to Implement, Use and Maintain

Customer case - Dynatrace Monitoring Redefined

Michel Duruel

MLOps (a compound of “machine learning” and “operations”) is a practice for collaboration and communication between data scientists and operations professionals to help manage the production machine learning lifecycle. Similar to the DevOps term in the software development world, MLOps looks to increase automation and improve the quality of production ML while also focusing on business and regulatory requirements. MLOps applies to the entire ML lifecycle - from integrating with model generation (software development lifecycle, continuous integration/continuous delivery), orchestration, and deployment, to health, diagnostics, governance, and business metrics. To watch the full presentation click here: https://info.cnvrg.io/mlopsformachinelearning In this webinar, we’ll discuss core practices in MLOps that will help data science teams scale to the enterprise level. You’ll learn the primary functions of MLOps, and what tasks are suggested to accelerate your teams machine learning pipeline. Join us in a discussion with cnvrg.io Solutions Architect, Aaron Schneider, and learn how teams use MLOps for more productive machine learning workflows. - Reduce friction between science and engineering - Deploy your models to production faster - Health, diagnostics and governance of ML models - Kubernetes as a core platform for MLOps - Support advanced use-cases like continual learning with MLOps

MLOps for production-level machine learning

cnvrg.io AI OS - Hands-on ML Workshops

Spring Web Flow

NexThoughts Technologies

Meraki Solution Overview

Claudiu Sandor

L’hypervision des Services - Présentation au BMC Exchange Paris 2014 par Jea...

Devoteam

Meeting the demands of everchanging IT management and security requirements means evolving both how you respond to and resolve incidents. It’s critical for organizations to adopt a scalable DevOps solution that integrates with their current monitoring systems to enable collaboration across development and operations teams, reducing the mean time to resolution. PagerDuty works with AWS services like Amazon CloudWatch, to provide rapid incident response with rich, contextual details that allow you to analyze trends and monitor the performance of your applications and AWS environment.

DevOps at Scale: How Datadog is using AWS and PagerDuty to Keep Pace with Gr...

Amazon Web Services

Cloud Monitoring with Prometheus

QAware GmbH

Last year in May, where we could do what we liked and Covid19 was not even a word, the itSMF organized an event to review ITIL4 and how it positioned itself in the agile service management world. For those who joined, I said that all the information shared was based on the ITIL4 foundation input. Since then, a lot has happened. Also in the world of ITIL4. Axelos released 4 more specialist and strategist titles and 35 practice titles. It gave the possibility to revisit the initial understanding, challenge it and extending it to the level I am at today. I also said that when time is right, I would share my insights. So if you want that in depth review of how Axelos has reinvented ITIL and how for me, this evolution of ITIL is as disruptive as the market we are in today, mark in your agenda : 26th of November from 17:30 until 19:00 What can you expect from this indepth session on ITIL4? We will start off with a short recap of the foundation, so even people not really familiar with the basic ins and outs can follow the session. After that introduction, the 4 core volumes added as part of the managing professional will be reviewed and connected to the ITIL4 operating model. We will investigate how each of the volumes adds tools and guidance, allowing a service driven organisation to become the best version of itself. Personally it has been a discovery journey which took and still takes time to grasp the potential. I hope that by the end of the session, some of the insights might be of use in your own service management evolution journey. Eddy Peters

ITIL4 – 26.11.2020

itSMF Belgium

Monitoring Solutions for APIs

Apigee | Google Cloud

La actualidad más candente (20)

Template Plano de disponibilidade dos serviços

Distributed Trace & Log Analysis using ML

Incident Mgmt Process Guideand Standards

ITIL Practical Guide - Service Operation

What's up with the Immersive Industry?!

MSC Digital transformation with Axway API Management products and SmartWave S...

On the Application of AI for Failure Management: Problems, Solutions and Algo...

Dynatrace

Chaos Engineering with Gremlin Platform

Next Generation Network Automation

LES SYSTEMES DE GESTION DES IDENTITES ET DES ACCES : MISE EN ŒUVRE ET APPORT ...

Customer case - Dynatrace Monitoring Redefined

MLOps for production-level machine learning

Spring Web Flow

Meraki Solution Overview

L’hypervision des Services - Présentation au BMC Exchange Paris 2014 par Jea...

DevOps at Scale: How Datadog is using AWS and PagerDuty to Keep Pace with Gr...

Cloud Monitoring with Prometheus

ITIL4 – 26.11.2020

Monitoring Solutions for APIs

Similar a Why and how to test logging - DevOps Showcase North - Feb 2016 - Matthew Skelton

We all like building and deploying cloud applications. But what happens once that’s done? How do we know if our application behaves like we expect it to behave? Of course, logging! But how do we get that data off of our machines? How do we sift through a bunch of seemingly meaningless diagnostics? In this session, we’ll look at how we can keep track of our Azure application using structured logging, AppInsights and AppInsights analytics to make all that data more meaningful.

What is going on? Application Diagnostics on Azure - Copenhagen .NET User Group

Maarten Balliauw

Watch this Tech Talk: https://do.co/video_dworth Dave Worth, Engineering Manager at Strava, lays out a strategy for choosing the right tech stack depending on your business and team need. Watch as he guides you through tool sets that navigate around business constraints and regulatory concerns. About the Presenter Dave Worth’s professional life consists of being a web and backend engineer who developed specialization in observability through building reliable distributed systems at Strava, and previously DigitalOcean. In his spare time, Dave loves cycling, jiu jitsu, and searching for another great math book to only read the first 50 pages of. New to DigitalOcean? Get US $100 in credit when you sign up: https://do.co/deploytoday To learn more about DigitalOcean: https://www.digitalocean.com/ Follow us on Twitter: https://twitter.com/digitalocean Like us on Facebook: https://www.facebook.com/DigitalOcean Follow us on Instagram: https://www.instagram.com/thedigitalocean/ We're hiring: http://do.co/careers

Building an Observability Platform in 389 Difficult Steps

DigitalOcean

In this talk, Matthew Skelton (Skelton Thatcher Consulting) explores five practical, tried-and-tested, real-world techniques for improving operability with many kinds of software systems, including cloud, Serverless, on-premise, and IoT. Logging as a live diagnostics vector with sparse event IDs Operational checklists and 'run book dialogue sheets' as a discovery mechanism for teams Endpoint healthchecks as a way to assess runtime dependencies and complexity Correlation IDs beyond simple HTTP calls Lightweight 'User Personas' as drivers for operational dashboards These techniques work very differently with different technologies. For instance, an IoT device has limited storage, processing, and I/O, so generation and shipping of logs and metrics looks very different from the cloud or 'serverless' case. However, the principles - logging as a live diagnostics vector, event IDs for discovery, etc - work remarkably well across very different technologies. From a talk at Agile in the City Bristol 2017 http://agileinthecity.net/2017/bristol/sessions/index.php?session=44

Practical operability techniques for teams - Matthew Skelton - Agile in the C...

Skelton Thatcher Consulting Ltd

Holistic application health monitoring, request tracing across distributed systems, instrumentation, business process SLAs - all of them are integral parts of today’s technical stacks. Nevertheless many teams decide to integrate observability last which makes it an almost impossible challenge - especially if you have to deal with hundreds and thousands of services. Therefore starting early is essential and in this talk we are going to see how we can solve those challenges early and explore the foundations of building and evolving complex microservices platforms in respect to observability. We are going to share some of the best practices and quick wins that allow us to correlate different telemetry systems and gradually build up towards more sophisticated use-cases. We are also going to look at some of the standard AWS services such as X-Ray and Cloudwatch that help us get going "for free" and then discuss more complex tooling and integrations building up towards a fully integrated ecosystem. As part of this talk we are also going to share some of the learnings we have made at Sixt on this topic and we are going to introduce some of the solutions that help us operate our microservices stack

Observability foundations in dynamically evolving architectures

Boyan Dimitrov

Presented at the Global Integration Bootcamp 2021 As developers, we tend to focus on building and shipping our services and apps to production, but it’s quite common that we forget to think about what happens after go-live. Once we reach production, the solution becomes someone else’s problem. But, even if we could build bug-free services, distributed systems will fail. And if we don’t design and build our services with traceability and observability in mind, we won’t give the means to the operations team to troubleshoot problems when they arise. While Azure Functions provide very rich telemetry with Application Insights; in this session we will see how to implement custom tracing and some observability practices in Azure Functions adding business related metadata, leveraging the structured logging capabilities, and going beyond the out-of-the-box features. In the session, I will demo a distributed tracing approach for Azure Functions that works well in integration solutions following the Publish-Subscribe integration pattern.

Custom Distributed Tracing in Azure Functions (2021-02-27)

Paco de la Cruz

A guide through the Azure Messaging services - Update Conference

Eldert Grootenboer

20 Simple Questions from Exactpro for Your Enjoyment This Holiday Season

Iosif Itkin

What is going on - Application diagnostics on Azure - TechDays Finland

Maarten Balliauw

Semantic logging with etw and slab from DCC 10/16

Chris Holwerda

With microservices and containers becoming mainstream, container orchestrators provide much of what the cluster (nodes and containers) needs. With container orchestrators' core focus on scheduling, discovery, and health at an infrastructure level, microservices are left with unmet, service-level needs, such as: - Traffic management, routing, and resilient and secure communication between services - Policy enforcement, rate-limiting, circuit breaking - Visibility and monitoring with metrics, logs, and traces - Load balancing and rollout/canary deployment support Service meshes provide for these needs. In this session, we will dive into Istio - its components, capabilities, and extensibility. Istio envelops and integrates with other open source projects to deliver a full-service mesh. We'll explore these integrations and Istio's extensibility in terms of choice of proxies and adapters, such as nginMesh.

Istio: Using nginMesh as the service proxy

Lee Calcote

Go Observability (in practice)

Eran Levy

Over the past decade, usage of online applications is experiencing remarkable growth. One of the main reasons for the success of web application is its “Ease of Access” and availability on internet. The simplicity of the HTTP protocol makes it easy to steal and spoof identity. The business liability associated with protecting online information has increased significantly and this is an issue that must be addressed. According to SANSTop20, 2013 list the number one targeted server side vulnerability are Web Applications. So, this has made detecting and preventing attacks on web applications a top priority for IT companies. In this paper, a rational solution is brought to detect events on web application and provides Security intelligence, log management and extensible reporting by analyzing web server logs.

Big Data Security Analytic Solution using Splunk

IJERA Editor

The site was slow. CPU and memory usage everywhere! Some dead objects in the corner. Something terrible must have happened! We have some IIS logs. Some traces from a witness. But not enough to find out what was wrong. In this session, we’ll see how effective telemetry, a profiler or two as well as a refresher of how IIS runs our ASP.NET web applications can help solve this server murder mystery.

Sherlock Homepage (Maarten Balliauw)

Visug

Sherlock Homepage - A detective story about running large web services (VISUG...

Maarten Balliauw

Have you ever imagined what it would be like to build a massively scalable streaming application on Kafka, the challenges, the patterns and the thought process involved? How much of the application can be reused? What patterns will you discover? How does it all fit together? Depending upon your use case and business, this can mean many things. Starting out with a data pipeline is one thing, but evolving into a company-wide real-time application that is business critical and entirely dependent upon a streaming platform is a giant leap. Large-scale streaming applications are also called event streaming applications. They are classically different from other data systems; event streaming applications are viewed as a series of interconnected streams that are topologically defined using stream processors; they hold state that models your use case as events. Almost like a deconstructed realtime database. In this talk, I step through the origins of event streaming systems, understanding how they are developed from raw events to evolve into something that can be adopted at an organizational scale. I start with event-first thinking, Domain Driven Design to build data models that work with the fundamentals of Streams, Kafka Streams, KSQL and Serverless (FaaS). Building upon this, I explain how to build common business functionality by stepping through patterns for Scalable payment processing Run it on rails: Instrumentation and monitoring Control flow patterns (start, stop, pause) Finally, all of these concepts are combined in a solution architecture that can be used at enterprise scale. I will introduce enterprise patterns such as events-as-a-backbone, events as APIs and methods for governance and self-service. You will leave talk with an understanding of how to model events with event-first thinking, how to work towards reusable streaming patterns and most importantly, how it all fits together at scale.

Kafka summit SF 2019 - the art of the event-streaming app

Neil Avery

Have you ever imagined what it would be like to build a massively scalable streaming application on Kafka, the challenges, the patterns and the thought process involved? How much of the application can be reused? What patterns will you discover? How does it all fit together? Depending upon your use case and business, this can mean many things. Starting out with a data pipeline is one thing, but evolving into a company-wide real-time application that is business critical and entirely dependent upon a streaming platform is a giant leap. Large-scale streaming applications are also called event streaming applications. They are classically different from other data systems; event streaming applications are viewed as a series of interconnected streams that are topologically defined using stream processors; they hold state that models your use case as events. Almost like a deconstructed realtime database. In this talk I step through the origins of event streaming systems, understanding how they are developed from raw events to evolve into something that can be adopted at an organizational scale. I start with event-first thinking, Domain Driven Design to build data models that work with the fundamentals of Streams, Kafka Streams, KSQL and Serverless (FaaS). Building upon this, I explain how to build common business functionality by stepping through patterns for Scalable payment processing Run it on rails: Instrumentation and monitoring Control flow patterns (start, stop, pause) Finally, all of these concepts are combined in a solution architecture that can be used at enterprise scale. I will introduce enterprise patterns such as events-as-a-backbone, events as APIs and methods for governance and self-service. You will leave talk with an understanding of how to model events with event-first thinking, how to work towards reusable streaming patterns and most importantly, how it all fits together at scale.

The art of the event streaming application: streams, stream processors and sc...

confluent

Combining logs, metrics, and traces for unified observability

Elasticsearch

Talk at TechUG day in Leeds on 22nd October 2015 The way in which many (most?) software teams use logging needs a re-think as we move into a world of microservices and remote sensors. Instead of using logging merely to dump out stack traces, our logs become a continuous trace of application state, with unique-enough identifiers for every interesting point of execution. We also use transaction identifiers to trace calls across components, services, and queues, so that we can reconstruct distributed calls after the fact. Logging becomes a rich source of insight for developers and operations people alike, as we 'listen to the logs' and tighten feedback cycles to improve our software systems.

Un-broken Logging - TechnologyUG - Leeds - Matthew Skelton

Skelton Thatcher Consulting Ltd

## Introducing a reactive Scala-Akka based system in a Java centric company

Milan Aleksić

As a Developer, you cannot attach the debugger to your application in Production, but you *can* use logging in a way which means you can diagnose problems very easily in both development AND Production. You also get to make friends with Operations people - win! In this tutorial, we'll show you how to get up and running with ELK (Elastic Search, LogStash, Kibana) with Vagrant on your developer machine for awesome logging-fu. Warning: may contain DevOps.

How to ditch the debugger and use logging instead - devwinter 2015

Skelton Thatcher Consulting Ltd

Similar a Why and how to test logging - DevOps Showcase North - Feb 2016 - Matthew Skelton (20)

What is going on? Application Diagnostics on Azure - Copenhagen .NET User Group

Building an Observability Platform in 389 Difficult Steps

Practical operability techniques for teams - Matthew Skelton - Agile in the C...

Observability foundations in dynamically evolving architectures

Custom Distributed Tracing in Azure Functions (2021-02-27)

A guide through the Azure Messaging services - Update Conference

20 Simple Questions from Exactpro for Your Enjoyment This Holiday Season

What is going on - Application diagnostics on Azure - TechDays Finland

Semantic logging with etw and slab from DCC 10/16

Istio: Using nginMesh as the service proxy

Go Observability (in practice)

Big Data Security Analytic Solution using Splunk

Sherlock Homepage (Maarten Balliauw)

Sherlock Homepage - A detective story about running large web services (VISUG...

Kafka summit SF 2019 - the art of the event-streaming app

The art of the event streaming application: streams, stream processors and sc...

Combining logs, metrics, and traces for unified observability

Un-broken Logging - TechnologyUG - Leeds - Matthew Skelton

## Introducing a reactive Scala-Akka based system in a Java centric company

How to ditch the debugger and use logging instead - devwinter 2015

Más de Skelton Thatcher Consulting Ltd

Modern software systems now increasingly span cloud and on-premises deployments and remote embedded devices and sensors. These distributed systems bring challenges with data, connectivity, performance, and systems management; to ensure success, you must design and build with operability as a first-class property. Matthew Skelton shares five practical, tried-and-tested techniques for improving operability with many kinds of software systems, including the cloud, serverless, on-premises, and the IoT: logging as a live diagnostics vector with sparse event IDs; operational checklists and runbook dialog sheets as a discovery mechanism for teams; endpoint health checks as a way to assess runtime dependencies and complexity; correlation IDs beyond simple HTTP calls; and lightweight user personas as drivers for operational dashboards. These techniques work very differently with different technologies. For instance, an IoT device has limited storage, processing, and I/O, so generating and shipping of logs and metrics looks very different from cloud or serverless cases. However, the principles—logging as a live diagnostics vector, event IDs for discovery, etc.—work remarkably well across very different technologies. Drawing from his experience helping teams improve the operability of their software systems, Matthew explains what works (and what doesn’t) and how teams can expand their understanding and awareness of operability through these straightforward, team-friendly techniques. From a talk given by Matthew Skelton at Velocity Conference EU 2017 - https://conferences.oreilly.com/velocity/vl-eu/public/schedule/detail/61954

Practical operability techniques for distributed systems - Velocity EU 2017

Skelton Thatcher Consulting Ltd

Modern software systems now increasingly span cloud, on-premise, and remote embedded devices & sensors. These distributed systems bring challenges with data, connectivity, performance, and systems management, so for business success we need to design and build with operability as a first class property. In this talk, we explore five practical, tried-and-tested, real world techniques for improving operability with many kinds of software systems, including cloud, Serverless, on-premise, and IoT: - Logging as a live diagnostics vector with sparse Event IDs - Operational checklists and 'Run Book dialogue sheets' as a discovery mechanism for teams - Endpoint healthchecks as a way to assess runtime dependencies and complexity - Correlation IDs beyond simple HTTP calls - Lightweight 'User Personas' as drivers for operational dashboards These techniques work very differently with different technologies. For instance, an IoT device has limited storage, processing, and I/O, so generation and shipping of logs and metrics looks very different from the cloud or Serverless case. However, the principles - logging as a live diagnostics vector, Event IDs for discovery, etc. - work remarkably well across very different technologies.

Practical operability techniques for teams - IPEXPO 2017

Skelton Thatcher Consulting Ltd

Presenters: Matthew Skelton and Rob Thatcher, Skelton Thatcher Consulting Webinar: Operability is all about making software work well in Production. In this webinar, we explore practical, tried-and-tested, real world techniques for improving operability with many kinds of software systems, including cloud, Serverless, on-premise, and IoT: logging with Event IDs, Run Book dialogue sheets, endpoint healthchecks, correlation IDs, and lightweight User Personas. Target audience: Software Developer, Tester, Software Architect, DevOps Engineer, Delivery Manager, Head of Delivery, Head of IT. Benefits: Attendees will gain insights into operability and why this is important for modern software systems, along with practical experience of techniques to enhance operability in almost any software system they encounter.

Practical operability techniques for teams - webinar - Skelton Thatcher & Unicom

Skelton Thatcher Consulting Ltd

Moving from a monolith to microservices can be daunting. How do we choose the right bounded contexts? How small should services be? Which teams should get which services? And how do we keep things from falling apart? By starting with the needs of the team, we can infer some useful heuristics for evolving from a monolithic architecture to a set of more loosely coupled services. Talk given at London DevOps meetup group - June 2017 - https://www.meetup.com/London-DevOps/events/238827763/

Teams and monoliths - Matthew Skelton - London DevOps June 2017

Skelton Thatcher Consulting Ltd

For effective, modern, Cloud-connected software systems we need to organize our teams in certain ways. Taking account of Conway’s Law, we look to match the team structures to the required software architecture, enabling or restricting communication and collaboration for the best outcomes. This talk will cover the basics of organization design, exploring a selection of key team topologies and how and when to use them in order to make the development and operation of your software systems as effective as possible. The talk is based on experience helping companies around the world with the design of their teams. A talk given at JAX DevOps London - April 2017

How and why to design your teams for modern software - JAX DevOps - April 2017

Skelton Thatcher Consulting Ltd

For effective, modern, cloud-connected software systems we need to organize our teams in certain ways. Taking account of Conway’s Law, we look to match the team structures to the required software architecture, enabling or restricting communication and collaboration for the best outcomes. This talk will cover the basics of organization design, exploring a selection of key team topologies and how and when to use them in order to make the development and operation of your software systems as effective as possible. The talk is based on experience helping companies around the world with the design of their teams. In summary, this talk will cover the basics of organization design, exploring a selection of key team topologies and how and when to use them in order to make the development and operation of your software systems as effective as possible. Takeaways: • The implications of Conway’s Law for software teams • Cognitive Load for teams • Effective team topologies • Team evolution

How and why to design your teams for modern software systems - Agile in Leeds...

Skelton Thatcher Consulting Ltd

Tools like GoCD and TeamCity are excellent components of advanced Continuous Delivery deployment systems. They help us focus on deployment pipelines and the flow of changes, rather than "builds" or "environments". We can further enhance these tools by using frameworks like Rancher to manage GoCD and TeamCity as highly available, always-on deployment services. In this talk, we'll see how to use Rancher to run deployment pipeline tooling like GoCD and TeamCity, and how this lets us focus on the important parts of Continuous Delivery: getting changes to Production safely and rapidly.

Using Rancher for highly available deployment services with GoCD and TeamCity

Skelton Thatcher Consulting Ltd

How and why to design your Teams for modern Software Systems - Matthew Skelto...

Skelton Thatcher Consulting Ltd

Teams and monoliths - Matthew Skelton - Velocity EU 2016

Skelton Thatcher Consulting Ltd

Teams and monoliths - Matthew Skelton - Agile in the City Bristol 2016

Skelton Thatcher Consulting Ltd

How to break apart a monolithic system safely without destroying your team Moving from a monolith to microservices can be daunting. How do we choose the right bounded contexts? How small should services be? Which teams should get which services? And how do we keep things from falling apart? By starting with the needs of the team, we can infer some useful heuristics for evolving from a monolithic architecture to a set of more loosely coupled services. Matthew Skelton is co-founder of Skelton Thatcher Consulting / @matthewpskelton

Teams and monoliths - Matthew Skelton - LondonCD 2016

Skelton Thatcher Consulting Ltd

Continuous Delivery techniques and practices are often misunderstood. This session will explore some Continuous Delivery anti-patterns based on work 'in the wild' with a wide range of organisations across different industry sectors: - Believing that "Continuous Delivery is not for us" - Ignoring the database - Thinking that a deployment pipeline is just a series of chained jobs in Jenkins - Not measuring delays between value-add activities - Ignoring Cost-of-Delay and job size - Not funding the build/test/deployment capability properly By avoiding these pitfalls, we can increase the effectiveness of our software delivery efforts. Attendees will learn: 1. Why Continuous Delivery (CD) is useful for almost all modern software 2. How to approach CD for databases 3. How to make CD really 'fly' within the organisation 4. How to 'sell' CD to business stakeholders

Continuous Delivery Anti-patterns from the wild - Matthew Skelton- IPEXPO Europe

Skelton Thatcher Consulting Ltd

Continuous Delivery antipatterns from the wild - Matthew Skelton - IPEXPO Man...

Skelton Thatcher Consulting Ltd

(Talk given at Continuous Lifecycle London 2016) Continuous Delivery techniques and practices are often misunderstood. This session will explore some Continuous Delivery anti-patterns based on work 'in the wild' with a wide range of organisations across different industry sectors: - Believing that "Continuous Delivery is not for us" - Ignoring the database - Thinking that a deployment pipeline is just a series of chained jobs in Jenkins - Not funding the build/test/deployment capability properly - No effective logging or application metrics By avoiding these pitfalls, we can increase the effectiveness of our software delivery efforts.

Continuous Delivery antipatterns from the wild - Matthew Skelton - Continuous...

Skelton Thatcher Consulting Ltd

How to bridge the Dev-DBA chasm - AgileYorkshire - Matthew Skelton

Skelton Thatcher Consulting Ltd

Treating operational aspects of software as 'non-functional requirements' and 'an Ops problem' rather than a core part of the software product leads to poor live service and unexplained errors in Production. Traceability, deployability, recoverability, diagnosability, monitorability, and high quality logging are key features of a software system, along with user-visible features surfaced via the UI, or a capability of an API endpoint. However, many Product Owners understandably feel uneasy about taking on the (necessary) responsibility for prioritising operational features alongside user-visible and API features. This session brings Scrum Masters and Product Owners up to speed on operational features and covers proven practices for improving operability in an Agile context, empowering Product Owners to make effective prioritisation choices about all kinds of product features, whether user-visible or operational.

How to address operational aspects effectively with Agile practices - Matthew...

Skelton Thatcher Consulting Ltd

Long live the DevOps team - LeedsDevOps - 2015-10-22 - Matthew Skelton

Skelton Thatcher Consulting Ltd

Treating operational aspects of software as 'non-functional requirements' and 'an Ops problem' rather than a core part of the software product leads to poor live service and unexplained errors in Production. Deployability, recoverability, diagnosability, monitorability, and high quality logging are simply features of a software system, along with user-visible features surfaced via the UI, or a capability of an API endpoint. However, many Product Managers understandably feel uneasy about taking on the (necessary) responsibility for prioritising operational features alongside user-visible and API features. This session aims to bring Scrum Masters and Product Owners up to speed on operational features, empowering them to make effective prioritisation choices about all kinds of product features, whether user-visible or operational.

Demystifying Operational Features for Product Owners - AgileCam - SkeltonThat...

Skelton Thatcher Consulting Ltd

The way in which many (most?) software teams use logging needs a re-think as we move into a world of microservices and remote sensors. Instead of using logging merely to dump out stack traces, our logs become a continuous trace of application state, with unique-enough identifiers for every interesting point of execution. We also use transaction identifiers to trace calls across components, services, and queues, so that we can reconstruct distributed calls after the fact. Logging becomes a rich source of insight for developers and operations people alike, as we 'listen to the logs' and tighten feedback cycles to improve our software systems.

Un-broken Logging - Operability.io 2015 - Matthew Skelton

Skelton Thatcher Consulting Ltd

What team configuration is right for DevOps to work? Devs doing Ops? Ops doing Dev? Everyone doing a bit of everything, or a special new silo doing Docker and Jenkins in the corner of the room? In this talk, Matthew Skelton and Rob Thatcher joins speculation with practical in-the-trenches experience to arrive at some working 'team topologies' for effective DevOps. Also involves audience participation. And hats :)

Long live the DevOps team - Edinburgh 2015 - Skelton Thatcher

Skelton Thatcher Consulting Ltd

Más de Skelton Thatcher Consulting Ltd (20)

Practical operability techniques for distributed systems - Velocity EU 2017

Practical operability techniques for teams - IPEXPO 2017

Practical operability techniques for teams - webinar - Skelton Thatcher & Unicom

Teams and monoliths - Matthew Skelton - London DevOps June 2017

How and why to design your teams for modern software - JAX DevOps - April 2017

How and why to design your teams for modern software systems - Agile in Leeds...

Using Rancher for highly available deployment services with GoCD and TeamCity

How and why to design your Teams for modern Software Systems - Matthew Skelto...

Teams and monoliths - Matthew Skelton - Velocity EU 2016

Teams and monoliths - Matthew Skelton - Agile in the City Bristol 2016

Teams and monoliths - Matthew Skelton - LondonCD 2016

Continuous Delivery Anti-patterns from the wild - Matthew Skelton- IPEXPO Europe

Continuous Delivery antipatterns from the wild - Matthew Skelton - IPEXPO Man...

Continuous Delivery antipatterns from the wild - Matthew Skelton - Continuous...

How to bridge the Dev-DBA chasm - AgileYorkshire - Matthew Skelton

How to address operational aspects effectively with Agile practices - Matthew...

Long live the DevOps team - LeedsDevOps - 2015-10-22 - Matthew Skelton

Demystifying Operational Features for Product Owners - AgileCam - SkeltonThat...

Un-broken Logging - Operability.io 2015 - Matthew Skelton

Long live the DevOps team - Edinburgh 2015 - Skelton Thatcher

Último

8257 interfacing 2 in microprocessor for btech students

HimanshiGarg82

tonesoftg

lanshi9

The fast-paced world of Agile development just got a turbo boost! Dive into this engaging talk on "Innovation at Speed: ChatGPT & the AI Transformation in Agile Development." Over the last few months, AI, including notable tools like Google Bard and Microsoft Co-Pilot, has been leveraged to supercharge Agile workflows. In this session, attendees will get an overview of the current AI landscape and its impact on development. They will learn why AI is the game-changer needed to embrace in the Agile lifecycle, offering that elusive X factor to multiply productivity. Real-world examples will be presented, and the challenges of implementing AI tools like ChatGPT within corporate environments will be discussed.

Harnessing ChatGPT - Elevating Productivity in Today's Agile Environment

VictorSzoltysek

We specialize in Psychic Readings, Psychic Love Spells, Binding Love Spells, Obsession Spells, Voodoo Spells, Lottery Spells, Marriage Spells, Black Magic Spells, Palm Readings & much more. Are you depressed? We perform this come-to-me love spell that works instantly with the aim of Winnipeg back the victim to the person performing the magic. Have you lost your lover? We perform this come-to-me love spell that works instantly with the aim of bringing back the victim to the person performing the magic. Have you lost your lover? Do u need to solve any relationship problem? Contact the powerful spells caster chief kule with love spells that work overnight and love spells that really work. Have you found yourself infatuated with a special someone you think could be the one? Are you looking for a spell to provide them with a nudge in the right direction? Or maybe the spell you cast didn’t achieve the results you were hoping for? Whether you’re new or versed in the ways of spell casting, we’re here to help. Today we’re going to provide you with a detailed guide on the types of love spells to cast. Not only that but there’s something for those who wish to find outside advice from more advanced spell casters. We’re also going to provide you with the top sites available to help you with your dilemma. Let’s begin our journey by educating ourselves on love magic and what a real love caster looks like. Love Magic and Love Casters Love magic made its first appearance back in Ancient Egypt and has been an active practice since. This type of magic is a branch of traditional magic and can be practiced in various ways. Typically the more common use of love magic is through the work of spells, but other methods look like Charms Rituals-LOVE Potions-Dolls and even Amulets If you are interested in becoming a love caster, be prepared for what’s to come. A genuine love caster knows that the art of love casting is no easy feat and shouldn’t be done casually. You should know that not only does it require you to be gifted spiritually, but you must be ready to serve others. Someone who is considered a real love caster has experience in all manner of spells, no matter the difficulty. Training yourself in attraction, commitment, and marriage spells is an excellent place to start. But this by no means will make you a professional. Practice your craft and expand your knowledge; understand that you will possess the ability to help others in time truly. Types of Love Spells What better way to start broadening your experiences with love spells than by learning more about them? These spells work like just about any other spell. Simply apply your intention, use a medium (sigils, mantras, candles, or charm bags), and top it off with establishing the belief that you will receive what you want. So what kind of spells are available and which ones suit your needs the best? Let’s take a look at the many options you have at your disposal. Attraction Spells

%+27788225528 love spells in Huntington Beach Psychic Readings, Attraction sp...

masabamasaba

In today's dynamic e-commerce landscape, the payment gateway emerges as a linchpin, ensuring smooth and secure transactions between buyers and sellers. In this discourse, we delve into the meticulous process of devising test cases tailored for scrutinizing payment gateways. Crafting precise test cases for payment gateways is a quintessential responsibility for testers operating within the service industry. This article meticulously explores pivotal scenarios integral to how to test payment gateways, coupled with essential guidelines for drafting effective test cases.

Payment Gateway Testing Simplified_ A Step-by-Step Guide for Beginners.pdf

kalichargn70th171

Model Call Girl Services in Delhi reach out to us at 🔝 9953056974 🔝✔️✔️ Our agency presents a selection of young, charming call girls available for bookings at Oyo Hotels. Experience high-class escort services at pocket-friendly rates, with our female escorts exuding both beauty and a delightful personality, ready to meet your desires. Whether it's Housewives, College girls, Russian girls, Muslim girls, or any other preference, we offer a diverse range of options to cater to your tastes. We provide both in-call and out-call services for your convenience. Our in-call location in Delhi ensures cleanliness, hygiene, and 100% safety, while our out-call services offer doorstep delivery for added ease. We value your time and money, hence we kindly request pic collectors, time-passers, and bargain hunters to refrain from contacting us. Our services feature various packages at competitive rates: One shot: ₹2000/in-call, ₹5000/out-call Two shots with one girl: ₹3500/in-call, ₹6000/out-call Body to body massage with sex: ₹3000/in-call Full night for one person: ₹7000/in-call, ₹10000/out-call Full night for more than 1 person: Contact us at 🔝 9953056974 🔝. for details Operating 24/7, we serve various locations in Delhi, including Green Park, Lajpat Nagar, Saket, and Hauz Khas near metro stations. For premium call girl services in Delhi 🔝 9953056974 🔝. Thank you for considering us!

CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE

9953056974 Low Rate Call Girls In Saket, Delhi NCR

Announcing Codolex 2.0 from GDK Software

Jim McKeeth

We specialize in Psychic Readings, Psychic Love Spells, Binding Love Spells, Obsession Spells, Voodoo Spells, Lottery Spells, Marriage Spells, Black Magic Spells, Palm Readings & much more. Are you depressed? We perform this come-to-me love spell that works instantly with the aim of bringing back the victim to the person performing the magic. Have you lost your lover? We perform this come-to-me love spell that works instantly with the aim of bringing back the victim to the person performing the magic. Have you lost your lover? Do u need to solve any relationship problem? Contact the powerful spells caster chief kule with love spells that work overnight and love spells that really work. Have you found yourself infatuated with a special someone you think could be the one? Are you looking for a spell to provide them with a nudge in the right direction? Or maybe the spell you cast didn’t achieve the results you were hoping for? Whether you’re new or versed in the ways of spell casting, we’re here to help. Today we’re going to provide you with a detailed guide on the types of love spells to cast. Not only that but there’s something for those who wish to find outside advice from more advanced spell casters. We’re also going to provide you with the top sites available to help you with your dilemma. Let’s begin our journey by educating ourselves on love magic and what a real love caster looks like. Love Magic and Love Casters Love magic made its first appearance back in Ancient Egypt and has been an active practice since. This type of magic is a branch of traditional magic and can be practiced in various ways. Typically the more common use of love magic is through the work of spells, but other methods look like Charms Rituals-LOVE Potions-Dolls and even Amulets If you are interested in becoming a love caster, be prepared for what’s to come. A genuine love caster knows that the art of love casting is no easy feat and shouldn’t be done casually. You should know that not only does it require you to be gifted spiritually, but you must be ready to serve others. Someone who is considered a real love caster has experience in all manner of spells, no matter the difficulty. Training yourself in attraction, commitment, and marriage spells is an excellent place to start. But this by no means will make you a professional. Practice your craft and expand your knowledge; understand that you will possess the ability to help others in time truly. Types of Love Spells What better way to start broadening your experiences with love spells than by learning more about them? These spells work like just about any other spell. Simply apply your intention, use a medium (sigils, mantras, candles, or charm bags), and top it off with establishing the belief that you will receive what you want. So what kind of spells are available and which ones suit your needs the best? Let’s take a look at the many options you have at your disposal

%+27788225528 love spells in Boston Psychic Readings, Attraction spells,Bring...

masabamasaba

WSO2Con2024 - Enabling Transactional System's Exponential Growth With Simplicity

WSO2

Abortion Pill Prices Tembisa [(+27832195400*)] 🏥 Women's Abortion Clinic in Tembisa ● Abortion Pills For Sale in Tembisa ● Tembisa 🏥🚑!! Abortion Clinic Near Me Cost, Price, Women's Clinic Near Me, Abortion Clinic Near, Abortion Doctors Near me, Abortion Services Near Me, Abortion Pills Over The Counter, Abortion Pill Doctors' Offices, Abortion Clinics, Abortion Places Near Me, Cheap Abortion Places Near Me, Medical Abortion & Surgical Abortion, approved cyctotec pills and womb cleaning pills too plus all the instructions needed This Discrete women’s Termination Clinic offers same day services that are safe and pain free, we use approved pills and we clean the womb so that no side effects are present. Our main goal is that of preventing unintended pregnancies and unwanted births every day to enable more women to have children by choice, not chance. We offer Terminations by Pill and The Morning After Pill.” Our Private VIP Abortion Service offers the ultimate in privacy, efficiency and discretion. we do safe and same day termination and we do also womb cleaning as well its done from 1 week up to 28 weeks. We do delivery of our services world wide SAFE ABORTION CLINICS/PILLS ON SALE WE DO DELIVERY OF PILLS ALSO Abortion clinic at very low costs, 100% Guaranteed and it’s safe, pain free and a same day service. It Is A 45 Minutes Procedure, we use tested abortion pills and we do womb cleaning as well. Alternatively the medical abortion pill and womb cleansing !!!

Abortion Pill Prices Tembisa [(+27832195400*)] 🏥 Women's Abortion Clinic in T...

Medical / Health Care (+971588192166) Mifepristone and Misoprostol tablets 200mg

%in Stilfontein+277-882-255-28 abortion pills for sale in Stilfontein

masabamasaba

(Vivek)Call Us, 8448380779,Call girls in Delhi NCr – We Offer best in class call girls. escort Service At Affordable Price At low Rate with Space Night 8000 We Are One Of The Oldest Escort and Call girls Agencies in Delhi. You Will Find That Our Female Escorts Are Full Of Fun, Sexy And They Would Love Enjoy Your Company. We Have A Fantastic Selection Of Escort Ladies Available For In-Calls As Well As Out-Calls. Our Escorts Are Not Only Beautiful But All Have Great Personalities Making Them The Perfect Companion For Any Occasion. In-Call:- You Can Come At Our Place in Delhi Our place Which Is Very Clean Hygienic 100% safe Accommodation. Out-Call:- You have To Come Pick The Girl From My Place We Are Also Provide Door Step Services (Delhi Ncr, Noida, Gurgaon, Faridabad, Ghaziabad Note:- Pic Collectors Time Passers Bargainers Stay Away As We Respect The Value For Your Money Time And Expect The Same From You Hygienic:- Full Ac room And Clean Rooms Available In Hotel 24 * 7 Hourly In Delhi NCR More Details, With WhatsApp Number, +91-8448380779

call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️

Delhi Call girls

Conference: Engage2024 in Antwerp Type: Workshop Speakers: Florian Vogler, Henning Kunz, Christoph Adler Title: Navigating the Future with The Hitchhiker's Guide to Notes and Domino 14 Abstract: Embark on an exhilarating journey with industry trailblazers Florian Vogler, Henning Kunz, and Christoph Adler in this not-to-be-missed workshop at the forefront of the tech universe. Get ready for a thrilling kick-off as we navigate the current state of the HCL universe, setting the stage for an exploration of the groundbreaking Notes and Domino 14. Discover the latest enhancements and revolutionary features that will redefine your experience. In this interactive session, unlock a treasure trove of tips and tricks to elevate your utilization of version 14, both with and without the game-changing panagenda MarvelClient. Brace yourself for also diving into Nomad, Nomad Web, and VoltMX, expanding your horizons in the expansive HCL landscape. Be a part of this exclusive opportunity to stay ahead in the ever-evolving world of HCL technologies. Your journey to mastering Notes and Domino 14 begins here. And remember, in the spirit of intergalactic exploration, don't forget to bring your towel!

W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...

panagenda

%in Soweto+277-882-255-28 abortion pills for sale in soweto

masabamasaba

WSO2Con2024 - From Code To Cloud: Fast Track Your Cloud Native Journey with C...

WSO2

WSO2CON 2024 - Cloud Native Middleware: Domain-Driven Design, Cell-Based Arch...

WSO2

This presentation covers the following topics: What is logging? The purpose of logging: Debugging The purpose of logging: Security The purpose of logging: Stats & analytics Traditional logging Traditional logging: Advantages Traditional logging: Disadvantages The solution: Large-scale logging Large-scale logging: Core principles Large-scale logging: Solution types Large-scale logging: Cloud vs on-prem Large-scale logging: Operational complexity Large-scale logging: Security Large-scale logging: Costs Large-scale logging: On-prem comparison - Elasticsearch - Grafana Loki - VictoriaLogs On-prem comparison: Setup and operation On-prem comparison: Costs On-prem comparison: Full-text search support On-prem comparison: How to efficiently query 100TB of logs? On-prem comparison: Integration with CLI tools VictoriaLogs for large-scale logging VictoriaLogs demo instance - Ingestion rate: 3600 messages / minute - The number of log messages: 1.1 billion - Uncompressed log messages’ size: 1.5TB - Compressed log messages’ size: 23GB - Compression ratio: 47x - Memory usage: 150MB VictoriaLogs CLI integration demo - Which errors have occurred in all the apps during the last hour? - How many errors have occurred during the last hour? - Which apps generated the most of errors during the last hour? - The number of per-minute errors for the last 10 minutes - Status codes for the last hour - Non-200 status codes for the last week - Top client IPs for the last 4 weeks with 404 and 500 response status codes - Per-month stats for the given IP across all the logs Large-scale logging solution MUST provide excellent CLI integration VictoriaLogs: (temporary) drawbacks VictoriaLogs: Recap - Easy to setup and operate - The lowest RAM usage and disk space usage (up to 30x less than Elasticsearch and Grafana Loki) - Fast full-text search - Excellent integration with traditional command-line tools for log analysis - Accepts logs from popular log shippers (Filebeat, Fluentbit, Logstash, Vector, Promtail, Grafana Agent) - Open source and free to use!

Large-scale Logging Made Easy: Meetup at Deutsche Bank 2024

VictoriaMetrics

Direct Style Effect Systems -The Print[A] Example- A Comprehension Aid

Philip Schwarz

The title is not connected to what is inside

shinachiaurasa2

MarTech Trend 2024 Book : Marketing Technology Trends (2024 Edition) How Data...

Jittipong Loespradit

Why and how to test logging - DevOps Showcase North - Feb 2016 - Matthew Skelton

1. Why and how to test logging DevOps Showcase North / Testing Showcase North Manchester, UK - Unicom Thursday 11th February 2015 Matthew Skelton Skelton Thatcher Consulting

2. confession: I am a big fan of logging

4. use logging as a channel/vector to make distributed systems more testable

5. transforming technology and teams high impact expertise Cloud, Agile, DevOps

8. Why we should test logging How to test logging effectively

10.

11. exceptional situations edge cases metrics analytics ‘audits’ … @evanphx

12. logging as an execution trace

13. reduce time-to-detect increase team engagement increase configurability enhance DevOps collaboration #operability

14.

15. (event sourcing) (structured logging) (CQRS)

16.

17. using logging mainly for errors inconsistent use of logging “logging slows things down”

18. “logging pollutes my domain model” “logging is just for Ops people” log aggregation only in Production

19. logging assumed to be free ($0) to implement logs not available to Tester or Developers

20.

21.

22.

23.

24.

25. distinct event IDs transaction tracing instrumentation log aggregation & search

26. cross-component visibility increased test coverage programmatic assertions deep insights

27. stories for testing logging

28. BasketItemAdded Search: BasketItem

29. Continuous event IDs

30. How many distinct event types (state transitions) in your application?

31.

32. represent distinct states

33. enum Human-readable sets: unique values, sparse, immutable C#, Java, Python, node (Ruby, PHP, …)

34. public enum EventID { // Badly-initialised logging data NotSet = 0, // An unrecognised event has occurred UnexpectedError = 10000, ApplicationStarted = 20000, ApplicationShutdownNoticeReceived = 20001, PageGenerationStarted = 30000, PageGenerationCompleted = 30001, MessageQueued = 40000, MessagePeeked = 40001, BasketItemAdded = 60001, BasketItemRemoved = 60002, CreditCardDetailsSubmitted = 70001, // ... }

35. Technical Domain public enum EventID { // Badly-initialised logging data NotSet = 0, // An unrecognised event has occurred UnexpectedError = 10000, ApplicationStarted = 20000, ApplicationShutdownNoticeReceived = 20001, PageGenerationStarted = 30000, PageGenerationCompleted = 30001, MessageQueued = 40000, MessagePeeked = 40001, BasketItemAdded = 60001, BasketItemRemoved = 60002, CreditCardDetailsSubmitted = 70001, // ... }

36. BasketItemAdded = 60001

37. BasketItemAdded = 60001 BasketItemRemoved = 60002

38. BasketItemAdded = 60001 BasketItemRemoved = 60002

39. represent distinct states

40.

41. OrderSvc_BasketItemAdded

42.

43. Monolith to microservices: debugger does not have the full view

44. Even with remote debugger, it’s boring to attach and detach

45.

46. Storage I/O Worker Job Queue Upload

47.

48.

49.

50. Transaction tracing

51. ‘Unique-ish’ identifier for each request Passed through downstream layers

52. Unique-ish ID

53. Testing logging

54. use logging as a channel/vector to make distributed systems more testable

55. track a parcel online

56.

57. search by event ID

58. transaction trace

59. Web App Doc store Audit service Msg queue

60. Transactional sub-system Log aggregation sub-system

61. An action here… …results in log entry here

62. trace events in a distributed, asynchronous system

63. stories for testing logging

64. AuditRecordCreated Search: AuditRecordCreated

65. AuditRecordCreated Search: AuditRecordCreated

66. Feature: User trades stocks Scenario: User requests a sell before close of trading Given I have 100 shares of MSFT stock And I have 150 shares of APPL stock And the time is before close of trading When I ask to sell 20 shares of MSFT stock Then I should have 80 shares of MSFT stock And I should have 150 shares of APPL stock And a sell order for 20 shares of MSFT stock should have been executed http://martinfowler.com/bliki/GivenWhenThen.html - Pete Hodgson

67. Given I run a scenario as a Lawyer And I create a document [And I wait 5 seconds] When I search the logs API Then I should find a recent entry for “AuditRecordCreated”

68.

69. Recap

70. use logging as a channel/vector to make distributed systems more testable

71. unique-ish event type IDs transaction tracing log aggregation & search Stories: expected search results

72. cross-component visibility increased test coverage programmatic assertions deep insights

73. trace events in a distributed, asynchronous system

74. ‘Structured Logging’ TW: “Adopt” (May 2015) https://www.thoughtworks.com/radar/techniques/structured-logging http://gregoryszorc.com/ .NET: http://serilog.net/ Java: https://github.com/fluent/fluent-logger-java

75. More Ditch the Debugger and Use Log Analysis Instead Matthew Skelton https://blog.logentries.com/2015/07/ditch- the-debugger-and-use-log-analysis-instead/

76. Thank you http://skeltonthatcher.com/ enquiries@skeltonthatcher.com @SkeltonThatcher +44 (0)20 8242 4103 @matthewpskelton

Why and how to test logging - DevOps Showcase North - Feb 2016 - Matthew Skelton

Recomendados

Recomendados

Más contenido relacionado

La actualidad más candente

La actualidad más candente (20)

Similar a Why and how to test logging - DevOps Showcase North - Feb 2016 - Matthew Skelton

Similar a Why and how to test logging - DevOps Showcase North - Feb 2016 - Matthew Skelton (20)

Más de Skelton Thatcher Consulting Ltd

Más de Skelton Thatcher Consulting Ltd (20)

Último

Último (20)

Why and how to test logging - DevOps Showcase North - Feb 2016 - Matthew Skelton