What's New in Scylla Monitoring 3.0
•0 recomendaciones•808 vistas
Descargar para leer sin conexión
Denunciar
Scylla Monitoring is a fast-paced project that exposes the cream of the Scylla native metrics in easy-to-consume and easy-to-understand dashboards. Its goal is to always make it as easy as possible for a user to understand how the system is behaving, and what can be done in reaction to issues to make the system perform better. Over the past 12 months, Scylla Monitor changed a lot, adding entirely new dashboards and refactoring existing ones to better convey relevant information to the users. In this talk, we will explore those changes, how to make the best use of the project and discuss what's in the oven for next year.
Recomendados
Learnings from the Field. Lessons from Working with Dozens of Small & Large D...HostedbyConfluent
811 vistas•29 diapositivas
Más contenido relacionado
La actualidad más candente
Tales from the four-comma club: Managing Kafka as a service at Salesforce | L...HostedbyConfluent
412 vistas•23 diapositivas
Not Your Mother's Kafka - Deep Dive into Confluent Cloud Infrastructure | Gwe...HostedbyConfluent
655 vistas•35 diapositivas
Kickstart your Kafka with Faker Data | Francesco Tisiot, Aiven.ioHostedbyConfluent
61 vistas•22 diapositivas
Planning for Disaster Recovery (DR) with Galera ClusterCodership Oy - Creators of Galera Cluster
740 vistas•27 diapositivas
La actualidad más candente(20)
Similar a What's New in Scylla Monitoring 3.0
Microservices @ Work - A Practice Report of Developing MicroservicesQAware GmbH
581 vistas•28 diapositivas
OSDC 2018 | Hardware-level data-center monitoring with Prometheus by Conrad H...NETWAYS
336 vistas•64 diapositivas
Flexible and Real-Time Stream Processing with Apache FlinkDataWorks Summit
2.2K vistas•38 diapositivas
Similar a What's New in Scylla Monitoring 3.0(20)
Más de ScyllaDB
Database Performance at Scale Masterclass: Workload Characteristics by Felipe...ScyllaDB
125 vistas•28 diapositivas
Database Performance at Scale Masterclass: Database Internals by Pavel Emelya...ScyllaDB
96 vistas•22 diapositivas
Database Performance at Scale Masterclass: Driver Strategies by Piotr SarnaScyllaDB
68 vistas•29 diapositivas
Powering Real-Time Apps with ScyllaDB_ Low Latency & Linear ScalabilityScyllaDB
140 vistas•24 diapositivas
7 Reasons Not to Put an External Cache in Front of Your Database.pptxScyllaDB
109 vistas•68 diapositivas
Más de ScyllaDB(20)
Último
.conf Go 2023 - Many roads lead to Rome - this was our journey (Julius Bär)Splunk
188 vistas•10 diapositivas
Astera Labs: Intelligent Connectivity for Cloud and AI InfrastructureCXL Forum
125 vistas•16 diapositivas
Último(20)
What's New in Scylla Monitoring 3.0
- 1. What’s new in Scylla Monitoring 3.0 Amnon Heiman, Software Developer
- 2. Presenter Amnon Heiman, Software Developer at ScyllaDB Over 15 years of experience in software development of large scale systems. Previously worked at Convergin, which was acquired by Oracle. Holds a BA and MSc in Computer Science from the Technion- Machon Technologi Le’ Israel and an MBA from Tel Aviv University.
- 3. What is New ■ Stack Overview ■ Versions Update ■ New Dashboards ■ Alerts ■ New Features ■ Scylla Manager Integration
- 6. Versions upgrade ■ Grafana 6.4.3 ■ Prometheus 2.13.1 ■ Alert-manager 0.17 ■ Scylla Open source 3.1 ■ Scylla Enterprise 2019.1 ■ Scylla Manager 2.0 (upcoming version) ■ Scylla Alternator ■ Python 3
- 7. Dashboards Reorganization User facing Dashboards ■ Overview - General overview of the cluster ■ Detailed - Drilldown look at a Scylla Node ■ CQL - CQL metrics and CQL Optimization ■ Alternator - Alternator metrics ■ Manager - Scylla Manager metrics ■ OS - OS related metrics (disk, network) Scylla’s support Oriented Dashboards ■ Errors - Scylla’s internal errors ■ CPU ■ IO
- 8. New Dashboard - CQL Commands ■ Inserts ■ Reads ■ Deletes ■ Updates ■ Batches
- 9. New Dashboard - CQL cont’ Optimization ■ Prepared Statements ■ Paged Queries ■ Token Aware ■ Reversed Read ■ Allow filtering ■ Consistency Level issues ■ Cross DC traffic
- 10. New Dashboard - Alternator (DynamoDB API) ■ Cluster overview ■ Data Plane Actions ■ Data Plane Latencies ■ Control Plane Actions ■ Cache ■ Timeouts
- 11. Additional Alerts ■ Alerts are shown in the dashboard and can connect to external systems ■ New alerts: ● Low disk size ● CQL connectivity
- 12. How to Add an Alert ■ Part of the Prometheus configuration (prometheus.rules.yml) ■ Structure ● Name ● What happened ● For how long ● What to report https://prometheus.io/docs/prometheus/latest/configuration/alerting_rules/
- 13. How to Add an Alert - Example - alert: InstanceDown expr: up == 0 for: 30s labels: severity: "2" annotations: description:'description...' summary: Instance is down Name Prometheus expression Duration Labels Set to the Alert severity is important longer description Summary
- 14. Annotations ■ Annotations are markers on the graph
- 15. Monitoring/Manager tighter integration ■ Manager has a Consul API ■ Prometheus can read the node list from the Manager ■ No configuration files are needed
- 16. Thank you Stay in touch Any questions? Amnon Heiman amnon@scylladb.com @amnonheiman
Notas del editor
- Lets start off by taking a look at an overview of our monitoring stack. Our Monitoring stack uses Prometheus for Metrics collection and storage. In order to create dashboards-display we use Grafana that reads these metrics from Prometheus. Prometheus can generate alerts, the alertmanager receives these alerts and serves as a data source for Grafana as well.
- Now, let’s discuss the changes. The applications and framework listed up here have all been upgraded. In particular Grafana 6 comes with a new look and extensioned abilities. By the way you no longer need python.
- The major change, is the dashboards reorganization to make the dashboards clearer and easier to use. The overview dashboard provides at quick glance how well the cluster is operating. Detailed - Drilldown detailed look at a Scylla Node
- Let's look at the new dashboards. The CQL dashboard is based on a talk by Shlomi in last year summit. It has two parts, the first covers the CQL commands.
- The second part is for CQL optimization. When everything is functioning optimally, all gauge should be at zero. On the other hand when the gauge is above zero it indicates potential problem.
- We recently introduced Scylla’s Alternator, which is a DynamoDB API for scylla. The Alternator dashboard provides a picture of what the alternator is doing.
- We now alert on low diskspace and cql connectivity problems.
- Many of our users have been asking about adding alerts themselves. Prometheus will fire an alert if a condition is met within a certain period of time. The alert will contain additional text explaining what is happening.
- This is what an alert configuration looks like To add an alert, you give it a name, you write an expression, define a minimum duration, and typically you will add labels, description and summary.
- Annotations are a new features which highlights events helping the users understand the system behaviour.
- Finally, we have tighter integration with the Manager. You can now set your monitoring to read its configuration directly from the manager instead of configuring it manually.