Se ha denunciado esta presentación.
Utilizamos tu perfil de LinkedIn y tus datos de actividad para personalizar los anuncios y mostrarte publicidad más relevante. Puedes cambiar tus preferencias de publicidad en cualquier momento.
Próximo SlideShare
What to Upload to SlideShare
What to Upload to SlideShare
Cargando en…3
×
1 de 36

Elastic 6.1 Feature Presentation

0

Compartir

Descargar para leer sin conexión

Walkthrough the major new features of the Elastic Stack 6.1

Libros relacionados

Gratis con una prueba de 30 días de Scribd

Ver todo

Audiolibros relacionados

Gratis con una prueba de 30 días de Scribd

Ver todo

Elastic 6.1 Feature Presentation

  1. 1. 1 Dec 18, 2017 6.1 Feature Discussion
  2. 2. 2
  3. 3. 3 Adaptive Replica Selection Historic behavior is round robin Round Robin Without adaptive replica selection primary replica1 Coordinating node
  4. 4. 4 Adaptive Replica Selection But sometimes you’re in a noisy-neighbor situation and that’s not great Round Robin Without adaptive replica selection primary replica1 tenant 2 tenant 3 machine 2 machine 1 Coordinating node
  5. 5. 5 Adaptive Replica Selection Or you could have a degraded disk, causing slower response times Round Robin Without adaptive replica selection r1 r2 degraded disk Coordinating node
  6. 6. 6 Adaptive Replica Selection Accounting for node performance in searches Adaptive With adaptive replica selection r1 r2 degraded disk q̂(s) = 1 + (os(s) * n) + q(s) Ψ(s) = R(s) - 1/µ̄(s) + (q̂(s))^b / µ̄(s) Coordinating node
  7. 7. 7 Shard Splitting •  Fewer concerns up front on deciding correct number of shards •  Scale based on capacity demands •  Compliments shrink API and improves story on elastic scalability Add capacity after an index has been created Source: Gray Arial 10pt 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 number_of_shards: 1 _split _split _split _split number_of_routing_shards: 16
  8. 8. 8 Shard Splitting Workflow Process for splitting shards Create index with “number_of_routing _shards” defined 1 2 3 4 Set index as read only ("index.blocks.write" : true) Make _split request with “number_of_shards” as factor of “number_of_routing _shards” Monitor _split progress with _cat/ recovery or _cluster/ health 5 Make index writeable again ("index.blocks.write" : false)
  9. 9. 9 Composite Aggs Aggregations meet pagination ●  Efficiently work with large aggregation results by paginating ●  Return all aggregation results, without setting a maximum size ●  As described by Parse.ly: ●  API powered by Elasticsearch aggregation queries ●  API supports page and limit parameters ●  Query for page=10, results_per_page=1000, ○  10,000 results fetched, last 1000 returned client side ○  5-6 second execution time
  10. 10. 10 Composite Aggs: Sample Use Case Let’s aggregate pageviews for a Google Analytics type application URL Access Time http://elastic.co 2017-12-15T12:10:30Z https://www.elastic.co/guide/index.html 2017-12-15T12:10:40Z http://elastic.co 2017-12-15T12:10:55Z URL Pageviews http://elastic.co 20,000 https://www.elastic.co/guide/index.html 5,000 https://www.elastic.co/guide/en/elasticsearch/reference/current/index.html 2,000 •  Millions of URLs •  API/programmatic access to aggregation results
  11. 11. 11 Composite Aggs: Sample Use Case Let’s aggregate pageviews for a Google Analytics type application GET page-views/_search { "aggs" : { "my_buckets": { "composite" : { "size": 10, "sources" : [ { "url": { "terms" : { "field": "url", "order": "desc" } } } ] } } } }
  12. 12. 12 GET page-views/_search { "aggs" : { "my_buckets": { "composite" : { "size": 10, "after": { "url": "https://www.elastic.co/ guide/en/elasticsearch/reference/current/index.html" }, "sources" : [ { "url": { "terms" : { "field": "url", "order": "desc" } } } ] } } } } } Composite Aggs: Sample Use Case Let’s aggregate pageviews for a Google Analytics type application
  13. 13. 13
  14. 14. 14 Benefits ●  Easier to format and debug ●  Automate script testing ●  Improve version control How it works ●  Write script in file stored on local disk ●  Reference script file path in Ruby filter ●  Pass optional parameters to script Improved scripting support File-based Ruby scripts
  15. 15. 15 What is it ●  Execution environment for Java plugins Benefits ●  Execute plugins in any JVM language Guidance to customers ●  Do not turn on in production! ●  Try in dev/test and report any issues --experimental-java-execution Java execution engine (experimental, off by default) Paves way for Java plugins
  16. 16. 16 Logstash Compatibility: Monitoring & Management •  Highly recommended to run the same minor versions across Elasticsearch, Kibana, and Logstash. •  Logstash must be on the same or lower minor version than the Elasticsearch m/m cluster and within the same major version. •  The last minors of a Logstash major release will be the compatibility releases. •  Included in support matrix “Product Compatibility” tab. Logstash 6.1 Features Logstash Elasticsearch (Monitoring & Management Cluster) 5.2.x 5.2.x - 5.6.x 5.3.x 5.3.x - 5.6.x 5.4.x 5.4.x - 5.6.x 5.5.x 5.5.x - 5.6.x 5.6.x 5.6.x - 6.0.x 6.0.x 6.0.x - 6.2.x 6.1.x 6.1.x - 6.2.x 6.2.x 6.2.x
  17. 17. 17
  18. 18. 18 What it is •  Monitor environment for changes and configure data collection accordingly Benefits •  Allows ongoing monitoring of highly dynamic environments Docker Autodiscovery First step in Beats “autodiscovery” theme
  19. 19. 19 •  Implements a Docker-native approach •  Simplifies user experience •  Experimental in 6.1 Docker JSON logging prospector Implements default JSON logging driver prospectors: - type: docker containers.ids: - c3ec7a0bd9640151a768663b7e78c... Filebeat config
  20. 20. 20 Logging data New in 6.1 System •  Linux / MacOS •  Windows Events Containers •  Docker •  Kubernetes Infrastructure Applications Databases •  MySQL •  PostgreSQL (6.1) Queues •  Redis •  Kafka (6.1) Web / Proxy •  Apache •  Nginx •  Traefik (6.1) Elastic •  Elasticsearch* •  Kibana* •  Logstash (6.1) WINLOGBEATFILEBEAT *near-term roadmap
  21. 21. 21
  22. 22. 22 Metrics data New in 6.1 METRICBEAT OS •  System (uptime) •  Windows (service) Infrastructure Cloud metadata •  AWS •  GCP •  Azure •  DigitalOcean •  Alibaba Containers •  Docker •  Kubernetes Virtualization •  vSphere Storage •  Ceph (OSD) Uptime •  Heartbeat HEARTBEAT
  23. 23. 23 Metrics data New in 6.1 METRICBEAT Applications Datastores •  MySQL •  PostgreSQL •  MongoDB •  Couchbase •  Aerospike •  Memcached •  Etcd (6.1) Web servers •  Apache •  Nginx Other •  HAProxy •  Zookeeper •  Prometheus Queues •  Kafka •  Redis •  RabbitMQ (queue) Elastic •  Elasticsearch •  Kibana •  Logstash (6.1) Custom metrics •  JMX/Jolokia •  PHP-FPM •  Golang •  Dropwizard •  HTTP (server) •  Graphite (6.1) HEARTBEAT
  24. 24. 24 Packetbeat •  SSL envelope analysis Auditbeat •  Improved dashboards Security Analytics Data New in 6.1
  25. 25. 25 Packetbeat •  SSL envelope analysis Auditbeat •  Improved dashboards Security Analytics Data New in 6.1
  26. 26. 26
  27. 27. 27 6 Hide visualization title in dashboard (81 comments) 5 Preserve dashboard layout in reports 4 Support for keystore in Kibana 4 Drop down and range slider input controls (10 comments) 3 Dashboard specific visualization titles (31 comments) 3 Add borders (margins) to dashboard panels (19 comments) 2 Pie chart data labels (66 comments) 2 Support for Math.js in TSVB 2 TSVB data table 1 WMS base layer for region maps 32+ ER’s and over 300 comments & upvotes closed Just in time for the holidays
  28. 28. 28 Kibana Home Phase 1
  29. 29. 29 Lab Visualizations Input Controls
  30. 30. 30 Pie Chart Data Labels
  31. 31. 31 Time Series Visual Builder Data Table & Math.js Support
  32. 32. 32 Dashboard Customization Optional margins, customizable and hidden panel titles
  33. 33. 33 Dashboard Title URL Parameter
  34. 34. 34 Reporting Preserve Dashboard Layout
  35. 35. 35 Canvas Technology Preview www.elastic.co/blog/canvas-tech-preview, canvas.elastic.co
  36. 36. 36 Questions?

×