There are many tools and possibilities available in the Icinga monitoring ecosystem. It isn't just checks and notifications anymore. Visualize what's going on, collect metrics with Graphite, InfluxDB and Grafana. Correlate log events with monitoring alerts in Elastic/Graylog. Don't forget about ticket systems and fancy office dashboards too. This talk dives into all these possibilities, existing and newly developed and presents the next integrations chapter after the OSMC 2017 story. Presentation Bio: Michael is a long term Icinga Developer and most recently Community Manager. He loves to play with Icinga integrations and try new things (Vagrant, Dashing, Puppet, etc.). In his sparetime Michael takes care about monitoring-portal.org and building awesome LEGO models.

1. Dev and Ops Stories
Integrations++
#icingacamp| March 8th, 2018 | Berlin

2. INTRODUCTION
Michael Friedrich

3. INTRODUCTION
Michael Friedrich
•Senior Developer @
• Developer & Community Lead
•@dnsmichi
•„A taste of Austria in lovely Nuremberg.“

4. INTRODUCTION
monitoring-portal.org

5. INTRODUCTION
Icinga

6. Who is using ?

7. Who automates
monitoring
deployments?

8. AUTOMATION

9. AUTOMATION
Overview
•Setup & configure „the basics“
•Deploy distributed environments
•Install integrations and modules
•Environments: dev, stage, prod

10. AUTOMATION
Puppet
•I like Puppet: Descriptive & declarative
•Official modules for Icinga 2 & Icinga Web 2
•Stable modules on forge.puppet.com
•Vagrant: Puppet 5, Environments, Hiera

11. AUTOMATION
Puppet – Icinga 2
class { '::icinga2':
manage_repo => false,
confd => $real_confd,
features => $basic_features,
}
mysql::db { 'icinga':
user => 'icinga',
password => 'icinga',
host => 'localhost',
charset => 'latin1',
collate => 'latin1_general_ci',
grant => [ 'ALL' ]
}
class{ '::icinga2::feature::idomysql':
user => 'icinga',
password => 'icinga',
database => 'icinga',
import_schema => true,
require => Mysql::Db['icinga'],
}
https://github.com/i
cinga/puppet-
icinga2

12. AUTOMATION
Puppet – Icinga Web 2
mysql::db { 'icingaweb2':
user => 'icingaweb2',
password => 'icingaweb2',
host => 'localhost',
grant => [ 'ALL' ]
}
class { '::icingaweb2':
manage_repo => false,
import_schema => true,
db_type => 'mysql',
db_host => 'localhost‘,
db_port => 3306,
db_username => 'icingaweb2',
db_password => 'icingaweb2‘
}
class { '::icingaweb2::module::monitoring':
ido_host => 'localhost',
ido_db_name => 'icinga',
ido_db_username => 'icinga',
ido_db_password => 'icinga',
commandtransports => {
icinga2 => {
transport => 'api',
username => $api_username,
password => $api_password
}
}
}
https://github.com/i
cinga/puppet-
icingaweb2

13. AUTOMATION
Puppet – Icinga Web 2 Modules
$map_module_conf_dir = "${conf_dir}/modules/map”
$map_settings = {
'module-map' => {
'section_name' => 'map',
'target' => "${map_module_conf_dir}/config.ini",
'settings' => {
'stateType' => 'hard',
'default_zoom' => '6',
}
}
}
icingaweb2::module { 'map':
install_method => 'git',
git_repository => 'https://github.com/nbuchwitz/icingaweb2-module-map.git',
git_revision => 'master',
settings => $map_settings,
}
->
concat::fragment { "module_maps_dashboards":
target => $default_dash_conf_path,
content => template("profiles/icinga/icingaweb2/modules/map/dashboard.ini.erb"),
order => '10’
}
https://github.com/I
cinga/icinga-
vagrant/blob/master
/.puppet/modules/pr
ofiles/manifests/icin
ga/icingaweb2.pp

14. AUTOMATION
Puppet
https://www.icinga.com/products/integrations/puppet/

15. Who is using Graphing?

16. METRICS

17. METRICS
Overview
•„Time series data bases“ (TSDB)
•RRDTool
•Graphite
•InfluxDB

18. Graphite
&
Icinga Web 2 ?

19. METRICS
Icinga Web 2 Graphite Module
•Graphite Render API
•Many functions
•Return SVG
•Detail view
https://github.com/
echocat/puppet-
graphite

20. METRICS
Icinga Web 2 Graphite Module
•Graph dashboard
•Search host/service
•Responsive layout
•Template language
•Data, colors, ...
•Render URL params

21. Grafana
&
Icinga Web 2 ?

22. METRICS
Grafana
•Datasources: Graphite, InfluxDB
•Default templates
•Dashboards
https://github.com/
voxpupuli/puppet-
grafana

23. METRICS
Icinga Web 2 Module
•Grafana API
•Download
•Direct
•Detail View Image

24. METRICS
Icinga Web 2 Module
•Host Action
•All service graphs
•Detailed documentation
•Configuration
•Grafana templates

25. LOGS & EVENTS

26. Who is using
or

27. LOGS & EVENTS
Overview
•„syslog“ to Elastic/Graylog
•„monitoring data“
•„events“

28. LOGS & EVENTS
Overview
•
•Filebeat
•icingabeat
•Icinga 2
•GELF Writer
•Elasticsearch Writer

29. Host is down in Icinga Web 2
+
Access to syslogs & events
=
Central view for faster problem analysis

30. Nice idea J
Write a module?

31. LOGS & EVENTS
Elastic Stack
•HostActions Hook
•Not embedded (would refresh too often)
•Query Elasticsearch/Graylog REST API
•List entries
•Filters, fields

32. LOGS & EVENTS
Elastic Stack
• for event visualization
• in Icinga Web 2?
https://github.com/
elastic?q=puppet-

33. LOGS & EVENTS
Elastic Stack

34. LOGS & EVENTS
Graylog
•How about ?
•“Streams“ with pre-filtered data
•Query data (same as monitoring list)
•Apply filters, pagination
•WIP: https://github.com/Icinga/icingaweb2-module-graylog/issues
https://github.com/
Graylog2/puppet-
graylog

35. LOGS & EVENTS
Graylog
•TODO: Screenshot

36. VISUALIZATION

37. Show hosts
on a map
in Icinga Web 2 ?

38. VISUALIZATION
MAPS

39. MAPS
Openstreetmap
•Fetch geolocation via JS
•Points as JSON
•leaflet.js renderer

40. MAPS
Openstreetmap
•Host Popup with service list/states
•Worst state calculation
•Default zoom config

41. MAPS
Openstreetmap
Dashlets in Icinga Web 2

42. VISUALIZATION
THEMES

43. THEMES
Overview
•Customize Icinga Web 2
•„Corporate Identity“
•... or just fun J
•Resources
• https://exchange.icinga.com/search?q=category%3A%22Themes%22
• https://github.com/Icinga/icingaweb2-theme-company
https://github.com/i
cinga/icinga-vagrant

44. THEMES
Overview

45. VISUALIZATION
DASHBOARDS

46. DASHBOARDS
Icinga Web 2
•?showFullscreen
•?showCompact
•?addColumns
/icingaweb2/monitoring/list/services?service_problem=1&sort=service_s
everity
&showCompact&showFullscreen&addColumns=host_output,host_address

48. List of problems:
How many problems do
you have?

49. DASHBOARDS
Icinga Web 2
•Reduce problems to NUMBERS
•Add static details & short readable lists
•No clicks – view it in the office

50. DASHBOARDS
Dashing
„Dashing is a Sinatra based framework that lets
you build beautiful dashboards.“
•Open tickets, current tasks, any problems
•Colors for state indication
•Ruby, HTML, CSS, JS, Coffeescript

51. DASHBOARDS
Dashing
•Widgets
•Present number, lists, data
•Styling
•Dynamic update events

52. DASHBOARDS
Dashing
•Dashboard
•Add Widget types
•Define widget data as „data-id“
•Static HTML (browser drag&drop via JS)

53. DASHBOARDS
Dashing
•Jobs
•Run every X seconds
•Get data from source
•Send event to „data-id“

54. Icinga 2 REST API +
Dashing =
#monitoringlove

55. DASHBOARDS
Dashing v1.4.0

56. DASHBOARDS
Dashing v2.0.0
•v2.0.0 @ #icingacamp Berlin 2018
•Local configuration file icinga2.local.json
•Environment variables (for containers)
•Icinga Web 2 Iframe URL config
•Refined layout and style
https://github.com/i
cinga/icinga-vagrant

57. DASHBOARDS
Dashing v2.0.0

58. IDEAS

59. IDEAS
Mine for 2018
•Internet of Things
•MQTT, mqttwarn
• 04/2018 https://www.heise.de/select/ix/2018/3/1520118809608597
•(Home) Automation & Environmental
•HTTP Callbacks for notifications & more

60. IDEAS
Add yours!

61. www.icinga.com
packages.icinga.com
github.com/icinga
icinga
icinga
icinga
Thank You!