ELK-Stack is world’s most popular log management platform. These open-source products are most commonly used in log analysis in IT environments. Logstash collects and parses logs, Elasticsearch indexes and stores the information. Kibana then presents the data in visualizations that provide actionable insights into one’s environment/software. Ashwin is going to brief about ELK-stack and show how this popular log management platform can be used with BizTalk servers. Including installing ELK stack in Windows and demo on how BizTalk data can be logged and analyzed in ELK-Stack. And he is going to discuss about some of the uses cases you can use ELK-stack with BizTalk and Azure.

1. Using ELK-Stack (Elasticsearch,
Logstash and Kibana) with BizTalk
Server
M.R. Ashwin Prabhu https://www.linkedin.com/in/mrashwinprabhu

2. fortuvis.com
2
Using ELK-Stack (Elasticsearch, Logstash and Kibana) with BizTalk Server
Ashwin Prabhu
fortuvis.com
By

3. fortuvis.com
3
Agenda
 What is ELK stack (Elastic Stack)? Why do we need ELK stack?
 ELK Stack Architecture
 Logstash
 ElasticSearch
 Kibana
 ELK Installation notes in Windows?
 ELK with BizTalk - Demo
 Q&A

4. fortuvis.com
4
Who am I?
• Ashwin Prabhu
• Mircosoft Azure MVP for 2016, 2015 & 2014
• Independent Consultant in BizTalk Server and Azure
• Living in UK
• 15 Years of experience in BizTalk Server
• Blog: http://www.fortuvis.com/blog/
• @mrashwinprabhu
• https://www.linkedin.com/in/mrashwinprabhu

5. fortuvis.com
5
What is ELK stack (Elastic Stack)? Why do we need ELK?
• Log management platform
• Provides actionable insights in real time from structured and unstructured logs

6. fortuvis.com
6
What’s is ELK stack (Elastic Stack)? Why do we need ELK? Continue..
• ElasticSearch (E), Logstash (L), Kibana (K)
• Free open source stack for log management with commercial support, managed solutions, and
additional tools from Elastic.
• ELK stack aka Elastic Stack
• Provides the value of convert these unstructured and structured log files, into more meaningful
dashboards and searchable data.

7. fortuvis.com
7
ELK Stack Architecture
• Logstash can collect and parse the log from different sources, store it in Elasticsearch and Kibana
provides a visualization of that data

8. fortuvis.com
8
ELK Architecture - Logstash
• Logstash event processing pipeline has three stages
Input
Filter
Output

9. fortuvis.com
9
ELK Architecture - Elasticsearch
• Document based search engine
• JSON based
• Built on top of Apache Lucene
• Schema free
• Distributed by design
• API Centric
• NoSQL database

10. fortuvis.com
10
ELK Architecture - Kibana
• Browser based analytics and search dashboard for data stored in Elasticsearch
• Create dashboard
• Similar to Power BI for analytics but more search based

11. fortuvis.com
11
ELK with BizTalk – Demo

12. fortuvis.com
12
Any Questions?

13. fortuvis.com
13
Thank You
ashwin.prabhu@fortuvis.com
@mrashwinprabhu
Blog: http://www.fortuvis.com/blog/