Have you ever wondered what technology stack does professional cloud SaaS companies use for log management and analysis? In this session, we cover a logging stack that can be considered for professional SaaS deployments. We compare log management tools for applications deployed in Cloud. We will dive deep into one such tool called SumoLogic.

1. Log Management and
Analysis
Logging in Cloud
Vignesh G
Principal Engineer
April 2016

2. © 2014 Progress Software Corporation. All rights reserved.2
Agenda
 Why do we need logging?
 Centralized Logging
 What to look for while choosing Logging
Tools?
 Best Practices
 Tools Comparison
 Analytics and Performance Management
 Saas Logger demo

3. © 2014 Progress Software Corporation. All rights reserved.3
Need for Logging
 Production Monitoring
 Production troubleshooting
 Debugging
 Analytics
 Security Auditing and Compliance
 Application Performance Management
 Alerts

4. © 2014 Progress Software Corporation. All rights reserved.4
Traditional Logging

5. © 2014 Progress Software Corporation. All rights reserved.5
Log Aggregator

6. © 2014 Progress Software Corporation. All rights reserved.6
OpenSource Stack

7. © 2014 Progress Software Corporation. All rights reserved.7
Saas Tools

8. © 2014 Progress Software Corporation. All rights reserved.8
Best Practices
 Use UUID - Stored in threadLocal (MDC if using slf4j )
 AspectJ for logging
 Obfuscate sensitive information and PII in logs (logentries
datahug, Logstash filters)
 Capture console logs
 Log user identity wherever possible

9. © 2014 Progress Software Corporation. All rights reserved.9
What to look for while choosing Logging Tools?
 Website Integrity –
 Whitelist options
 User roles and permissions
 Option to filter data before shipping
 Where is the data residing
 Is your data encrypted on the wire?
 Is the Provider SOC2 compliant?
 Is Data encrypted on Providers Disk?

10. © 2014 Progress Software Corporation. All rights reserved.10
Tools Comparison
 Splunk
• Pros: Feature rich, Market Leader, Excelent Search and charting
tools
• Cons: Onpremise, Expensive
 SumoLogic
• Pros: Feature rich, alerts
• Cons: As a developer, if you’re logging sensitive or PII you need to
make sure it’s redacted, Tiem Lag, Upload overhead
 PapperTrails
• Pros: Affordable
• Cons: too basic
 LogStash
• Pros: Opensource
• Cons: It’s a stack of three products

11. © 2014 Progress Software Corporation. All rights reserved.11
Log Management Landscape

12. © 2014 Progress Software Corporation. All rights reserved.12
Analytics - Logins

13. © 2014 Progress Software Corporation. All rights reserved.13
Geo Analytics
 _sourceCategory=*demo*tomcat*access | parse regex "(?<remote_ip>d{1,3}.d{1,3}.d{1,3}.d{1,3})" | lookup latitude, longitude,
country_code, country_name, region, city, postal_code, area_code, metro_code from geo://default on ip = remote_ip | count by latitude,
longitude, country_code, country_name, region, city, postal_code, area_code, metro_code | sort _count

14. © 2014 Progress Software Corporation. All rights reserved.14
Response time

15. © 2014 Progress Software Corporation. All rights reserved.15
APM