1) The document discusses how self-service business intelligence (BI) tools can integrate geospatial analysis capabilities. 2) It describes Metatron Discovery, an open-source BI platform developed by SK Telecom that has added features like spatial indexing and GIS querying of data in Druid, as well as geospatial visualization charts and maps. 3) The presentation provides examples of how Metatron Discovery allows users to perform geospatial analysis and get insights from location-based data, such as analyzing police incidents in San Francisco.

1. When Self-Service BI meets
Geospatial Analysis
meets
Kyungtaak Noh | SK telecom, South Korea
2019 Strata Data Conference

2. Who I am
1metatron Discovery
Developer Product Owner

3. My announcements
Metatron Discovery 2
Spatial index optimization and GIS query
support on Druid using Apache Lucene
Big data: The best way to truly understand
customers in Telco
When Self-Service BI meets
Geospatial Analysis,

4. metatron Discovery ?
Metatron Discovery 3
https://bi-survey.com

5. metatron Discovery ?
Metatron Discovery 4
Files
(CSV/XLS)
Database
(Hive/Druid/mySQL/…)
More details >> Visit https://metatron.app

6. Metatron Discovery 5
Workbench = SQL Explorer
Dashboard = Visualization
Notebook/Embedded Analytics
= (a little bit) Advanced analysis
Workspace = collaboration
Data Prep. – Data Transformer
Meta-Data Management
= Data exploration

7. Extension of strata 2017
Metatron Discovery 6
1000+ servers
60TB Data/Day
24 HR = 720M CEI Record/DAYX 30M Customer

8. New feature : Data Preparation
After 2 years…
Metatron Discovery 7
Apps: Integrator
Apps : Anomaly
New feature : MDM
New feature : Geospatial Analysis
Apps : APM
1000
user/day

9. What dose mean BI to meet the geo.. ?
Metatron Discovery 8
Location IntelligenceBusiness Intelligence

10. We met a long time ago,
Metatron Discovery 9
Experimental
V1 Chart
V1 Dashboard
Narrow out focus

11. Can’t get over the geo..
Metatron Discovery 10
WHERE the GPS
connection is not
working?
Need to check quality of
wireless-base-station BY
REGION
on the map!
WHERE is the
COVERAGE area of a
particular base station?
Want to see
location information
together
on the dash board!
What ROUTE is the
most commonly
used in a specific
area?

12. Prerequisite for map
Metatron Discovery 11
Enhance the engine (druid)
UX Concept for geometry
&

13. Engine - Druid
Metatron Discovery 12
https://metatron.app/index.php/2018/09/06/evaluation-on-druid/http://druid.io/

14. Metatron Discovery 13
https://github.com/apache/incubator-druid/issues/1055
Difficulty - Hard

15. Metatron Discovery 14
Our approach
Points
• Geo3DPoint : not yet (next hafl?)
• LatLonPoint : bbox, distance query
Shapes
• RecursivePrefixTree based on GeoHash
• Supports spatial operations
(covers, intersects, etc.)
[Druid Queries]
Spatial index optimization and GIS query
support on Druid using Apache Lucene
For indexing / searching geospatial data

16. Metatron Discovery 15
Our approach
Choropleth Map Geospatial RelationHexagonal Aggregation
K-Means

17. UX Concept for visualization
Metatron Discovery 16
1. [Dashboard] View 2. [Chart] Create Chart 3. [Chart] Pivot Data
4. [Chart] Decorate Chart 5. [Dashboard] Publish
Edit
6. [Dashboard] Interaction
(Selection, Drill-Down, …)

18. UX: Chart View
Metatron Discovery 17
Chart view
Pivot Shelf
Attributes
Data view
Column
Row
Aggregation
Dimension Columns
Measure Columns

19. Typical Map view
Metatron Discovery 18
Layers AttributesMap view
<<Base map>>

20. Geo Column
Measure Column
Our approach : Multiple layers
Metatron Discovery 19
Map view
Attributes
Layer Shelf
Data view

21. Our approach : Geospatial Analysis
Metatron Discovery 20
Map view
Layer ShelfAnalysis
view
Attributes

22. Brownie point : Support ingestion for geometry
Metatron Discovery 21
Add geo type
: Point / Line / Polygon
Support convert
coordinate system

23. Brownie point : Pluggable custom base map
Metatron Discovery 22

24. Finally we met
Metatron Discovery 23
UserInterfaceApplicationServerStorage
Customized
GeoJSON
JSON/HTTP
metatron Search
Query
JSON/HTTP
Result Pivot
Data
JSON/HTTP
Druid Query
JSON/HTTP
Result Data
JSON/HTTP
16 basic chats + MAP
metatron Search
Query
JSON/HTTP
Files
(CSV/XLS)
Database
(Hive/Druid/mySQL/…)
Create
data source
Ingest
data source
with Geometry
G

25. Use case 1– Find Police Incidents in San Francisco
24metatron Discovery

26. Use case 1 – Wrangled Dataset
25metatron Discovery
Transform To WKT
Union of 2 dataset

27. Use case 1 – Show Map
26metatron Discovery

28. Use case 1 – Get Insight
27metatron Discovery

29. To maintain relationship,
Metatron Discovery 28
Improve Visualization Performance Using App dedicated Map View

30. Open-sourced
Metatron Discovery 29

31. Metatron Discovery 30
Thank you!