Se ha denunciado esta presentación.
Se está descargando tu SlideShare. ×

[2019 Strata] Self Sevice BI meets Geospatial Analysis

Anuncio
Anuncio
Anuncio
Anuncio
Anuncio
Anuncio
Anuncio
Anuncio
Anuncio
Anuncio
Anuncio
Anuncio
Cargando en…3
×

Eche un vistazo a continuación

1 de 31 Anuncio
Anuncio

Más Contenido Relacionado

Similares a [2019 Strata] Self Sevice BI meets Geospatial Analysis (20)

Anuncio

Más reciente (20)

Anuncio

[2019 Strata] Self Sevice BI meets Geospatial Analysis

  1. 1. When Self-Service BI meets Geospatial Analysis meets Kyungtaak Noh | SK telecom, South Korea 2019 Strata Data Conference
  2. 2. Who I am 1metatron Discovery Developer Product Owner
  3. 3. My announcements Metatron Discovery 2 Spatial index optimization and GIS query support on Druid using Apache Lucene Big data: The best way to truly understand customers in Telco When Self-Service BI meets Geospatial Analysis,
  4. 4. metatron Discovery ? Metatron Discovery 3 https://bi-survey.com
  5. 5. metatron Discovery ? Metatron Discovery 4 Files (CSV/XLS) Database (Hive/Druid/mySQL/…) More details >> Visit https://metatron.app
  6. 6. Metatron Discovery 5 Workbench = SQL Explorer Dashboard = Visualization Notebook/Embedded Analytics = (a little bit) Advanced analysis Workspace = collaboration Data Prep. – Data Transformer Meta-Data Management = Data exploration
  7. 7. Extension of strata 2017 Metatron Discovery 6 1000+ servers 60TB Data/Day 24 HR = 720M CEI Record/DAYX 30M Customer
  8. 8. New feature : Data Preparation After 2 years… Metatron Discovery 7 Apps: Integrator Apps : Anomaly New feature : MDM New feature : Geospatial Analysis Apps : APM 1000 user/day
  9. 9. What dose mean BI to meet the geo.. ? Metatron Discovery 8 Location IntelligenceBusiness Intelligence
  10. 10. We met a long time ago, Metatron Discovery 9 Experimental V1 Chart V1 Dashboard Narrow out focus
  11. 11. Can’t get over the geo.. Metatron Discovery 10 WHERE the GPS connection is not working? Need to check quality of wireless-base-station BY REGION on the map! WHERE is the COVERAGE area of a particular base station? Want to see location information together on the dash board! What ROUTE is the most commonly used in a specific area?
  12. 12. Prerequisite for map Metatron Discovery 11 Enhance the engine (druid) UX Concept for geometry &
  13. 13. Engine - Druid Metatron Discovery 12 https://metatron.app/index.php/2018/09/06/evaluation-on-druid/http://druid.io/
  14. 14. Metatron Discovery 13 https://github.com/apache/incubator-druid/issues/1055 Difficulty - Hard
  15. 15. Metatron Discovery 14 Our approach Points • Geo3DPoint : not yet (next hafl?) • LatLonPoint : bbox, distance query Shapes • RecursivePrefixTree based on GeoHash • Supports spatial operations (covers, intersects, etc.) [Druid Queries] Spatial index optimization and GIS query support on Druid using Apache Lucene For indexing / searching geospatial data
  16. 16. Metatron Discovery 15 Our approach Choropleth Map Geospatial RelationHexagonal Aggregation K-Means
  17. 17. UX Concept for visualization Metatron Discovery 16 1. [Dashboard] View 2. [Chart] Create Chart 3. [Chart] Pivot Data 4. [Chart] Decorate Chart 5. [Dashboard] Publish Edit 6. [Dashboard] Interaction (Selection, Drill-Down, …)
  18. 18. UX: Chart View Metatron Discovery 17 Chart view Pivot Shelf Attributes Data view Column Row Aggregation Dimension Columns Measure Columns
  19. 19. Typical Map view Metatron Discovery 18 Layers AttributesMap view <<Base map>>
  20. 20. Geo Column Measure Column Our approach : Multiple layers Metatron Discovery 19 Map view Attributes Layer Shelf Data view
  21. 21. Our approach : Geospatial Analysis Metatron Discovery 20 Map view Layer ShelfAnalysis view Attributes
  22. 22. Brownie point : Support ingestion for geometry Metatron Discovery 21 Add geo type : Point / Line / Polygon Support convert coordinate system
  23. 23. Brownie point : Pluggable custom base map Metatron Discovery 22
  24. 24. Finally we met Metatron Discovery 23 UserInterfaceApplicationServerStorage Customized GeoJSON JSON/HTTP metatron Search Query JSON/HTTP Result Pivot Data JSON/HTTP Druid Query JSON/HTTP Result Data JSON/HTTP 16 basic chats + MAP metatron Search Query JSON/HTTP Files (CSV/XLS) Database (Hive/Druid/mySQL/…) Create data source Ingest data source with Geometry G
  25. 25. Use case 1– Find Police Incidents in San Francisco 24metatron Discovery
  26. 26. Use case 1 – Wrangled Dataset 25metatron Discovery Transform To WKT Union of 2 dataset
  27. 27. Use case 1 – Show Map 26metatron Discovery
  28. 28. Use case 1 – Get Insight 27metatron Discovery
  29. 29. To maintain relationship, Metatron Discovery 28 Improve Visualization Performance Using App dedicated Map View
  30. 30. Open-sourced Metatron Discovery 29
  31. 31. Metatron Discovery 30 Thank you!

×