SlideShare a Scribd company logo
1 of 20
Introduction to  Vision based AR of Zenitum AlbertHeekwan Kim  Founder & CEO mail : albertk@zenitum.com twitter : @hkalbert
2 Contents Market Technologies Zenitum- zMART SDK
3 Market Mobile AR is popular, thanks to Smartphones Super popular in countries like Japan, Korea and US
4 Market The Future of Mobile AR will be BIG! say Research Firms around world  Clearly, $350 million in 2014 $732 million in 2014  $2.2 billion in 2015 according to ABI Research (Oct. 22, 2009) according to Juniper Research (Nov. 24, 2009) The Gazillion Dollar Pie! according to ARC Chart (Nov. 8, 2010)
5 Market Few Huddles to Overcome for increasing the market even bigger From “ARC Chart” Before full augmented reality can be achieved, several technical hurdles must be overcome. 1. The availability of standardized visual content will be a significant hurdle in providing robust AR experiences 2. Computer vision based object recognition and the accurate anchoring of content, must support real time processing - Peter Crocker,  lead analyst of ARC Chart Zenitum specializes Sharable  Standard  AR Contents Highly precise Vision based Tracking Highly precise Vision based Tracking
6 Technology AR Technology Spectrum focus on mobile platforms Pre-define NFT Instant NFT Space & Depth Square Markers time Vision AR (Includes real-time tracking) GPS AR Visual Search (not AR) Service oriented Core technology oriented
7 Technology Zenitum helps the market grow into a main stream industry Marketing Firms Core Technology Firms Core Tech. & Service Firm License New solutions Providing Solution s Applying  Existing solutions ,[object Object]
Biased on proprietary HW products
More contract works than solutions
Provide proprietary AR technologies
License new solutions from Zenitum
Creating initial buzz is possible
Can’t provide actual solutions
Difficult to apply business models
Develop AR Apps based SDK
CreateAR content with AR Platforms
Create new AR paradigm
Own solutions to address the needs
Deploying multiple business modelsfor multiple industry domains
SDK to 3rd party developers

More Related Content

Similar to Introduction to Zenitum's Vision based Mobile Augmented Reality Technology

콘텐츠 플랫폼 구조 분석
콘텐츠 플랫폼 구조 분석콘텐츠 플랫폼 구조 분석
콘텐츠 플랫폼 구조 분석
Jaehyeuk Oh
 
An Introduction to Game Programming with Flash: Kinect
An Introduction to Game Programming with Flash: KinectAn Introduction to Game Programming with Flash: Kinect
An Introduction to Game Programming with Flash: Kinect
Krzysztof Opałka
 

Similar to Introduction to Zenitum's Vision based Mobile Augmented Reality Technology (20)

Mobile Augmented Reality Development tools
Mobile Augmented Reality Development toolsMobile Augmented Reality Development tools
Mobile Augmented Reality Development tools
 
Hacking for salone: drone races
Hacking for salone: drone racesHacking for salone: drone races
Hacking for salone: drone races
 
콘텐츠 플랫폼 구조 분석
콘텐츠 플랫폼 구조 분석콘텐츠 플랫폼 구조 분석
콘텐츠 플랫폼 구조 분석
 
Hacking for Salone: Drone Races - Di Saverio; Lippolis - Codemotion Milan 2016
Hacking for Salone: Drone Races - Di Saverio; Lippolis - Codemotion Milan 2016Hacking for Salone: Drone Races - Di Saverio; Lippolis - Codemotion Milan 2016
Hacking for Salone: Drone Races - Di Saverio; Lippolis - Codemotion Milan 2016
 
Nizar Romdhane, ARM
Nizar Romdhane, ARMNizar Romdhane, ARM
Nizar Romdhane, ARM
 
Hung DO-DUY - Spikenet
Hung DO-DUY - Spikenet Hung DO-DUY - Spikenet
Hung DO-DUY - Spikenet
 
Google Glass Breakdown
Google Glass BreakdownGoogle Glass Breakdown
Google Glass Breakdown
 
Razum
RazumRazum
Razum
 
Designing Mobile AR Applications
Designing Mobile AR ApplicationsDesigning Mobile AR Applications
Designing Mobile AR Applications
 
Tobias Rothermel (pmd technologies): pmd ToF – the Swiss Army Knife of 3D Sen...
Tobias Rothermel (pmd technologies): pmd ToF – the Swiss Army Knife of 3D Sen...Tobias Rothermel (pmd technologies): pmd ToF – the Swiss Army Knife of 3D Sen...
Tobias Rothermel (pmd technologies): pmd ToF – the Swiss Army Knife of 3D Sen...
 
Aurea Vision & Aurea Consulting: technology proposal
Aurea Vision & Aurea Consulting: technology proposalAurea Vision & Aurea Consulting: technology proposal
Aurea Vision & Aurea Consulting: technology proposal
 
【1110ROS社群開講】ROS 2與DDS應用於工業領域_王健豪
【1110ROS社群開講】ROS 2與DDS應用於工業領域_王健豪【1110ROS社群開講】ROS 2與DDS應用於工業領域_王健豪
【1110ROS社群開講】ROS 2與DDS應用於工業領域_王健豪
 
Introduction to Extended Reality - XR
Introduction to Extended Reality - XRIntroduction to Extended Reality - XR
Introduction to Extended Reality - XR
 
IRJET - IoT based Surveillance Robot
IRJET -  	  IoT based Surveillance RobotIRJET -  	  IoT based Surveillance Robot
IRJET - IoT based Surveillance Robot
 
ARE 2011 AR Authoring
ARE 2011 AR AuthoringARE 2011 AR Authoring
ARE 2011 AR Authoring
 
FITC Bushra Mahmood
FITC Bushra MahmoodFITC Bushra Mahmood
FITC Bushra Mahmood
 
Develop store apps with kinect for windows v2
Develop store apps with kinect for windows v2Develop store apps with kinect for windows v2
Develop store apps with kinect for windows v2
 
Develop Store Apps with Kinect for Windows v2
Develop Store Apps with Kinect for Windows v2Develop Store Apps with Kinect for Windows v2
Develop Store Apps with Kinect for Windows v2
 
An Introduction to Game Programming with Flash: Kinect
An Introduction to Game Programming with Flash: KinectAn Introduction to Game Programming with Flash: Kinect
An Introduction to Game Programming with Flash: Kinect
 
Android Workshop Day 1 Part 2
Android Workshop Day 1 Part 2Android Workshop Day 1 Part 2
Android Workshop Day 1 Part 2
 

Recently uploaded

IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
Enterprise Knowledge
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
Joaquim Jorge
 

Recently uploaded (20)

How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
Tech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdfTech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdf
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 

Introduction to Zenitum's Vision based Mobile Augmented Reality Technology

  • 1. Introduction to Vision based AR of Zenitum AlbertHeekwan Kim Founder & CEO mail : albertk@zenitum.com twitter : @hkalbert
  • 2. 2 Contents Market Technologies Zenitum- zMART SDK
  • 3. 3 Market Mobile AR is popular, thanks to Smartphones Super popular in countries like Japan, Korea and US
  • 4. 4 Market The Future of Mobile AR will be BIG! say Research Firms around world Clearly, $350 million in 2014 $732 million in 2014 $2.2 billion in 2015 according to ABI Research (Oct. 22, 2009) according to Juniper Research (Nov. 24, 2009) The Gazillion Dollar Pie! according to ARC Chart (Nov. 8, 2010)
  • 5. 5 Market Few Huddles to Overcome for increasing the market even bigger From “ARC Chart” Before full augmented reality can be achieved, several technical hurdles must be overcome. 1. The availability of standardized visual content will be a significant hurdle in providing robust AR experiences 2. Computer vision based object recognition and the accurate anchoring of content, must support real time processing - Peter Crocker, lead analyst of ARC Chart Zenitum specializes Sharable Standard AR Contents Highly precise Vision based Tracking Highly precise Vision based Tracking
  • 6. 6 Technology AR Technology Spectrum focus on mobile platforms Pre-define NFT Instant NFT Space & Depth Square Markers time Vision AR (Includes real-time tracking) GPS AR Visual Search (not AR) Service oriented Core technology oriented
  • 7.
  • 9. More contract works than solutions
  • 10. Provide proprietary AR technologies
  • 11. License new solutions from Zenitum
  • 12. Creating initial buzz is possible
  • 14. Difficult to apply business models
  • 15. Develop AR Apps based SDK
  • 16. CreateAR content with AR Platforms
  • 17. Create new AR paradigm
  • 18. Own solutions to address the needs
  • 19. Deploying multiple business modelsfor multiple industry domains
  • 20. SDK to 3rd party developers
  • 21.
  • 22. 9 Zenitum - zMART Zenitum Mobile AR Tool Mobile AR Software Developer Kit Android OS 2.1/2.2 iOS 3.1+/4.x zMART Applications Contents Generation & Interaction Libraries (Custom Logic Support) Real-time AR Object Loader & Renderer (2D/3D/Video/Audio/Animated/Text) zMART Low-Level API zVAR SDK for iOS (zFT) zVAR Pro SDK for Android (zFT2) zVAR SDK for Android (zFT) zVAR Pro SDK for iOS (zFT2) zNET for AR (Remote Data Accessing API) zGAR (Location-Based App. Logic) Platform-Independent AR Core Libraries (zFT / zFT2) Platform-Dependent I/O Libraries
  • 23. 10 Zenitum - zMART Overview - Support rich AR experience using “zFT” core library based SDK - Platform-independent Natural-Feature Detecting & Tracking library - Platform-dependent input/output library for Core AR module - Dynamic 2D/3D contents loading & rendering with custom AR scene - Multiple platform supports (iOS, Android, WM, Symbian) - Compatible / Consistent features across platforms (including PCs) - APIs & Application Templates for developers
  • 24.
  • 26. Up to 20 f/s tracking
  • 27. Supports PC, Mac, iOS4, Android, WM, Symbian
  • 28. Min. requirement: ARM 11 core with 500MhzUp to 20 f/s of AR tracking on pre-defined targets Less than inch level of precise tracking available! zFT–1 AR Tracking Engine
  • 29. 12 Zenitum - zMART zVAR – zFT1 Pre-defined image target tracking - Texture/Image based Natural-Feature Detecting & Tracking : zFT Library + Natural marker generator (Off-line) - Support Video overlay or See-Through AR Object : OpenGL-ES + SceneGraph based renderer - Robust multiple tracking with pose estimation : Concurrent tracking with more than 5 targets - Robust tracking against rotation/moving/zooming/multi-resolution of natural target - Customizable contents definition for advanced scene rendering and interaction using XML and Lua script engine - Native AR Object format from conversion of various general 3D content format : 3DS, OBJ, MD2 - Various audio format support for rich content interaction : MP3, WAV, OGG - Platform : iPhone 3GS/4G (iOS 4.x), Android (OS 2.1/2.2) - Fast target detecting time : less than 0.5 seconds (depends on natural features of target) - Maximum distance between device and target to detecting : 80 ~ 90 cm - Robust detecting against occlusion : more than 60% of target - Natural marker generation : multi-resolution of source image (at least 320x240 pixels), 10~20 minutes - Application development : Combination of zFT core library and application templates (for iOS and Android)
  • 30.
  • 31. Precise natural feature tracking engine
  • 32. Up to 20 f/s tracking
  • 33. Supports PC, Mac, iOS4, Android, WM, Symbian
  • 34. Min. requirement: ARM 11 core with 700MhzNo pre-defined targets needed. Just take photos Instant AR contents tagging and sharing is possible! zFT–2 AR Tracking Engine 13
  • 35. 14 Zenitum - zMART zVAR – zFT2 Instant target information generation - Texture/Image based Natural-Feature Detecting & Tracking : zFT2 Library + Real-time natural marker generator - Integrated with powerful high level API for 2D/3D visualization engine - Support Video overlay or See-Through AR Object : OpenGL-ES + modular 2D/3D renderer - Robust multiple tracking with pose estimation : Concurrent tracking with more than 5 targets - Robust tracking against rotation/moving/zooming/multi-resolution of natural target - Advanced contents definition for AR scene rendering and interaction using XML - Support general 3D content formats for AR Object : .X, 3DS, OBJ, MD2 from general tool (e.g 3DS Max) - Animated 3D for AR Object using skinned-mesh type : .X format with advanced content engine - Various audio format support for rich content interaction : MP3, WAV, OGG - Platform : iPhone 3GS/4G (iOS 4.x), Android (OS 2.1/2.2) - Fast target detecting time : less than 0.5 seconds (depends on natural features of target) - Maximum distance between device and target to detecting : 80 ~ 90 cm - Robust detecting against occlusion : more than 60% of target - Natural marker generation : multi-resolution of source image (at least 320x240 pixels), instant generating & registration from device’s camera input
  • 36. 15 Zenitum - zMART zMART Contents Supported content types
  • 37. 16 Zenitum - zMART class CZFTENGINE { void InitEngine(const unsigned int n=1); void GetProjectionMatrix(float pMatrix[16]); boolLoadMarker(const std::string &pFilename); boolFindMarker(const void* pSrcImage,floatfCameraMatrix[16]); void Render(); void Destroy(); … }; Initialize Engine Get Camera Projection Matrix Load Marker Find Marker Rendering Object
  • 38.
  • 40.
  • 41. 3D
  • 42. Video, Audio. etcMarker Detecting & Tracking Yes No End
  • 43. 18 Zenitum - zMART Supported Game Engines Future support
  • 44.
  • 45. Open Release (Jan. 2011 ~) - zFT-1
  • 46.
  • 47. D-Track (Space & Depth Tracker) - http://www.youtube.com/watch?v=ibWnY9ZXKzk - http://www.youtube.com/watch?v=7jUaxlS52tU
  • 48. 2D Video AR Advertisement on ARAD- http://www.youtube.com/watch?v=O4QZv_RVtsc (on Newspapers) - http://www.youtube.com/watch?v=gMmCo2cX5lM (on Street Billboards) - http://www.youtube.com/watch?v=GfxcG-l8F64 (on Beer Cans) - http://www.youtube.com/watch?v=rf8-rP56wwg (on Streets and combination with GPS AR)