1. Chetan Kumar S
Shivakumar.chetan@gmail.com
Augmented Reality: On new powerful
mobile computing platforms
Emerging trends in Mobile computing - From Mobile Application to Context
Aware Computing
MSRIT

2. Disclaimer
● The video and photos are copyright of respective owners
● Some of text are from various papers/report, copyright of
respective owners

3. Emerging trends in Mobile computing - From Mobile Application to Context Aware Computing 3
What is Augmented Reality(AR)

4. Emerging trends in Mobile computing - From Mobile Application to Context Aware Computing 4
What is Augmented Reality
● In a nutshell, Augmented Reality (AR) blends virtual objects into real
world.
● AR Systems must have following characteristics:
– Combines real and virtual
– Interactive and realtime
● Movie like avatar is it AR ?
– Registered in 3D
● Weather reporting in TV is AR ??

5. Emerging trends in Mobile computing - From Mobile Application to Context Aware Computing 5
What is augmented reality
● Devices may be
– Head mounted display
● Google glasses and beyond
– Mobile phones and tablet

6. Emerging trends in Mobile computing - From Mobile Application to Context Aware Computing 6
What can it do
● Interior Design
– See how the furniture fits in before you buy,
– Change orientation in AR before spending effort

7. Emerging trends in Mobile computing - From Mobile Application to Context Aware Computing 7
What can it do
● Product Information
– Allows customer better experience
– Interact with the product

8. Emerging trends in Mobile computing - From Mobile Application to Context Aware Computing 8
What can it do
● Medicine
– Display 3D model of CT image on actual part

9. Emerging trends in Mobile computing - From Mobile Application to Context Aware Computing 9
Why is it becoming important now
● Processing power
– Becoming more powerful and also lower cost

10. Emerging trends in Mobile computing - From Mobile Application to Context Aware Computing 10
Why is it becoming important now
● Everything is coming into mobile
High speed
CPU
High speed
GPU
Camera
High speed
data

11. Emerging trends in Mobile computing - From Mobile Application to Context Aware Computing 11
Mobile phone as platform
● Cheap
● Socially acceptable
● Well known
● Discrete
● Wide spread
● Intuitive to use

12. Emerging trends in Mobile computing - From Mobile Application to Context Aware Computing 12
AR Browsers

13. Emerging trends in Mobile computing - From Mobile Application to Context Aware Computing 13
AR technology
● AR technology involve two major parts:
● Computer vision tracking
– Track objects not location/context
● Indoor may be simple, outdoor is complex
– More useful than GPS/compass
● Computer graphics rendering
– Situated information visualization
– Multimedia

14. Emerging trends in Mobile computing - From Mobile Application to Context Aware Computing 14
Technology in AR: Components
● AR Hardware components
– Essentially three components
● A camera
● A Display
● A Processing unit
● The form factor can vary
– Mobile phone/Tablet
– Dedicated devices
● Like one used in NatGeo example

15. Emerging trends in Mobile computing - From Mobile Application to Context Aware Computing 15
Technology in AR: Tracking
● Types of AR
– Marker based tracking, normally using rectangular fiducial
marking
● Edge detection operation by thresholding
● Normalization using perspective transformation
● Pattern matching

16. Emerging trends in Mobile computing - From Mobile Application to Context Aware Computing 16
AR Technology: Tracking
● Types of AR
– Markerless Tracking
● Edge detection
approach
● 3D model analysis
approach
● Human model
approach

17. Emerging trends in Mobile computing - From Mobile Application to Context Aware Computing 17
AR Technology: Rendering
● What about cluttered images ?

18. Emerging trends in Mobile computing - From Mobile Application to Context Aware Computing 18
AR Technology: Rendering
● Image driven layout

19. Emerging trends in Mobile computing - From Mobile Application to Context Aware Computing 19
Few AR toolkits and SDK
ARTookKit
http://www.hitl.washington.edu/artoolkit/
ARToolKitPlus
https://launchpad.net/artoolkitplus
AndAR
http://code.google.com/p/andar/
Open TDL
https://github.com/zk00006/OpenTLD/wiki
vuforia
https://www.vuforia.com/

20. Emerging trends in Mobile computing - From Mobile Application to Context Aware Computing 20
Few AR toolkits and SDK
Software for Articulated Tracking
http://humim.org/tracker
Computer Vision
http://www.computervisiononline.com/software

21. Emerging trends in Mobile computing - From Mobile Application to Context Aware Computing 21
Design Challenges: AR on mobile
devices
● AR combines graphics, vision, interaction
● AR requires (unlike related disciplines)
– Strict real time operation
● Unlike Ubicomp or mobile information systems
– High spatial precision (1cm, 1 degree)
● Unlike location based services
– Robustness for operation by human user
● Unlike many computer vision methods in
automation etc.
●

22. Emerging trends in Mobile computing - From Mobile Application to Context Aware Computing 22
Design Challenges: AR on mobile
devices
● Mobile phone AR requires (in addition)
– No thin client!
– Same level of performance as desktop AR
● New algorithms must be orders of magnitude more
efficient
– No unrealistic assumptions about HW
– Unique form factor considerations
● Screen size
● Camera quality

23. Emerging trends in Mobile computing - From Mobile Application to Context Aware Computing 23
Research issues & challenges
● Tracking
– Increased robustness
● Automatic adaptation to changing conditions
● Use new hardware capabilities (GPU)
– Wider range of object types
● Less textured, general 3D objects
● Live object capture for tracking
– Tracking in unknown environments
● Underwater ? Night/day ? Rainy/Shiny day

24. Emerging trends in Mobile computing - From Mobile Application to Context Aware Computing 24
Research issues and challenges
● Models generation, capture and rendering
– Capture of appearance
● Image based rendering, cheaper end user
capturing
– Semantic information from user-input
● Enables more complex interactions with the
environment
– Can we inform the system if the object is a
rubber ball OR ceramic ball

25. Emerging trends in Mobile computing - From Mobile Application to Context Aware Computing 25
Thank you
● Questions