This document discusses augmented reality and the ARToolkit library. It begins with definitions of augmented reality and its challenges, such as camera tracking, handling occlusions, and illumination consistency. It then discusses augmented reality platforms for Android, including AndAR and NyARToolkit. The document outlines the system requirements and additional requirements for LG Optimus 3D devices. It provides an overview of the ARToolkit library, including its features, architecture, development principles, and limitations.

1. AUGMENTED REALITY AND 3D By Ivan Trajkovic and DamirBurazerovic

2. INDEX What is Augmented Reality ? Problems in Augmented Reality Augmented Reality on Android platform Development platform and system requirements LG Optimus 3D additional requirements ARToolKit

3. WHAT IS AUGMENTED REALITY (AR) ? It is a variation of Virtual Environments (VE) It is a system that supplements the real world with computer-generated virtual objects which seem to coexist in the same space and present the following properties: It combines real and virtual objects in real environment It executes interactively in real time It lines up real and virtual objects It is applied to all senses of the user

4. PROBLEMS IN AUGMENTED REALITY There are three major challenges associated with AR: CAMERA TRACKING HANDLING OCCLUSIONS ILLUMINATION CONSISTENCY

5. CAMERA TRACKING Fig 1: the Simple Program Running a virtual block aligned with a real mark Fig 2: Threshold Video Image with Identified Pattern

6. HANDLING OCCLUSIONS Problem: real objects are in front of the virtual objects in the scene

7. ILLUMINATION CONSISTENCY Three frames from a 3 hour long sequence showing virtual sculpture rendered into scene with consistent illumination.

9. DEVELOPMENT PLATFORM AND SYSTEM REQUIREMENTS Multiplatform (Linux, MacOS and Windows) Windows XP (32-bit), Vista (32- or 64-bit), or Windows 7 (32- or 64-bit) Mac OS X 10.5.8 or later (x86 only) Linux (tested on Ubuntu Linux, Lucid Lynx) Android SDK (http://developer.android.com/sdk/index.html) Eclipse IDE ADT Plugin for Eclipse

10. LG OPTIMUS 3D ADDITIONAL REQUIREMENTS Real3D SDK ( http://developer.lgmobile.com/sdk/android/repository.xml) What LG Real3D provides Real3D API that helps you to control the display hardware block interliving Real3D API demos The emulator that enables you to test your 3D applications with red-cyan glasses

11. WHAT IS Real3D?

12. HOW Real3D WORKS? Source: LG Real3D SDK

13. ARToolKit Software library for building AR applications. Originally developed by Dr. Hirokazu Kato. Human Interface Technology Laboratory (HIT Lab) at the University of Washington, HIT Lab NZ at the University of Canterbury, New Zealand, ARToolworks, Inc, Seattle.

14. ARToolKit Uses computer vision algorithms to solve AR tracking problem. Calculate the real camera position and orientation relative to physical markers in real time.

15. ARToolKitFEATURES Multiplatform (Linux, MacOS and Windows) Single camera tracking using any black square. Distributed with complete source code. Fast rendering based on OpenGL. Simple and modular API (in C and C++). A complete set of samples and utilities.

16. ARToolKit FEATURES OpenSource with GPL license for non- commercial usage. Commercial licenses are administered by ARToolworks, Inc., Seattle, WA, USA.

17. ARToolKit ARCHITECTURE ARToolKit has three basic modules: Scene Capturer 2. Augmented Reality (AR) 3. Augmented Image Generator

18. HOW DOES ARToolKit WORK? Source: http://www.hitl.washington.edu/artoolkit/documentation/userarwork.htm

19. LIMITATIONS Virtual objects appear only when complete markers are visible. Size of virtual objects Movement of virtual objects If users cover up part of the pattern with their hands or other objects the virtual object will disappear

20. LIMITATIONS Range issues Pattern complexity Marker orientation relative to the camera Lighting conditions

21. ARToolKit – DEVELOPMENT PRINCIPLES There are two stages when developing an ARToolKitapplication: 1. Writing the application. 2. Training image-processing routines on markers that will be used in the application.

22. ARToolKit – Development Principles

23. LITERATURE Augment Reality (Edited by SohaMaad), 2010 Intech ARToolKit http://www.tinmith.net/lca2004/ARToolkit/ARToolKit2.33doc.pdf Real-Time Occlusion Handling in Augmented Reality Based on an Object Tracking Approach Authors: Yuan Tian, Tao Guan* and Cheng Wang http://www.mdpi.com/1424-8220/10/4/2885/pdf

24. LINKS ARToolKit http://www.hitl.washington.edu/artoolkit/ ARToolkitPro for Android http://www.artoolworks.com/support/library/ARToolKit_Professional ARToolkitPlus 2.1.1 http://handheldar.icg.tugraz.at/artoolkitplus.php NyARToolkit for Android http://sourceforge.jp/projects/nyartoolkit/releases/?package_id=7605