In 2005, we said:
“There could be a time where you open up the bonnet of your car, point your mobile phone at the engine to (a) identify which part is which and (b) call up instructions on how to remove and replace a particular part.”
And as we were watching Star Trek; something quite transformative was happening under our noses—fiction was becoming a reality—Augmented Reality (AR). As the complexity of products continually increases, customers are placing the burden to explain how to use, maintain, and service product at the feet of makers. The Maintenance Repair Overhaul (MRO) industry faces one of the biggest challenges with two-dimensional (2D) documentation—50 percent of every technician’s shift is actually spent on finding and reading procedural information. As a consequence, technicians lose focus, resulting in lesser efficiency and increasing cost for the companies. Imagine this scenario—you work in the documentation department of a ready-to-assemble furniture manufacturer. They will take that two dimensional instructions manual and try to mentally connect what is drawn on the black and white printed page with the pile of clamps, screws, and plywood sitting in front of them. Now, wouldn’t it be great if your 2D image suddenly became animated and grew into a three-dimensional (3D) image? Your customers could see exactly what the furniture piece would look like. AR and 3D are complementary technologies that futurists and technologists will be especially powerful in learning content and training—the future of technical documentation would be authored and delivered using an AR enhanced instruction manual. The combination of notes, animations and more not just on top of a digital 3D model, but overlaid on top of the real physical item is powerful. It cuts through any errors that can occur when individuals need to interpret documentation.
2. @nabayanroy #LavaCon
About the Speaker
Hello, I am Nabayan and I am not a on
.
I am on a journey with my , my
I am a ; an .
And today I want to share one such
& .
4. @nabayanroy #LavaCon
In this session, we will cover:
Photo credit: Edgaras Maselskis
The core
component
s of AR
The need to
change the
way certain
industries
provide
documentatio
n
The various
elements of
3D content
authoring &
the process
How you can
repurpose
Autodesk’s
CAD tools to
create 3D
content
Demo
5. “I believe that this continues
the trajectory, going from text
to photos to videos to fully
immersive scenes that you can
construct models and different
things instantaneously to show
people much richer
descriptions of what you’re
thinking or experiencing at that
point.”
- Mark Zuckerberg
@nabayanroy #LavaCon
6. Augmented Reality(AR) - Getting it Right
@Speaker Hashtag @LavaCon
This is AR This is Virtual Reality (VR)
@nabayanroy #LavaCon
13. Statistics
@Speaker Hashtag @LavaCon
According to
maintenanceassistant.co
m
Maintenance gets the
blame in more than 1/3rd
1/3rd of the cases which
involve aircraft equipment
equipment malfunctioning.
malfunctioning.
What’s more, when an
engine delay is
encountered, it is the
maintenance error which
accounts for 50% of its
As per the Aviation Safety
Database, 2014 turned
out to be an dangerous
year for the aviation
industry involving as
many as 80 incidents
including civilian and
military.
Experts state that
about 12% of air
accidents result due
to faulty maintenance
@nabayanroy #LavaConPhoto credit Alexey Lin
14. Incremental
releases, multiple
scrums
Maintenance personnel are under
tremendous pressure while
performing tasks because of various
factors involving time, efficiency, and
cost.
Technical
misunderstandings
relating to
maintenance
documentation
(manuals, job cards)
A Complex Quagmire
45% of every technician’s
shift is actually spent on
finding and reading
procedural and related
information.
@nabayanroy #LavaCon
37. Create Quick Response Codes or Markers
Can be scanned by mobile devices or wearables
Retrieves a URL or 3D object embedded within it
@nabayanroy #LavaCon
47. A trend towards mobile AR applications
A trend towards content repositories
A trend towards easy-to-use authoring tools for
AR
Why Consider the Future?
A trend towards easy-to-use engineering data
for content creation
A trend towards ubiquitous 3D content and
publishing channels
@nabayanroy #LavaCon
49. References and Credits
• Understanding Augmented Reality by Alan B. Craig
• Augmented Reality: Principles and Practice by Dieter
Schmalstieg; Tobias Hollerer
• Teaching and Learning in 3D Immersive Worlds by Robert
Sanders; Amy Cheney
• 3D models created using Autodesk Inventor, 123D Design,
Tinkercad, 3ds Max
• Autodesk Design Review
• Augmented Reality App: Augment
• Kean Walmsley and Vrok project
• Augmented Reality Stirling Engine By Sebastian Kerner
• BuildAR Viewer
@nabayanroy #LavaCon
Augmented Reality (AR) technology is a kind of human-computer interaction that superimposes the natural visual perception of a human user with computer-generated information (e.g. 3D models, annotation, and texts). AR presents this information in a context-sensitive way to the user. They are integrated into the environment by geometrical and photometrical registration and are manipulable in real-time.
The most common features of AR are:
combines real and virtual,
•
Interactive in real time
•
Registered in 3D
The three core components include:
1. Sensor(s) to determine the state of the physical world where the application is deployed.
Three primary categories of sensors are used in AR systems:
1. Sensors used for tracking
2. Sensors for gathering environmental information
3. Sensors for gathering user input
2. A processor to evaluate the sensor data, to implement the “laws of nature” and other rules of the virtual world, and to generate the signals required to drive the display
3. A display suitable for creating the impression that the virtual world and the real world are coexistent and to impinge on the participant’s senses such that he or she senses the combination physical world and virtual world
A Next-Generation Approach to Solving MRO Problems
The tool should be capable of mechanical design, product simulation, tooling creation, and design communication. Create illustration sets from 3D CAD files.
Simple creation of various Augmented Reality scenarios Standardized processing of CAD data and 3D models No time-consuming manual adaptations to CAD data
Create or Import your 3D CAD data. Visual content for AR applications can be categorized as three basic types:
■ Three-dimensional (3D) objects
■ Two-dimensional (2D) images (including text)
■ Visual elements that vary with time (animation, video clips, etc.)
Create or Import your 3D CAD data. The AR content developer has all of these options available as well. The content of any media, including AR, is directly informed by the goal of the creator. If the goal is to communicate factual information or physical attributes, then the content developer must choose representations to support that goal.
Interactive 3D view or virtual reality view of the procedure can be delivered. Add instructions and explanations as text develop exploded views , animations, and other stylized views of an assembly.
Annotations attached to CAD data (e.g. callouts, tools)
Text content, attributes, and properties are set and edited in the Format Text dialog box. Use the Format Text dialog box to:
Add or edit notes in drawings or text in sketches.
Specify text attributes for title blocks, borders, datum identifiers, and sketch symbols.
Add or edit text for dimensions, view labels, hole notes, hole tags, and chamfer notes.
Insert model parameter references in text. When property values change, text that contains the property updates with the new values.
Insert iProperty text property references in text. When the text property values change, text containing the text property updates with the new values. Available for all drawing text.
Develop exploded views, animations, and other views. Scene Graphs
Another concept important to the issue of 3D content is the idea of scene graphs. A scene graph is a data structure that provides information about the relationship between different graphical entities. For example, it provides information about the spatial relationship between entities as well as other relationships, such as the impact that moving one object has on moving another object. So if our virtual vase has virtual flowers in it, when I move the vase, the flowers move too.
The scene graph is expressed exactly as it sounds. It is a graph in which objects (or parts of objects) are nodes in the graph, and the relationships are expressed by the edges in the graph.
OpenSceneGraph (OSG) (http://www.openscenegraph.org/projects/osg) is a free, open source implementation of scene graph functionality that uses C++ and OpenGL. This allows the content creator to worry more about their content and less about low-level details of the graphics involved with the content. The OSG library has plug-ins that allow it to read from different common file formats. This allows you to build the scene graph from multiple sources and also to use the scene graph in different applications.
Find product specific information: • Scan QR code • Visual Search • Textual Search
Information is found quickly and presented clearly
To build an Augmented Reality system based on a fiduciary marker, you will need the following:
Marker or a pattern it two versions: printed as seen in Figure 1, and .patt file store in your computer.
Camera (connected to the computer)
Computer with running AR software
Output device: Computer monitor, projector or AR glasses.
Fiducial markers can be placed in an environment where they are stand alone or in conjunction with other types of real-world entities. In this scene, the markers are placed on a white cube as well as on a colorful background scene that contributes to the AR application. There is also a physical model of a dinosaur skeleton that is part of the content of this AR application
Find information for fault finding, MRO and operation through visual search. By pointing the camera of a mobile device at a specific location, the user can see the desired 3D illustration, text or animation; receiving the desired information.
allow to place life-size 3D models in your environment with or without the use of trackers.
Real time content at the point of action/performance increases technical dispatch and punctuality. The user can load the desired scene directly on his mobile by pointing his AR app on the part in the aircraft. You can use in-house app or any commercial app to load the AR content on your device.
Normally, a repairmen would tediously browse through the 2D manuals and compare the images in the manual with the actual parts and components. It was cumbersome and in-efficient. Now with 3D content, images and animation shows repairmen, which tools and work steps are required.