These are slides from the Defence Industry event orgranized by the Australian Research Centre for Interactive and Virtual Environments (IVE). This was held on April 18th 2024, and showcased IVE research capabilities to the South Australian Defence industry.

1. Australian Research Centre for
Interactive and Virtual Environments
Positively changing the world through changing people’s realities
https://unisa.edu.au/ive/

2. Acknowledgment of Country
We acknowledge this land that we meet on today is the
traditional lands of the Kaurna people and that we
respect their spiritual relationship with their country. We
also acknowledge the Kaurna people as the custodians
of the Adelaide region and that their cultural and
heritage beliefs are still as important to the living
Kaurna people today.

3. Darryn Smart
Acting Chief, Sensors and Effectors Division,
Defence Science and Technology Group

4. Darryn Smart
Acting Chief Sensors & Effector Division
Defence Science & Technology Group
Edinburgh SA, Australia
DSTG, UniSA & Industry – Working Together to ensure
Australia maintains a Tactical Advantage
18th April 2024

5. Defence Strategic Review 2023
“DSTG and ASCA to enable
research and industry sectors
to focus (our) work on
development of advanced and
asymmetric capabilities in
key technology areas.”

6. Defence Science & Technology Group
Group Purpose Statement
To develop innovative technologies that
can be delivered by industry and
transitioned into Defence capability
To shape innovation, science and
technology within Defence and across
the nation
Defence Innovation, Science &
Technology Strategy

7. DAIRNet

8. SCHED

9. ANFF-SA

10. Foundational
Collaboration & Partnering
IS&T
Capabilities
Workforce
Advanced & Asymmetric
Capabilities

11. Partnering to
achieve
Capability
Case Example:
REDWING

12. Thank You

13. IVE Overview

18. A world leader in AR & VR
technologies
• Leaders in Australia for AR and VR research
• #3 in the world for the number of AR publications (2 x MIT)
• A unique alignment of computer science, neuroscience,
art, architecture, and design
• Focusing on transforming industry and solving large-scale
societal challenges

19. IVE Leadership Team
Professor
Bruce Thomas
Founding Director
Professor
Mark Billinghurst
Director
Professor
Ning Gu
Deputy Director
Professor
Ian Gwilt
A/Professor
Ross Smith
Dr Joanne
Zucco
Dr Peter
Schumacher
Dr Gun Lee Dr Deirdre
Feeney
Dr Julie Nichols
Professor
Ina Bornkessel-
Schlesewsky
A/Professor
Erik Champion

20. Research Groups
Membership totals over 130 people including academics, researchers and PhD students
distributed over multiple campuses

21. Facilities
A suite of mixed reality visualisation
environments enabling up to full scale simulation

22. Research Capabilities
• Human Computer Interaction
• Data Visualisation Techniques
• Enhancing Health & Medical Procedures
• Real-time Empathic Collaboration
• Design & Visualisation of Architecture
• Human Centred Industrial Design
• Sensory Data Collection and Analysis
• Cognitive Neuroscience and Psychology
• Human & Computing Creative Nexus

23. Application Areas
• Education
• Defence
• Manufacturing
• Agriculture
• Design
• Health
• Creative
• Urban design

24. International Collaborations
Academia Industry

25. ARIVE Network
Australasian Researchers in Interactive and Virtual Environments
Collecting together all the best AR/VR researchers in Australia and NZ
- 9 institutions, 260 researchers, > 30 million USD in funding
Industry research consortium

26. Key Research Groups
• Studio for Complex Human Environment Design (SCHED)
• Wearable Computing
• Empathic Computing
• Cognitive Neuroscience
Contributing to the Defence Sector

27. Studio for Complex Human
Environment Design (SCHED)

28. Complex Space Design
Applying human-centred design practices to the design of complex, confined,
high-stakes, high-intensity habitable spaces
Submarine Habitability Design
• Control room
• Sleeping berths
• Galley

29. Complex Space Design
Command and Control Rooms
• S&T support from Agile C2 STaR Shot
• Dr Alexander Kalloniatis
• Plan MURA
• Supporting future designs of the ops room
• Preparing the way for integrating capabilities from diverse
agencies
• Human-centred design practices for the application of ISO 11064
• Anticipation and integration of new technologies
Applying human-centered design principles to the industrial design of control rooms

30. Complex Space Design
RAES – Real Anthropometry Experience System
A tool that uses:
• Body scanning
• Games engines
• VR
• DHMs
So, designers can:
• Easily manipulate DHMs
• Export them to CAD to support the design
• Gain empathic experiences
Developing tools for the application of Digital Human Manikins for design

31. Complex Space Design
Developing tools for the application of Digital Human Manikins for design
RAES – Real Anthropometry Experience System
A tool that uses:
• Body scanning
• Games engines
• VR
• DHMs
So, designers can:
• Easily manipulate DHMs
• Export them to CAD to support the design
• Gain empathic experiences

32. Wearable
Computer
Lab

33. Immersive Visualisation

34. Immersive Visualisation Training Support Systems
Visual Analytics

35. Training Support Systems
Immersive Visualisation Hardware prototyping
Robotics interaction
Visual Analytics
Digital Twins
Collaborative
Sensemaking

36. Visualisation – “help people understand
the world by revealing and
communicating insights within the data
around us.”

37. Visualisation – “help people understand
the world by revealing and
communicating insights within the data
around us.”

38. Narrative Visualisation
• Data as a narrative to support
mental models
• Combine rich data sources
into a single cohesive view
Exposing the story behind
complex large data

39. Immersive Analytics
• Directly touch and grab data
• Exceed the limits of a desktop monitor
• Natural collaborative environment
Intuitively exploring complex data relationships
through immersive visualisation techniques

40. Immersive Digital Twins
• Immersive modelling of complex platforms
• One-to-one mapping of CAD models
• Collaborative training and familiarisation
• Visualise real-time data from the platform
Using digital twins for training and maintenance in
difficult or high-risk environments

41. Empathic Computing

42. Empathic Computing
Empathy is ...
“Seeing with the eyes of another,
listening with the ears of another,
and feeling with the heart of another.”
- Alfred Adler (1870~1937)
Experiencing the reality of another.
Using AR/VR/MR technology to develop systems that support deeper understanding

43. Immersive Remote Collaboration
AR/VR/MR technology to enable technical support from a remote expert

44. Asynchronous Spatial Collaboration
AR technology to capture and replay expert’s operation for training and shift work

45. Shared Emotional Understanding
Physiological sensors to capture and share emotional status for personal connection
Physiological sensors Shared data visualisation
Enhanced emotional cues

46. Empathic Computing
• Experience Capture
• 360/3D AR/VR/MR teleconferencing
• Expert demonstration capture and replay
• Natural Interaction
• Augmented non-verbal communication cues
• Adaptive multi-scale avatars
• Implicit Understanding
• Sharing emotion with physiological sensors
• EEG hyper-scanning for MR collaboration
Immersive Collaboration and Shared Experience across Space and Time

47. Cognitive Neuroscience

48. Cognitive Neuroscience
Online measurement of cognitive load
We can tell how hard brains are working
Training and human performance
Improving the performance of high performers
Team performance in naturalistic settings with real-world
tasks
Measurement of brains where it's most useful
Inter-brain synchrony
Understanding the mechanisms of collaboration
Your brain and how to use it

49. Online measurement of cognitive load

50. Training and human performance

51. Team performance in naturalistic settings

52. Team performance in naturalistic settings
• Resting-state EEG predicts performance
• Resting-state EEG can reliably differentiate between
members within a dyad
• Task-related theta and alpha activity during easy training
tasks predicted later performance on complex training to a
greater extent than prior behaviour

53. Engaging with IVE

54. Engaging with IVE
A range of industry engagement and partnership options:
Student Sponsorship
• Final year projects, PhD support, industry placement
Joint co-funded research
• ARC linkage grants, Defence Innovation Partnership Grants,
ASCA Emerging Disruptive Technologies bids
Fully-funded projects
• Targeted research, commercialisation
Strategic Partnerships
• ARIVE membership, long term initiatives

55. Example: Meta & CSIRO
• A cohort-based, industry-driven, multi-disciplinary graduate program
• Provide entrepreneurial thinking and skills in AI and emerging tech
• Meta supported cohort on XR Health and Safety
 3-year project
 3 Universities (UniSA, UQ, Monash)
 7 PhD, 6 Masters, 21 Honours students
 $200K/year investment (1/3 the total cost)
 Meta commercialises research outcomes
CSIRO Next Generation Graduate Program

56. Demonstrations
Research Capability Demonstration
Cognitive Neuroscience Mind Reading for Beginners
Collaborative Systems Shared Sphere
ARTips
Data Analytics Tilt-5 Collaborative Visualisation
Data Visualisation Narrative Visualisation
Human Centred Design Real-Time Posing & Capturing of Manikins
Human Robot Interaction CLIVE the Robotic Dog
VR Training Roxplorer Digital Twin
Visualisation Ozmap

57. Thank You
Headquarters
Australian Research Centre for Interactive and Virtual Environments
UniSA Mawson Lakes Campus
Mawson Lakes, South Australia 5095 Australia
IVECentre@unisa.edu.au