Windows Mixed Reality - DDD Reading 2018

•

1 like•1,338 views

This document discusses analyzing visual content using HoloLens, computer vision APIs, Unity and the Mixed Reality Toolkit. It introduces mixed reality as existing on a spectrum between physical and digital reality, with virtual reality and augmented reality on that spectrum. It describes some input methods for mixed reality applications like gaze, gesture, voice and motion control. It also lists some Microsoft tools and resources for computer vision and mixed reality development like the Windows ML APIs, Mixed Reality Toolkit, Cognitive Services and Microsoft Ignite.

Technology

Analysing visual content using HoloLens,
Computer Vision APIs,
Unity and the Mixed Reality Toolkit
Davide Zordan
B: https://www.davidezordan.net
E: mail@davidezordan.net
T: @DavideZordan

Davide Zordan
Software Engineer
MCSD, MCSA, MS, MCP
Xamarin Certified Mobile Developer
Microsoft MVP (2009-2014)

MIXED REALITY
VIRTUAL REALITYPHYSICAL REALITY

PHYSICAL
REALITY
DIGITAL
REALITY
MIXED REALITY (MR)
WINDOWS MIXED REALITY HOLOGRAPHIC DEVICES (SEE-THROUGH)
WINDOWS MIXED REALITY IMMERSIVE DEVICES (OPAQUE)
AR
TODAY
VR
TODAY
Physical - Digital Reality Spectrum
*The term mixed reality was originally introduced in a 1994 paper by Paul Milgram and Fumio Kishino, "A Taxonomy of Mixed Reality Visual Displays."

Source: https://www.microsoft.com/en-us/research/blog/microsoft-hololens-facilitates-computer-vision-research-by-providing-access-to-raw-image-sensor-streams-with-research-mode/

World coordinates
Spatial mapping
Spatial audio

Mixed Reality Academy
https://docs.microsoft.com/en-us/windows/mixed-reality/academy
Mixed Reality Toolkit
https://github.com/Microsoft/MixedRealityToolkit-Unity
Cognitive Services
https://azure.microsoft.com/en-gb/services/cognitive-services/
Microsoft Ignite
https://8gportalvhdsf9v440s15hrt.blob.core.windows.net/ignite2017/session-
presentations/BRK2404.PPTX

“Any sufficiently advanced technology is
indistinguishable from magic”
Arthur C. Clark, Profiles of the future, 1961

Thanks
Davide Zordan
B: https://www.davidezordan.net
E: mail@davidezordan.net
T: @DavideZordan

Similar to Windows Mixed Reality - DDD Reading 2018

Presented at FITC's Spotlight AR/VR event on Dec 2, 2017. More info at www.fitc.ca Margaryta Ostapchuk Microsoft Overview Windows Mixed Reality opens a window into the virtual world, right from Windows Desktop. This new platform enables developers to create rich, immersive experiences, using a variety of supported headsets. In this talk, you will learn about how you can get started developing for Windows Mixed Reality. Margaryta will discuss the device and platform technologies. She will walk through the emerging development trends and look at some resources that can help kick-start your development journey. Finally, Margaryta will wrap it all up with a look at the development workflow, with a device demo that will inspire you to take the leap into Windows Mixed Reality. Objective Learn more about Windows Mixed Reality and how you can leverage frameworks to create immersive experiences Target Audience General VR/AR/MR developers Assumed Audience Knowledge Some VR development experience Five Things Audience Members Will Learn What Windows Mixed Reality is and its importance Device technologies and specification Emerging trends and techniques Challenges in development and how to avoid them Development workflow

Developing Immersive Experiences With Windows Mixed Reality

FITC

A talk from the Life Track at AWE USA 2017 - the largest conference for AR+VR in Santa Clara, California May 31- June 2, 2017. Matt Zeller (Microsoft): Windows Mixed Reality: Holograms to VR, and Everything in Between Mixed reality covers a spectrum of experiences from traditional AR to VR. Come learn about Microsoft’s mixed reality strategy, and how you can create experiences that cover the entire spectrum using one platform and one set of tools. http://AugmentedWorldExpo.com

Matt Zeller (Microsoft): Windows Mixed Reality: Holograms to VR, and Everythi...

AugmentedWorldExpo

Slides from my presentation at DDD conference 2019 https://www.developerdeveloperdeveloper.com. Abstract: We all see the cool demos of how augmented and virtual reality are going to be the future of our interaction with devices, but it often feels like there’s a significant barrier to getting started in building these types of apps. This session is here to help. If you’ve ever thought about developing for Oculus Rift, HTC Vive or the Windows Mixed Reality headsets, but haven’t known where to start, this is the session for you. At DDD, I will present what I learned building a small game, set in a mysterious dungeon using Unity and the SteamVR plugin. We'll explore how to import assets from the Unity store, how to implement locomotion techniques and interactions using the motion/touch controllers, including some tips for optimising performance and avoid motion sickness. Come along, there’ll be .NET code, demos and we’ll have some fun looking at how you can get started on your first VR/AR project.

Getting started with Unity and AR/VR for the .NET developer

Davide Zordan

CodeMash – VR/AR talk

Amanda Lange

Augmented reality the evolution of human computer interaction

Bello Abubakar

Tijdens deze sessie nemen we je mee in de wereld van Augmented Reality. Ben je benieuwd welke markten al hiermee aan de slag zijn gegaan? De HoloLens van Microsoft gaat verder dan Google Glass en is een ander product dan de vr-bril. Deze zelfstandige computerbril projecteert hologrammen in de echte fysieke wereld en integreert de virtuele wereld met de echte wereld. Ben je een C# ontwikkelaar, Unity game designer, IT-architect, consultant, relatiemanager of gewoon een gadgetliefhebber die meer wil weten over de HoloLens? Dan is deze sessie iets voor jou!

SPSNL17 - Introductie HoloLens - Augmented Reality in 2017 - Michiel Hamers

DIWUG

BIMO Forum 2017 - Présentation Microsoft HoloLens

Artionet Web Agency

Slides from my session at the Global XR Conference. Nov 2022. Abstract: Augmented and Virtual Reality technologies allow advanced interactions in three-dimensional space by projecting digital content into users' field of view using dedicated opaque and see-through head-mounted displays. At the Global XR Conference 2022, I will show what I have learned by building a software prototype combining AR and VR to transmit in real-time a three-dimensional video. Point clouds were captured using a mobile depth camera and transmitted to a Virtual Reality device (Meta Quest 2) using a WebSocket server hosted on the Microsoft Azure platform. Come along, there will be Unity demos, and we will have some fun looking at building a distributed system integrating holograms in a Virtual Reality experience.

Getting Started with Point Clouds Visualisation and AR/VR

Davide Zordan

Etna dev 2016 - Introduction to Mixed Reality with HoloLens

Matteo Valoriani

Technical seminar report

Sumit Kumar Sharma

weAR MARKOVERSE eng 2021

Emanuele Borasio

Virtual reality Presentation

Anand Akshay

Vitual Reality

SiliconExpert Technologies

Mixed Reality blends people, places and things across a full spectrum ranging from the real-world to digital virtual worlds. This session is your introduction to building 3D applications and games for Windows Mixed Reality using C#, Visual Studio and Unity. We’ll start with a quick recap of Mixed Reality, the HoloLens device, immersive headsets and the Universal Windows Platform (UWP), and talk about interacting with holograms using gaze, gestures and voice. Next, we’ll dive into building 3D apps for Windows Mixed Reality in Unity with C#, using the Mixed Reality Toolkit for Unity, exporting our project to Visual Studio and running it on either a HoloLens device, an immersive Mixed Reality headset or the HoloLens Emulator. Science fiction becomes science fact, and Unity & UWP developers are at the front of this revolution. Come learn how to get started and build your journey into a world of holograms you create.

Building Holographic & VR Experiences Using the Mixed Reality Toolkit for Unity

Nick Landry

MixedReality.pptx

smilesmorales

Virtual Reality

Akash Bhokare

2014 COSC 426 Lecture 2: Augmented Reality Technology

Mark Billinghurst

Getting started with Unity and AR/VR for the .NET developer... Reloaded!

Davide Zordan

Mixed Reality Development Overview

Nick Landry

VRCAI 2011 Billinghurst Keynote

Mark Billinghurst

Similar to Windows Mixed Reality - DDD Reading 2018 (20)

Developing Immersive Experiences With Windows Mixed Reality

Matt Zeller (Microsoft): Windows Mixed Reality: Holograms to VR, and Everythi...

Getting started with Unity and AR/VR for the .NET developer

CodeMash – VR/AR talk

Augmented reality the evolution of human computer interaction

SPSNL17 - Introductie HoloLens - Augmented Reality in 2017 - Michiel Hamers

BIMO Forum 2017 - Présentation Microsoft HoloLens

Getting Started with Point Clouds Visualisation and AR/VR

Etna dev 2016 - Introduction to Mixed Reality with HoloLens

Technical seminar report

weAR MARKOVERSE eng 2021

Virtual reality Presentation

Vitual Reality

Building Holographic & VR Experiences Using the Mixed Reality Toolkit for Unity

MixedReality.pptx

Virtual Reality

2014 COSC 426 Lecture 2: Augmented Reality Technology

Getting started with Unity and AR/VR for the .NET developer... Reloaded!

Mixed Reality Development Overview

VRCAI 2011 Billinghurst Keynote

Recently uploaded

The value of a flexible API Management solution for Open Banking Steve Melan, Manager for IT Innovation and Architecture - State's and Saving's Bank of Luxembourg Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - The value of a flexible API Management solution for O...

apidays

EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER

MadyBayot

ICT role in 21st century education and its challenges

rafiqahmad00786416

Six Myths about Ontologies: The Basics of Formal Ontology

johnbeverley2021

MINDCTI Revenue Release Quarter One 2024

MIND CTI

presentation ICT roal in 21st century education

jfdjdjcjdnsjd

Keynote 2: APIs in 2030: The Risk of Technological Sleepwalk Paolo Malinverno, Growth Advisor - The Business of Technology Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...

apidays

Vector Search -An Introduction in Oracle Database 23ai.pptx

Remote DBA Services

Following the popularity of “Cloud Revolution: Exploring the New Wave of Serverless Spatial Data,” we’re thrilled to announce this much-anticipated encore webinar. In this sequel, we’ll dive deeper into the Cloud-Native realm by uncovering practical applications and FME support for these new formats, including COGs, COPC, FlatGeoBuf, GeoParquet, STAC, and ZARR. Building on the foundation laid by industry leaders Michelle Roby of Radiant Earth and Chris Holmes of Planet in the first webinar, this second part offers an in-depth look at the real-world application and behind-the-scenes dynamics of these cutting-edge formats. We will spotlight specific use-cases and workflows, showcasing their efficiency and relevance in practical scenarios. Discover the vast possibilities each format holds, highlighted through detailed discussions and demonstrations. Our expert speakers will dissect the key aspects and provide critical takeaways for effective use, ensuring attendees leave with a thorough understanding of how to apply these formats in their own projects. Elevate your understanding of how FME supports these cutting-edge technologies, enhancing your ability to manage, share, and analyze spatial data. Whether you’re building on knowledge from our initial session or are new to the serverless spatial data landscape, this webinar is your gateway to mastering cloud-native formats in your workflows.

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Safe Software

Corporate and higher education. Two industries that, in the past, have had a clear divide with very little crossover. The difference in goals, learning styles and objectives paved the way for differing learning technologies platforms to evolve. Now, those stark lines are blurring as both sides are discovering they have content that’s relevant to the other. Join Tammy Rutherford as she walks through the pros and cons of corporate and higher ed collaborating. And the challenges of these different technology platforms working together for a brighter future.

Corporate and higher education May webinar.pptx

Rustici Software

Understanding the FAA Part 107 License ..

Christopher Logan Kennedy

Retrieval augmented generation (RAG) is the most popular style of large language model application to emerge from 2023. The most basic style of RAG works by vectorizing your data and injecting it into a vector database like Milvus for retrieval to augment the text output generated by an LLM. This is just the beginning. One of the ways that we can extend RAG, and extend AI, is through multilingual use cases. Typical RAG is done in English using embedding models that are trained in English. In this talk, we’ll explore how RAG could work in languages other than English. We’ll explore French, Chinese, and Polish.

Introduction to Multilingual Retrieval Augmented Generation (RAG)

Zilliz

The Good, the Bad and the Governed - Why is governance a dirty word? David O'Neill, Chief Operating Officer - APIContext Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...

apidays

Effective data discovery is crucial for maintaining compliance and mitigating risks in today's rapidly evolving privacy landscape. However, traditional manual approaches often struggle to keep pace with the growing volume and complexity of data. Join us for an insightful webinar where industry leaders from TrustArc and Privya will share their expertise on leveraging AI-powered solutions to revolutionize data discovery. You'll learn how to: - Effortlessly maintain a comprehensive, up-to-date data inventory - Harness code scanning insights to gain complete visibility into data flows leveraging the advantages of code scanning over DB scanning - Simplify compliance by leveraging Privya's integration with TrustArc - Implement proven strategies to mitigate third-party risks Our panel of experts will discuss real-world case studies and share practical strategies for overcoming common data discovery challenges. They'll also explore the latest trends and innovations in AI-driven data management, and how these technologies can help organizations stay ahead of the curve in an ever-changing privacy landscape.

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

TrustArc

Elevate Developer Efficiency & build GenAI Application with Amazon Q

Bhuvaneswari Subramani

AWS Community Day CPH - Three problems of Terraform

Andrey Devyatkin

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving

Edi Saputra

💥 You’re lucky! We’ve found two different (lead) developers that are willing to share their valuable lessons learned about using UiPath Document Understanding! Based on recent implementations in appealing use cases at Partou and SPIE. Don’t expect fancy videos or slide decks, but real and practical experiences that will help you with your own implementations. 📕 Topics that will be addressed: • Training the ML-model by humans: do or don't? • Rule-based versus AI extractors • Tips for finding use cases • How to start 👨‍🏫👨‍💻 Speakers: o Dion Morskieft, RPA Product Owner @Partou o Jack Klein-Schiphorst, Automation Developer @Tacstone Technology

DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam

UiPathCommunity

Exploring Multimodal Embeddings with Milvus

Zilliz

Following the popularity of "Cloud Revolution: Exploring the New Wave of Serverless Spatial Data," we're thrilled to announce this much-anticipated encore webinar. In this sequel, we'll dive deeper into the Cloud-Native realm by uncovering practical applications and FME support for these new formats, including COGs, COPC, FlatGeoBuf, GeoParquet, STAC, and ZARR. Building on the foundation laid by industry leaders Michelle Roby of Radiant Earth and Chris Holmes of Planet in the first webinar, this second part offers an in-depth look at the real-world application and behind-the-scenes dynamics of these cutting-edge formats. We will spotlight specific use-cases and workflows, showcasing their efficiency and relevance in practical scenarios. Discover the vast possibilities each format holds, highlighted through detailed discussions and demonstrations. Our expert speakers will dissect the key aspects and provide critical takeaways for effective use, ensuring attendees leave with a thorough understanding of how to apply these formats in their own projects. Elevate your understanding of how FME supports these cutting-edge technologies, enhancing your ability to manage, share, and analyze spatial data. Whether you're building on knowledge from our initial session or are new to the serverless spatial data landscape, this webinar is your gateway to mastering cloud-native formats in your workflows.

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Safe Software

Recently uploaded (20)

Apidays New York 2024 - The value of a flexible API Management solution for O...

EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER

ICT role in 21st century education and its challenges

Six Myths about Ontologies: The Basics of Formal Ontology

MINDCTI Revenue Release Quarter One 2024

presentation ICT roal in 21st century education

Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...

Vector Search -An Introduction in Oracle Database 23ai.pptx

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Corporate and higher education May webinar.pptx

Understanding the FAA Part 107 License ..

Introduction to Multilingual Retrieval Augmented Generation (RAG)

Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

Elevate Developer Efficiency & build GenAI Application with Amazon Q

AWS Community Day CPH - Three problems of Terraform

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving

DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam

Exploring Multimodal Embeddings with Milvus

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Windows Mixed Reality - DDD Reading 2018

1. Analysing visual content using HoloLens, Computer Vision APIs, Unity and the Mixed Reality Toolkit Davide Zordan B: https://www.davidezordan.net E: mail@davidezordan.net T: @DavideZordan

2. Davide Zordan Software Engineer MCSD, MCSA, MS, MCP Xamarin Certified Mobile Developer Microsoft MVP (2009-2014)

3. MIXED REALITY VIRTUAL REALITYPHYSICAL REALITY

4. PHYSICAL REALITY DIGITAL REALITY MIXED REALITY (MR) WINDOWS MIXED REALITY HOLOGRAPHIC DEVICES (SEE-THROUGH) WINDOWS MIXED REALITY IMMERSIVE DEVICES (OPAQUE) AR TODAY VR TODAY Physical - Digital Reality Spectrum *The term mixed reality was originally introduced in a 1994 paper by Paul Milgram and Fumio Kishino, "A Taxonomy of Mixed Reality Visual Displays."

5. A new way to interact

6. Source: https://www.microsoft.com/en-us/research/blog/microsoft-hololens-facilitates-computer-vision-research-by-providing-access-to-raw-image-sensor-streams-with-research-mode/

7. Gaze

8. Gesture

9. Voice

10. Motion control

11. World coordinates Spatial mapping Spatial audio

12.

13.

14. Windows ML

15.

16.

17.

18.

19.

20.

21.

22.

23.

24.

25.

26. Mixed Reality Academy https://docs.microsoft.com/en-us/windows/mixed-reality/academy Mixed Reality Toolkit https://github.com/Microsoft/MixedRealityToolkit-Unity Cognitive Services https://azure.microsoft.com/en-gb/services/cognitive-services/ Microsoft Ignite https://8gportalvhdsf9v440s15hrt.blob.core.windows.net/ignite2017/session- presentations/BRK2404.PPTX

27. “Any sufficiently advanced technology is indistinguishable from magic” Arthur C. Clark, Profiles of the future, 1961

28. Thanks Davide Zordan B: https://www.davidezordan.net E: mail@davidezordan.net T: @DavideZordan

Windows Mixed Reality - DDD Reading 2018

Recommended

Recommended

More Related Content

Similar to Windows Mixed Reality - DDD Reading 2018

Similar to Windows Mixed Reality - DDD Reading 2018 (20)

Recently uploaded

Recently uploaded (20)

Windows Mixed Reality - DDD Reading 2018