16. Holograms from real life
View authentic moments in time
from every angle imaginable. From
the professional to the personal.
17.
18. Use everywhere
Adding depth to video is just like adding
color and audio: your content is more like
the real thing. Content becomes more
engaging, and creates more impact, which
in turn adds more emotional and practical
value to your experience.
ARTS AND ENTERTAINMENT EDUCATION AND TRAINING COMMERCE
HoloLensのようなMRデバイスは、私たち
がお互いに、そして私たちの周りの世界
とどのように相互作用するかという根本
的な変革となるもののほんの始まりにす
ぎません。
このテクノロジーは、アートとエンター
テインメントの消費者シナリオ、教育と
トレーニングを含む企業シナリオ、商取
引と小売りの探索で、今日すでに大きな
成功を収めて使用されています。
19. The media type of the future is
ready for today’s devices.
Reach billions of eyes on the
devices people have now, while
building your content library for
devices of the future
Shoot content once, and use
across multiple current and
future platforms:
Playback
• 2D Broadcast and film
• AR on mobile phones
• Head mounted VR
• Web browser playback
• HoloLens and Magic Leap
• Consoles and PCs
20. カメラ、VRデバイス、AI、制作技術の統合
20
複合現実に命を吹き込む
Mixed Reality Capture Studios
考えられるあらゆる視点から人間のパフォーマンス
を記録します。
実生活からホログラムを作成する
Mixed Reality Capture Studiosではホログラフィック
ビデオを録画しています
ダイナミックに、人間のパフォーマンスを記録
一般利用者は、VR、AR、従来の2D画面など、様々な
接点を通じてホログラムを楽しむことができます
Bring life to mixed reality
Mixed Reality Capture Studios record human
performances from every perspective
imaginable.
Create holograms from real life
At Mixed Reality Capture Studios, we record
holographic video—holograms of dynamic
people and performances. Your audiences can
interact with your holograms in augmented
reality, virtual reality, and on 2D screens.
21. How it works
Starting with capturing visual data from dozens of
cameras, we use the power of computer vision, AI,
and Azure to process staggering amounts of data to
create holographic content that can be consumed
on a broad spectrum of devices, from HoloLens to
mobile phones.
POINT CLOUD
HIGH RES MESH
DECIMATED TEXTURED MESH
COMPRESSED 15 Mbps MP4 FILE
600 GB
raw data per minute captured
300 MB
More technical detail available here: SIGGRAPH 2015
2015 Siggraph paper and video
https://docs.microsoft.com/en-us/windows/mixed-
reality/how-it-works-mixed-reality-capture-studios
22. Capture Stages
Licensed technology stack
REDMOND
SAN FRANCISCO
LOS ANGELES
LONDON
SEOUL
MOBILE
UK/US/EUROPE
BERLIN*
Los Angeles/ Metastage *Processing pipeline only
23. Post-processing
EDITING
Edit mesh and texture sequences with standard DCC tools
like Maya, Photoshop, and Nuke.
Re-encode edited content back to a single material MP4
with our proprietary tool.
It’s possible to use Maya, Arnold, V-Ray, etc. to render complex
lighting information like sub-surface scattering post-capture, and
then bake back out to our compressed MP4 format. There are
limitations, so be sure to chat with us prior to capture.
RELIGHT
We provide basic audio capture and a scratch mix for review.
Your audio engineer will be able to sweeten and enhance the
source files to create your perfect mix.
AUDIO
Not for redistribution
24. Post-processing
GAZE RETARGETING
Shader-based mesh deformation can automatically change
the angle of a presenter’s head to be more in line with a
viewer’s location without needing to rig and animate.
ROTOSCOPING/PROP REPLACEMENT
We have a Maya workflow and tool for adding simple
animated objects post-capture. Our partners have gone so
far as integrating motion capture technology into their
workflows (seen at right).
Props like golf clubs, glasses, swords, and other elements
are hard for us to capture well, but they are good
candidates for adding in post-production if needed.
Not for redistribution
25. Try it now!
For more information, including to enquire about booking
a shoot, visit our web page:
microsoft.com/mrcs
Key Points:
HELLO introductions, hope everyone had a good lunch,
Checking – still awake?
We’re going to talk about something a little different now – lift ourselves out of the magic of [node, culture, cloud architecture, ML models, whatever] and talk about what it looks like to work with Microsoft – and maybe more importantly, what it can look like to work with and partner with any large firm. We hope to cover…
Why it matters – why and how to think about partnering
What it looks like to partner with a company like Microsoft, and how to do it as a startup
Lessons you can take home. Things to think about for the future.
With real world examples from startups who have been there before.
But this all starts with one very simple premise. If you’re sitting in an early stage startup, you’re focused on creating and building.
NEXT SLIDE You are focused on building
To sum up, this is what we do.
We make holograms of people and animals in motion.
We believe that holographic video meets a real human need and desire.
Since the very first photograph humans have been trying to recreate a faithful version of reality– a version that is more like the way we actually view the world, with motion, color, sound, and now true depth.
That authenticity is crucial– its not fake, it’s not a game character, its what that real, live person is doing or just did. The next best thing to being there.
This is AJ Styles, WWE superstar wrestler, part of a capture we did for Wrestlemania in 2018
2019 NDA SupercutEven now you can see experiences start to come to life. Here are just a few of the things that have come along in the last year and a half or so.
How it works
By the numbers:
Even array of synchronized cameras, most common number of cameras is 106
1/2 infrared + 1/2 RGB cameras
4MP or 12MP cameras
30-60 frames per second standard capture. Higher fps possible
For more technical dive as necessary:
A link to our 2015 Siggraph paper and video which covers things in much more detail.
https://docs.microsoft.com/en-us/windows/mixed-reality/how-it-works-mixed-reality-capture-studios
システムは、すべてがステージの中心を指す数十台のキャリブレーションされたカメラから始まり、キャプチャボリュームを作成します。私たちのテクノロジーは、そのボリューム内にあるものをすべて再構築するように機能します。
さまざまなキャプチャシナリオをサポートするために、カメラを移動および再構成できます。一般に、これは、カメラを近づけて解像度を上げるか、引き離してより多くの物理的空間をキャプチャすることを意味します。サポートされている最大の直径は10フィート、最小の直径は3.5フィートです。
このスライドに示されているキャプチャボリュームは、直径8フィートの円であり、最も一般的なキャプチャボリューム構成です。
カメラの数と配置により、同時に複数の人を撮影することができます。通常、2人が最大のスイートスポットですが、同時に最大3〜4人をキャプチャでき、特定のシナリオでは適切な結果が得られます。
撮影時にかなりの量のデータ(毎秒10GB /毎分600GB)を生成します。コンピュータービジョン、機械学習、および多くのコンピューティング能力(Azureを利用)を使用して、さまざまなシナリオでより簡単に消費できるサイズにデータを取得します。HDビデオサイズに近いものまで(つまり、数百MB、1秒あたり10〜20Mビットに圧縮されます)。それをするために。
そのすべてのデータと処理からの最終出力は、独自のMP4ファイルです。 MP4ファイルの再生が予想されるほとんどすべての場所で、ホログラフィックビデオを再生でき、数十億のデバイスやユーザーに空間体験を提供できる可能性があります。これについては、次の数枚のスライドで詳しく説明します。
必要に応じてよりテクニカルダイビングを行うには:
物事をより詳細にカバーする2015Siggraphペーパーとビデオへのリンク。
https://docs.microsoft.com/en-us/windows/mixed-reality/how-it-works-mixed-reality-capture-studios
Get Captured Today!
現在、世界中の主要なメディアマーケットに一連のプロのサウンドステージがあります。 Microsoftには2つの段階があります。 1つは開発が行われるサンフランシスコにあり、もう1つはここレドモンドの目の前にあります。
ロンドン、ニューヨーク、ロサンゼルスの他のグループにステージのライセンスを供与し、さらに多くのライセンシーを獲得しました。 処理スタック、再生サポート、およびキャプチャテクノロジーの全体的な改良により、これらのパートナーをサポートします。 恒久的な設置に加えて、2つのモバイルステージが存在します。 これらのステージは、北米、英国、ヨーロッパ全体に移動できます。
We can do some really cool things with that output that don’t destroy the core authenticity of the performance that was captured
Call to action
Key Points:
HELLO introductions, hope everyone had a good lunch,
Checking – still awake?
We’re going to talk about something a little different now – lift ourselves out of the magic of [node, culture, cloud architecture, ML models, whatever] and talk about what it looks like to work with Microsoft – and maybe more importantly, what it can look like to work with and partner with any large firm. We hope to cover…
Why it matters – why and how to think about partnering
What it looks like to partner with a company like Microsoft, and how to do it as a startup
Lessons you can take home. Things to think about for the future.
With real world examples from startups who have been there before.
But this all starts with one very simple premise. If you’re sitting in an early stage startup, you’re focused on creating and building.
NEXT SLIDE You are focused on building
Microsoft Access is your essential tool kit!
You can get no-cost coding software and build the skills.
Because this whole notion of partnering has been so important to us, and still is – well, it’s the lens through which we look at working with startups.
So now I get to pivot a little bit – away from hammering the point home that hey, you should know who your partners are, and into what Microsoft brings to the party
I think y’all get the point, right? Pick some partners? Know what they can do?
Cool – let’s talk about what partnering with Microsoft looks like, and how to go about it if you’re interested.
We think of startups as our partners who can help our customers on their journey to digital transformation
NEXT what matters to Startups so they can help our customers?