SIGGRAPH 2012 Computational Plenoptic Imaging Course - 1 Introduction

1. ComputationalaPlenopticwindow
This slide has 16:9 media Imaging
Edit this text to create a Heading
 This subtitle is 20 points
 Bullets are blue
 They have 110% line spacing, 2 points before & after
 Longer bullets in the form of a paragraph are harder to
read if there is insufficient line spacing. This is the
maximum recommended number of lines per slide
Gordon Wetzstein Ivo Ihrke Douglas Lanman
(seven). Lab
MIT Media Saarland University MIT Media Lab
 Sub Heidrich
Wolfgang bullets look like this Akeley
Kurt Ramesh Raskar
University of British Columbia Lytro, Inc. MIT Media Lab

2. Edit this text to create a Heading
HDR Imaging & Computed Tomography
 This subtitle is 20 points
[Rouf et al. 2011]
 Bullets are blue
 They have 110% line spacing, 2 points before & after
 Longer bullets in the form of a paragraph are harder to
read if there is insufficient line spacing. This is the
maximum recommended number of lines per slide
(seven).
wikipedia
 Sub bullets look like this Tomographic
HDR Reconstruction

3. Edit this text to create a Heading
Lytro Light Field Camera
[Lytro, Inc.]
 This subtitle is 20 points
 Bullets are blue
 They have 110% line spacing, 2 points before & after
 Longer bullets in the form of a paragraph are harder to
read if there is insufficient line spacing. This is the
maximum recommended number of lines per slide
(seven).
 Sub bullets look like this
[Ng et al. 2005]

4. Edit this text to create a Heading
Ultra-fast Imaging & Looking around Corners
 This subtitle is 20 points
 Bullets are blue
 They have 110% line spacing, 2 points before & after
 Longer bullets in the form of a paragraph are harder to
read if there is insufficient line spacing. This is the
maximum recommended number of lines per slide
(seven).
 Sub bullets look like this

5. Instructors – Introduction & Overview
Edit this text to create a Heading
 This subtitle is 20 points
 Bullets are blue
Gordon Wetzstein
 They have 110% line spacing, 2 points before & after
 Longer bullets in the form of a paragraph are harder to
Postdoctoral Researcher
read if there is insufficient line spacing. This is the
MIT Media Lab
maximum recommended number of lines per slide
media.mit.edu/~gordonw
(seven).
 Sub bullets look like this

6. Instructors – High Dynamic Range
Edit this text to create a Heading Imaging
 This subtitle is 20 points
 Bullets are blue
 They have 110% line spacing, 2Wolfgang Heidrich
points before & after
 Longer bullets in the form of a paragraph are harder to
read if there is insufficient line spacing. This is the
Professor
maximum recommended number of lines of British Columbia
University per slide
(seven).
cs.ubc.ca/~heidrich
 Sub bullets look like this

7. Instructors – Spectral a Heading
Edit this text to create Imaging
 This subtitle is 20 points
 Bullets are blue
Ivo Ihrke
 They have 110% line spacing, 2 points before & after
 Longer bullets in the form of a paragraph are harder to
Research Group Leader
read if there is insufficient line spacing. This is the
Saarland University
maximum recommended number of lines per slide
(seven).
giana.mmci.uni-saarland.de/
 Sub bullets look like this

8. Instructors – Light Field Acquisition
Edit this text to create a Heading
 This subtitle is 20 points
 Bullets are blue
 They have 110% line spacing, 2 points before & after
 Longer bullets in the form of a paragraph are harder to
Douglas Lanman
read if there is insufficient line spacing. This is the
maximum recommended number of lines per slide
(seven). Research Scientist, Nvidia Research
Postdoctoral Researcher, MIT Media Lab
 Sub bullets look like this
media.mit.edu/~dlanman

9. Instructors – Inside the Heading
Edit this text to create aLytro Camera
 This subtitle is 20 points
 Bullets are blue
 They have 110% line spacing, 2 points before & after
 Longer bullets in the form of a paragraph are harder to
read if there is insufficient line spacing. This is the
maximum recommended number of lines per slide
Kurt Akeley
(seven).
Computer Graphics Pioneer & CTO at Lytro, Inc.
 Sub bullets look like this
lytro.com/team/kurt_akeley

10. Instructors – Ultra-fast Imaging
Edit this text to create a Heading
 This subtitle is 20 points
Ramesh Raskar
 Bullets are blue
 They have 110% line spacing, 2 points before & after
Associate Professor
 Longer bullets in the form of aLab
MIT Media paragraph are harder to
read if there is insufficient line spacing. This is the
media.mit.edu/~raskar
maximum recommended number of lines per slide
(seven). cameraculture.media.mit.edu
 Sub bullets look like this
TED Talk: Imaging at a Trillion FPS

11. Edit this text to create a Heading
Course Outline
 Introduction & Overview, Gordon (7 mins)
 This subtitle is 20 points
 High Dynamic Range Imaging, Wolfgang (10 mins)
 Bullets are blue

 Spectral Imaging,line spacing, 2 points before & after
They have 110% Ivo (10 mins)
 Light Field Acquisition, Douglas (10 mins)
Longer bullets in the form of a paragraph are harder to
 read if there is insufficient Kurt spacing. This is (20 mins)
Insight the Lytro Camera, line the
maximum recommended number of lines per slide
 Imaging at a Trillion FPS, Ramesh (20 mins)
(seven).
 Schlieren Imaging, Gordon
 Sub bullets look like this (5 mins)
 Q & A, all (10 mins)

12. Edit Mantis Shrimp
The this text to create a Heading
 This subtitle is 20 points 3 bands = trinocular vision
 Bullets are blue with each eye!
 They have 110% line spacing, 2 points before & after
 Longer bullets in the form of a paragraph are harder to
read if there is insufficient line spacing. This is the
maximum recommended number of lines per slide
(seven).
Up to 16 different photoreceptors:
 12 forSub bulletsUV, visible, IR)
 color (4 look like this
 4 for polarization (linear & circular)

13. Edit this text to create a Heading
Sensors Today
 This subtitle is 20 points
 Bullets are blue
 They have 110% line spacing, 2 points before & after
 Longer bullets in the form of a paragraph are harder to
read if there is insufficient line spacing. This is the
maximum recommended number of lines per slide
(seven).
 Sub bullets look like this
sensors are buckets collecting photons…

14. Edit this text to create a Heading
Sensors Today
 This subtitle is 20 points
 Bullets are blue
 They have 110% line spacing, 2 points before & after
 Longer bullets in the form of a paragraph are harder to
read if there is insufficient line spacing. This is the
maximum recommended number of lines per slide
(seven).
 Sub bullets look like this
… disregarding color …

15. Edit this text to create a Heading
Sensors Today
 This subtitle is 20 points
 Bullets are blue
 They have 110% line spacing, 2 points before & after
 Longer bullets in the form of a paragraph are harder to
read if there is insufficient line spacing. This is the
maximum recommended number of lines per slide
(seven).
 Sub bullets look like this
… direction …

16. Edit this text to create a Heading
Sensors Today
 This subtitle is 20 points
 Bullets are blue
 They have 110% line spacing, 2 points before & after
 Longer bullets in the form of a paragraph are harder to
read if there is insufficient line spacing. This is the
maximum recommended number of lines per slide
(seven).
 Sub bullets look like this
… time of arrival …

17. Edit this text to create a Heading
Sensors Today
 This subtitle is 20 points
 Bullets are blue
 They have 110% line spacing, 2 points before & after
 Longer bullets in the form ofPhotography
Computational a paragraph are harder to
read if there is insufficient line spacing. This is the
maximum recommended number of lines per slide
(seven).
 Sub bullets look like this
… all photons are integrated.

18. Edit this text to create as one Human Eye
Cameras are modeled a Heading
webvision.med.utah.edu
wikipedia.org
 This subtitle is 20 points
 Bullets are blue
 They have 110% line spacing, 2 points before & after
 Longer bullets in the form of a paragraph are harder to
read if there is insufficient line spacing. This is the
maximum recommended number of lines per slide
[Williams 91]
(seven).
 Sub bullets look like this
wikipedia.org

19. Edit this text to create a Heading
Visual Information Sampled
Human Visual System Consumer Video Camera
 This subtitle is 20 points
4 Plenoptic parameters
 Bullets are blue sampled (no Vx,y,z)
 They have 110% line spacing, 2 points before & after
 Longer bullets in the form of a paragraph arexharder to
1920 1080 (HD)
Allan Brooks, EE421, 2003
read if there is insufficient line spacing. This is the
3 – per slide
maximum recommended number of lines Color Filter Array
(seven).
Continuous ~30 fps
 Sub bullets look like this
1

20. Edit Plenoptic Function Heading
The this text to create a
 High-dimensional, ray-based model for light

 This subtitle is 20 points
Includes variations in space, time, angle, & wavelength
 Bullets are blue
 P  P ( ,  ,  , t , V , V , V )
They have 110% line spacing, 2 points beforez& after
x y
 Longer bullets in the form of a paragraph are harder to
plenoptic function
Vx Common parameterizations
V y read if there is insufficient line spacing. This is the
(seven).
P  P ( ,  ,V ,V )
maximum recommended number of lines per slide
x y
 Sub bullets look like this 4D light field
[Adelson and Bergen 91]

21. Edit this text to Photograph & Plenoptic Imaging
Computational create a Heading
 This subtitle is 20 points
 Bullets are blue
 Co-design of camera optics & computational
 They have 110% line spacing, 2 points before & after
processing
 Longer bullets in the form of a paragraph are harder to
read if there is insufficient line spacing. This is the
 maximum recommended number of lines per (+ HDR)
Categorized by plenoptic dimensions slide
(seven).
 Sub bullets look like this