Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Digital Holography
1. Digital Holography Conor Mc Elhinney Deptartment of Computer Science, National University of Ireland, Maynooth. 21 st Nov 2007
2.
3.
4. Using digital holography we can record a scene in a complex valued data structure which retains some of the scene's 3D information. A standard image obtained with a camera records a 2D focused image of the scene from one perspective. Why digital holography? However reconstructing a digital hologram returns a 2D image of the scene at a specific depth (300mm from the camera) from an individual perspective (along the optical axis). Algorithms and processing techniques need to be developed to extract the 3D information from digital holograms by processing multiple (volumes of) reconstructions. Image Processing Depth Map Reconstructions Why do we need image processing?
5. Why not 2D Image Processsing? Standard 2D image processing techniques can be applied to individual digital holographic reconstructions with varying success. 2D 3D 2D Image Processing Reconstructions Digital Holographic Image Processing However, we are interested in developing the field of digital holographic image processing (DHIP) where we use volumes of reconstructions to extract 3D information from digital holograms. Using this information we can develop techniques which are more accurate than standard 2D approaches.
11. Recording with digital holography Digital Holography Object Beam Laser CCD Recorded Image Reference Beam
12.
13. Reconstructing with digital holography Discrete Fresnel Transform Digital Hologram Digital Reconstruction Distance d
14. Numerical focusing of digital holograms Holograms can be numerically reconstructed at an arbitrary depth away from the camera.
15. Discrete Fresnel Transform Digital Hologram Digital Reconstruction Distance d Reconstructing with a subset of pixels
16. Reconstructing with a subset of pixels If you take a window of pixels from a hologram plane, the reconstruction will still be of the full scene but a reduced quality Hologram reconstruction Hologram plane Simulated Image Captured using a camera
18. Reconstructing different perspectives A hologram encodes multiple perspectives and these can be reconstructed by selectively choosing a subwindow from the hologram plane. Hologram reconstruction Hologram plane
26. Digital Hologram recording Object wavefront Reference Beam Interferogram Recorded Recorded Recorded + = + =
27. Digital Hologram recording Object wavefront Reference Beam Interferogram + = Recorded Recorded Recorded + + = + =
28. Digital Hologram recording Object wavefront Reference Beam Interferogram + = Recorded Recorded Recorded Intensity Only Intensity Only + + = + =
29. Digital Hologram recording CCD Object wavefront Reference Beam Interferogram + = Recorded Recorded Recorded + + = + = + = Intensity and Phase Information
30. Digital Hologram recording CCD Object wavefront Reference Beam Interferogram + = Recorded Recorded Recorded + + = + = + = Objects Amplitude Objects Phase
31.
32. Focus Metric applied to digital holograms We employed variance calculated on a block of pixels as our focus metric. We split the 40 hologram reconstructions into 4 quadrants, each of size 512 x 512. These blocks were then processed using variance and the depth with the maximum variance was taken as the estimated depth. We are now advancing this to autofocus a digital holographic reconstruction. depth variance
33.
34. What is Depth-From-Focus? Depth-From-Focus is an image processing technique which is used to determine the depth of a scene or a region within a scene through processing images taken at different focal depths. Why is this applicable to digital holography? Digital Holograms can be numerically reconstructed at an arbitrary depth. These numerical reconstructions are each at a different focal plane, which make them a good input to a Depth-From-Focus algorithm. What do we get from Depth-From-Focus? We can then create depth maps of the scene, segment the scene and create extended focused images of the scene.
35. What is Depth-From-Focus? Depth-From-Focus is an image processing technique which is used to determine the depth of a scene or a region within a scene through processing images taken at different focal depths. Why is this applicable to digital holography? Digital Holograms can be numerically reconstructed at an arbitrary depth. These numerical reconstructions are each at a different focal plane, which make them a good input to a Depth-From-Focus algorithm. What do we get from Depth-From-Focus? We can then create depth maps of the scene, segment the scene and create extended focused images of the scene.
36. What is Depth-From-Focus? Depth-From-Focus is an image processing technique which is used to determine the depth of a scene or a region within a scene through processing images taken at different focal depths. Why is this applicable to digital holography? Digital Holograms can be numerically reconstructed at an arbitrary depth. These numerical reconstructions are each at a different focal plane, which make them a good input to a Depth-From-Focus algorithm. What do we get from Depth-From-Focus? We can then create depth maps of the scene, segment the scene and create extended focused images of the scene.
42. What is an Extended Focused Image? This means that reconstructions can contain large blurry regions. Using our depth maps and the volume of reconstructions used to create them we can create an extended focused image. A disadvantage of holographic reconstructions is the limited depth of field. For a reconstruction at depth d only object points that are located at distance d from the camera are in focus. Why do we want to create an extended focused image? Depth Map Volume of Reconstructions = + Extended Focused Image
45. Extended Focused Image Reconstruction at the front of the scene Reconstruction at the back of the scene Extended Focused Image
46.
47. What is Object segmentation? For tasks such as object recognition, it is advantageous to segment a scene into object and background before attempting recognition. Object segmentation is the partitioning of a scene into object and background. Why do we want to perform object segmentation? 1 2 1 2 Threshold Line Reconstruction Depth (mm) Variance
51. What is Depth segmentation? Again using the example of object recognition, if a scene is complex (containing multiple occluding objects), using depth segmentation we can partition the scene into independent objects for analysis. Depth segmentation is the partitioning of a scene into individual objects after the background has been segmented. Why do we want to perform depth segmentation? 1 2 1 2 1 2 Reconstruction Depth Map Depth Maps Histogram
52. Segmenting reconstructions We now have a segmentation image where the value of each pixel corresponds to the object it belongs to. We can use this to segment a reconstruction into its different objects. Depth Segmentation 1 2 Segmentation Image Reconstruction of Segmented object 1 Reconstruction of Segmented object 2
53. Occluding Objects Through the use of depth information we have a strong criteria for determining if a region in the scene is an independent object or belongs to an earlier identified object. Advantage of segmentation based on depth information 1 2 Segmentation Image Reconstruction of Segmented object 1 Reconstruction of Segmented object 2
54.
55. Superposition Optical Axis 360mm CCD Simulated experimental set-up for the superposed hologram, with an second object superposed a distance of 90mm from the original object. Optical Axis 270mm 360mm CCD Simulated original setup for an object placed at 360mm away from the CCD. Reference Wave Object Wave Reference Wave Object Wave