3. Introduction Tele-immersion is an emerging technology that will enable users at geographically distributed sites to collaborate in real time in a shared, simulated environment as if they are in the same physical room. This is achieved through realistic reconstruction of the scenes in virtual space.
4.
5. History The idea of Tele-immersion was proposed by Jaron Lanier , the head of Advanced Networks and Services in 1997. National Tele-Immersion Initiative (NTII) was formed to implement this. In May 2000, researchers at University of North Carolina (UNC), the University of Pennsylvania and Advanced Networks and Services developed this technology. A user sitting in office at UNC was able to see lifelike 3D images of his colleagues hundreds of mile away.
7. Tele-conference vs. Tele-immersion Tele-immersion differs significantly from conventional video Tele-conferencing in that the user’s view of the remote environment changes dynamically as he moves his head. Tele-conferencing Tele-immersion
9. Immersive Virtual Environment Audio Synthesizer User Environment head- mounted display or projection display system Virtual Environment Generator Audio Localizer commands Speech Recognizer Display Electronics graphics eye position Head/Eye/Hand Tracking Electronics head position hand position Haptic/Tactile kinaesthetics system
18. This reconstruction uses Trinocular Stereo Algorithm. After constructing the disparity map, apply median filtering to remove a few outliers in the disparity map. Then the median filtered disparity map is combined with a registered color texture to reconstruct a 3D point cloud.
19. 3D Video Transmission 3D data is transmitted in compressed form using Modern Driven compression algorithm. System which generates 640x480 pixel depth color maps from 10 camera clusters in a rate of 15 frames per second (fps), requires 220 mbps bandwidth. Around 1.2 gbps is necessary for high quality effect.
23. Challenges Quality of transmitting multimedia and Tele-immersion data streams over the internet is affected by high packets loss rates. Expensive High bandwidth requirement.