View in EDS

Tangible Video Teleconference System Using Real-Time Image-Based Relighting.

Saved in:
Bibliographic Details
Title: Tangible Video Teleconference System Using Real-Time Image-Based Relighting.
Authors: Sae-Woon Ryu1 ryuseun@mr.hanyang.ac.kr, Sang Hwa Lee2 lhs@ipl.snu.ac.kr, Sang Chul Ahn3 asc@imrc.kist.re.kr, Jong-Il Park1 jipark@hanyang.ac.kr
Source: IEEE Transactions on Consumer Electronics. Aug2009, Vol. 55 Issue 3, p1162-1168. 6p.
Subjects: Videoconferencing, Teleconferencing, Reflectance, Graphics processing units, Computer graphics, Virtual reality, Computer simulation, Telecommunication systems
Abstract: This paper deals with a real-time image based relighting system for tangible video teleconference. The proposed image based relighting system renders the extracted human object using the virtual environmental images. The proposed system can homogenize virtually the lighting environments of remote users on the video teleconference, or render the humans like they are in the virtual places. To realize the video teleconference, the paper obtains the reflectance models of users in real-time using the controlled lighting system. The reflectance models of human surface are obtained by a pair of lighting sources which are turned on and off alternatively. The images with different illuminations are exploited to model the reflectance on the object surfaces. The environment map for rendering is acquired by the mirror ball images or virtual background ones. And the relighting algorithm is implemented by GPU based programming for real-time operation. According to the simulations, the proposed system estimates the reflectance models of human faces, and relights the human faces in real-time. The objects are rendered by the reflectance models and virtual environment map. The proposed system enables the users to immerse video teleconference just as they are in the virtual environments. [ABSTRACT FROM AUTHOR]
Copyright of IEEE Transactions on Consumer Electronics is the property of IEEE and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Engineering Source
Description
Abstract:This paper deals with a real-time image based relighting system for tangible video teleconference. The proposed image based relighting system renders the extracted human object using the virtual environmental images. The proposed system can homogenize virtually the lighting environments of remote users on the video teleconference, or render the humans like they are in the virtual places. To realize the video teleconference, the paper obtains the reflectance models of users in real-time using the controlled lighting system. The reflectance models of human surface are obtained by a pair of lighting sources which are turned on and off alternatively. The images with different illuminations are exploited to model the reflectance on the object surfaces. The environment map for rendering is acquired by the mirror ball images or virtual background ones. And the relighting algorithm is implemented by GPU based programming for real-time operation. According to the simulations, the proposed system estimates the reflectance models of human faces, and relights the human faces in real-time. The objects are rendered by the reflectance models and virtual environment map. The proposed system enables the users to immerse video teleconference just as they are in the virtual environments. [ABSTRACT FROM AUTHOR]
ISSN:00983063
DOI:10.1109/TCE.2009.5277971