View in EDS

Temporal Colored Coded Aperture Design in Compressive Spectral Video Sensing.

Saved in:
Bibliographic Details
Title: Temporal Colored Coded Aperture Design in Compressive Spectral Video Sensing.
Authors: Leon Lopez, Kareth M., Galvis Carreno, Laura V., Arguello Fuentes, Henry
Source: IEEE Transactions on Image Processing. Jan2019, Vol. 28 Issue 1, p253-264. 12p.
Subjects: Microfilm aperture card systems, Restricted isometry property, Image reconstruction, Signal-to-noise ratio, Algorithms
Abstract: Compressive spectral video sensing (CSVS) systems obtain spatial, spectral, and temporal information of a dynamic scene through the encoding of the incoming light rays by using a temporal-static coded aperture (CA). CSVS systems use CAs with binary entries spatially distributed at random. The random spatial encoding of the binary CAs entails a poor quality in the reconstructed images even though the CSVS sensing matrix is incoherent with the sparse representation basis. In addition, since some pixels are totally blocked, information such as object motion is missed over time. This paper substitutes the temporal-static binary coded apertures by a richer spatio-spectro-temporal encoding based on selectable color filters, named temporal colored coded apertures (T-CCA). The spatial, spectral, and time distributions of the T-CCAs are optimized by better satisfying the restricted isometry property (RIP) of the CSVS system. The RIP-optimized T-CCAs lead to spatio-spectral-time structures that tend to sense more uniformly the spatial, spectral, and temporal dimensions. An algorithm for optimally designing the T-CCAs is developed. In addition, a regularization term based on the scene motion is included in the inverse problem leading to a better quality of the reconstructed images. Computational experiments using four different spectral videos show an improvement of up to 6 dB in terms of peak signal-to-noise ratio of the reconstructed images by using the proposed inverse problem and the T-CCA patterns compared with the binary CAs and random and image-optimized CCA patterns. [ABSTRACT FROM AUTHOR]
Copyright of IEEE Transactions on Image Processing is the property of IEEE and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Engineering Source
Description
Abstract:Compressive spectral video sensing (CSVS) systems obtain spatial, spectral, and temporal information of a dynamic scene through the encoding of the incoming light rays by using a temporal-static coded aperture (CA). CSVS systems use CAs with binary entries spatially distributed at random. The random spatial encoding of the binary CAs entails a poor quality in the reconstructed images even though the CSVS sensing matrix is incoherent with the sparse representation basis. In addition, since some pixels are totally blocked, information such as object motion is missed over time. This paper substitutes the temporal-static binary coded apertures by a richer spatio-spectro-temporal encoding based on selectable color filters, named temporal colored coded apertures (T-CCA). The spatial, spectral, and time distributions of the T-CCAs are optimized by better satisfying the restricted isometry property (RIP) of the CSVS system. The RIP-optimized T-CCAs lead to spatio-spectral-time structures that tend to sense more uniformly the spatial, spectral, and temporal dimensions. An algorithm for optimally designing the T-CCAs is developed. In addition, a regularization term based on the scene motion is included in the inverse problem leading to a better quality of the reconstructed images. Computational experiments using four different spectral videos show an improvement of up to 6 dB in terms of peak signal-to-noise ratio of the reconstructed images by using the proposed inverse problem and the T-CCA patterns compared with the binary CAs and random and image-optimized CCA patterns. [ABSTRACT FROM AUTHOR]
ISSN:10577149
DOI:10.1109/TIP.2018.2867171