Statements in which the resource exists as a subject.
PredicateObject
rdf:type
lifeskim:mentions
pubmed:issue
5
pubmed:dateCreated
2007-5-11
pubmed:abstractText
We present a technique for enhancing underexposed visible-spectrum video by fusing it with simultaneously captured video from sensors in nonvisible spectra, such as Short Wave IR or Near IR. Although IR sensors can accurately capture video in low-light and night-vision applications, they lack the color and relative luminances of visible-spectrum sensors. RGB sensors do capture color and correct relative luminances, but are underexposed, noisy, and lack fine features due to short video exposure times. Our enhanced fusion output is a reconstruction of the RGB input assisted by the IR data, not an incorporation of elements imaged only in IR. With a temporal noise reduction, we first remove shot noise and increase the color accuracy of the RGB footage. The IR video is then normalized to ensure cross-spectral compatibility with the visible-spectrum video using ratio images. To aid fusion, we decompose the video sources with edge-preserving filters. We introduce a multispectral version of the bilateral filter called the "dual bilateral" that robustly decomposes the RGB video. It utilizes the less-noisy IR for edge detection but also preserves strong visible-spectrum edges not in the IR. We fuse the RGB low frequencies, the IR texture details, and the dual bilateral edges into a noise-reduced video with sharp details, correct chrominances, and natural relative luminances.
pubmed:language
eng
pubmed:journal
pubmed:citationSubset
IM
pubmed:status
MEDLINE
pubmed:month
May
pubmed:issn
1057-7149
pubmed:author
pubmed:issnType
Print
pubmed:volume
16
pubmed:owner
NLM
pubmed:authorsComplete
Y
pubmed:pagination
1185-94
pubmed:meshHeading
pubmed:year
2007
pubmed:articleTitle
Multispectral bilateral video fusion.
pubmed:affiliation
University of North Carolina at Chapel Hill, Chapel Hill, NC 27529, USA. bennett@cs.unc.edu
pubmed:publicationType
Journal Article, Research Support, U.S. Gov't, Non-P.H.S., Evaluation Studies