An orientation-based fusion algorithm for multisensor image fusion

Yufeng Zheng

doi:10.1117/12.849656

28 April 2010 An orientation-based fusion algorithm for multisensor image fusion

Yufeng Zheng

Proceedings Volume 7710, Multisensor, Multisource Information Fusion: Architectures, Algorithms, and Applications 2010; 77100K (2010) https://doi.org/10.1117/12.849656
Event: SPIE Defense, Security, and Sensing, 2010, Orlando, Florida, United States

Abstract

Multiscale fusion algorithms (wavelet or pyramid) can generally satisfy multisensory image fusion. However, those algorithms are not ideal to fuse visible images and infrared images whose intensities appear inverted. Therefore, a novel orientation-based fusion algorithm is proposed in this paper to address this problem. Specifically, a set of MxN Gabor wavelet transforms (GWT) are performed with two input images (I_A and I_B). At each frequency band (b = 1, 2, ..., M), the index of maximal GWT magnitude between two images is selected pixel by pixel; and then two index frequencies, H_A(b) and H_B(b), are calculated as its index accumulation along N orientations, respectively. The final H_A and H_B are the weighted summations through M bands, where the band weights (W_b) are given empirically. Eventually, the fused image is computed as I_F = (I_A .* H_A + IB .* H_B)/( H_A + H_B), where '.*' denotes element-by-element product of two arrays. The orientation-based fusion algorithm can be further varied by either keeping DC (direct current) or suppressing DC in GWT. "Keeping DC" will produce a contrast-smooth image; while "suppressing DC" will result a sharpened fusion. Color fusion is achieved by replacing the red channel of a color image with the fused image, which is suitable for poorly illuminated color images. Not only are the fused images of visible and infrared images satisfied, but the fusions of other image sets are also comparable to the results of multiscale fusion algorithms. The proposed algorithm can be applied to multiple (more than two) image fusion.

Citation Download Citation

Yufeng Zheng "An orientation-based fusion algorithm for multisensor image fusion", Proc. SPIE 7710, Multisensor, Multisource Information Fusion: Architectures, Algorithms, and Applications 2010, 77100K (28 April 2010); https://doi.org/10.1117/12.849656

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available