| Citation: | YANG Yong, LU Hangyuan, HUANG Shuying, et al. Remote sensing image fusion method based on adaptive injection model[J]. Journal of Beijing University of Aeronautics and Astronautics, 2019, 45(12): 2351-2363. doi: 10.13700/j.bh.1001-5965.2019.0372(in Chinese)
|
The purpose of remote sensing image fusion is to fuse high-spectral-resolution low-spatial-resolution multispectral (MS) images and high-spatial-resolution low-spectral-resolution panchromatic (PAN) images, so as to obtain the fusion images with high spectral resolution and high spatial resolution. How to determine the injection details and injection coefficients in the injection model is the key to image fusion research. For detail optimization, a multi-scale Gaussian filter is defined by simulating the characteristics of MS sensor, and then the filter is used to convolve with PAN image to extract the details and obtain the details highly related to MS image. In order to optimize the injection coefficient, an adaptive injection coefficient is proposed based on spectral information and detail information. To better preserve the edge information, a new edge preserving weight matrix is proposed to achieve the dual fidelity of spectral information and space. Finally, the optimized injection coefficient is multiplied by details and injected into the up-sampled MS image to obtain the final fusion result. Performance analysis of the method proposed in this paper has been carried out and a large number of tests have been conducted in each satellite dataset. The experimental results show that, compared with the most advanced methods, the proposed method performs best in both subjective and comprehensive objective assessment.
| [1] |
GHASSEMIAN H.A review of remote sensing image fusion methods[J]. Information Fusion, 2016, 32:75-89. doi: 10.1016/j.inffus.2016.03.003
|
| [2] |
GEMINE V, PAOLO A, ROCCO R, et al.Pansharpening based on deconvolution for multiband filter estimation[J].IEEE Transactions on Geoscience and Remote Sensing, 2019, 57(1):540-552. doi: 10.1109/TGRS.2018.2858288
|
| [3] |
MALPICA J A.Hue adjustment to IHS pan-sharpened IKONOS imagery for vegetation enhancement[J].IEEE Geoscience and Remote Sensing Letters, 2007, 4(1):27-31. doi: 10.1109/LGRS.2006.883523
|
| [4] |
PSJR C, SIDES S C, ANDERSON J A.Comparison of three different methods to merge multiresolution and multispectral data:Landsat TM and SPOT panchromatic[J].Photogrammetric Engineering & Remote Sensing, 1991, 57(3):265-303. http://cn.bing.com/academic/profile?id=32f78ce8535f3ce1bb1f202d3705a7b3&encoded=0&v=paper_preview&mkt=zh-cn
|
| [5] |
LABEN C A, BROWER B V.Process for enhancing the spatial resolution of multispectral imagery using pan-sharpening: U.S.6011875 A[P].2000-01-04.
|
| [6] |
MENG X C, SHEN H F, LI H F, et al.Review of the pansharpening methods for remote sensing images based on the idea of meta-analysis:Practical discussion and challenges[J].Information Fusion, 2019, 46:102-113. doi: 10.1016/j.inffus.2018.05.006
|
| [7] |
LI S, KWOK J T, WANG Y.Using the discrete wavelet frame transform to merge Landsat TM and SPOT panchromatic images[J].Information Fusion, 2002, 3(1):17-23. doi: 10.1016/S1566-2535(01)00037-9
|
| [8] |
NUNEZ J, OTAZU X, FORS O, et al.Multiresolution-based image fusion with additive wavelet decomposition[J].IEEE Transactions on Geoscience and Remote Sensing, 1999, 37(3):1204-1211. doi: 10.1109/36.763274
|
| [9] |
CUNHA A L D, ZHOU J, DO M N.The nonsubsampled contourlet transform:Theory, design, and applications[J].IEEE Transactions on Image Processing, 2006, 15(10):3089-3101. doi: 10.1109/TIP.2006.877507
|
| [10] |
YIN M, LIU W, ZHAO X, et al.A novel image fusion algorithm based on nonsubsampled shearlet transform[J].Optik-International Journal for Light and Electron Optics, 2014, 125(10):2274-2282. doi: 10.1016/j.ijleo.2013.10.064
|
| [11] |
YANG Y, WAN W, HUANG S Y, et al.Remote sensing image fusion based on adaptive HIS and multiscale guided filter[J].IEEE Access, 2016, 4:4573-4582. doi: 10.1109/ACCESS.2016.2599403
|
| [12] |
YANG Y, WU L, HUANG S Y, et al.Compensation details-based injection model for remote sensing image fusion[J].IEEE Geoscience and Remote Sensing Letters, 2018, 15(5):734-738. doi: 10.1109/LGRS.2018.2810219
|
| [13] |
YANG Y, WU L, HUANG S Y, et al.Remote sensing image fusion based on adaptively weighted joint detail injection[J].IEEE Access, 2018, 6:6849-6864. doi: 10.1109/ACCESS.2018.2791574
|
| [14] |
GIUSEPPE M, DAVIDEC, LUISA V, et al.Pansharpening by convolutional neural networks[J].Remote Sensing, 2016, 8(7):594. doi: 10.3390/rs8070594
|
| [15] |
AIAZZI B, ALPARONE L, BARONTI S, et al.MTF-tailored multiscale fusion of high-resolution MS and pan imagery[J].Photogrammetric Engineering and Remote Sensing, 2006, 72(5):591-596. doi: 10.14358/PERS.72.5.591
|
| [16] |
VIVONE G, RESTAINO R, CHANUSSOT J.Full scale regression-based injection coefficients for panchromatic sharpening[J].IEEE Transactions on Image Processing, 2018, 27(7):3418-3431. doi: 10.1109/TIP.2018.2819501
|
| [17] |
YIN H, LI S.Pansharpening with multiscale normalized nonlocal means filter:A two-step approach[J].IEEE Transactions on Geoscience and Remote Sensing, 2015, 53(10):5734-5745. doi: 10.1109/TGRS.2015.2429691
|
| [18] |
VIVONE G, ALPARONE L, CHANUSSOT J, et al.A critical comparison among pansharpening algorithms[J].IEEE Transactions on Geoscience and Remote Sensing, 2015, 53(5):2565-2586. doi: 10.1109/TGRS.2014.2361734
|
| [19] |
RAHMANI S, STRAIT M, MERKURJEV D, et al.An adaptive IHS pan-sharpening method[J].IEEE Geoscience and Remote Sensing Letters, 2010, 7(4):746-750. doi: 10.1109/LGRS.2010.2046715
|
| [20] |
LEUNG Y, LIU J, ZHANG J.An improved adaptive intensity-hue-saturation method for the fusion of remote sensing images[J].IEEE Geoscience and Remote Sensing Letters, 2013, 11(5):985-989. http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=fc1cc43de2c9b14f8fbdc2db892dc1e9
|
| [21] |
HE K, SUN J, TANG X.Guided image filtering[J].IEEE Transactions on Pattern Analysis and Machine Intelligence, 2013, 35(6):1397-1409. doi: 10.1109/TPAMI.2012.213
|
| [22] |
杨勇, 阙越, 黄淑英, 等.多视觉特征和引导滤波的鲁棒多聚焦图像融合[J].计算机辅助设计与图形学学报, 2017, 29(7):1324-1333. doi: 10.3969/j.issn.1003-9775.2017.07.019
YANG Y, QUE Y, HUANG S Y, et al.Robust multifocus image fusion via multiple visual features and guided filtering[J].Journal of Computer-Aided Design & Computer Graphics, 2017, 29(7):1324-1333(in Chinese). doi: 10.3969/j.issn.1003-9775.2017.07.019
|
| [23] |
敬忠良, 肖刚.图像融合:理论与应用[M].北京:高等教育出版社, 2007:160-172.
JING Z L, XIAO G.Image fusion:Principle and application[M].Beijing:Higher Education Press, 2007:160-172(in Chinese).
|
| [24] |
YANG Y, WANG W G, HUANG S H, et al.Anovel pan-sharpening framework based on matting model and multiscale transform[J].Remote Sensing, 2017, 9(4):391-750. doi: 10.3390/rs9040391
|
| [25] |
YANG Y, WU L, HUANG S Y, et al.Pansharpening for multiband images with adaptive spectral-intensity modulation[J].IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2018, 11(9):3196-3208. doi: 10.1109/JSTARS.2018.2849011
|
| [26] |
WALD L, RANCHIN T, MANGOLINI M.Fusion of satellite images of different spatial resolutions:Assessing the quality of resulting images[J].Photogrammetric Engineering and Remote Sensing, 1997, 63(6):691-699. http://cn.bing.com/academic/profile?id=72dfcaea4793b5939cd13da01141c6b7&encoded=0&v=paper_preview&mkt=zh-cn
|
| [27] |
OTAZU X, GONZÁLEZ-AUDÍCANA M, FORS O, et al.Introduction of sensor spectral response into image fusion methods.Application to wavelet-based methods[J].IEEE Transactions on Geoscience and Remote Sensing, 2005, 43(10):2376-2385. doi: 10.1109/TGRS.2005.856106
|
| [28] |
KAPLAN N H, ERER I.Bilateral filtering-based enhanced pansharpening of multispectral satellite images[J].IEEE Geoscience and Remote Sensing Letters, 2014, 11(11):1941-1945. doi: 10.1109/LGRS.2014.2314389
|
| [29] |
WANG Z, BOVIK A C.A universal image quality index[J].IEEE Signal Processing Letters, 2002, 9(3):81-84. doi: 10.1109/97.995823
|
| [30] |
YANG Y, TONG S, HUANG S Y, et al.Multifocus image fusion based on NSCT and focused area detection[J].IEEE Sensors Journal, 2015, 15(5):2824-2838. http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=c9013ea70ae3b0bbd28431b1a11d9f02
|
| [31] |
RANCHIN T, WALD L.Fusion of high spatial and spectral resolution images:The ARSIS concept and its implementation[J].Photogrammetric Engineering and Remote Sensing, 2000, 66(1):49-61. http://cn.bing.com/academic/profile?id=a562d5815c79f8c211ee34e00625c010&encoded=0&v=paper_preview&mkt=zh-cn
|
| [32] |
ALPARONE L, WALD L, CHANUSSOT J, et al.Comparison of pansharpening algorithms:Outcome of the 2006 GRSS data fusion contest[J].IEEE Transactions on Geoscience and Remote Sensing, 2007, 45(10):3012-3021. doi: 10.1109/TGRS.2007.904923
|
| [33] |
WALD L.Quality of high resolution synthesized images: Is there a simple criterion [C]//Proceedings of the Third Conference on Fusion of Earth Data, 2000: 99-103.
|
| [34] |
ALPARONE L, AIAZZI B, BARONTI S, et al.Multispectral and panchromatic data fusion assessment without reference[J].Photogrammetric Engineering and Remote Sensing, 2008, 74(2):193-200. doi: 10.14358/PERS.74.2.193
|
Figures(9) / Tables(7)
Copyright © Journal of Beijing University of Aeronautics and Astronautics
Address: Editorial Department of Journal of Beijing University of Aeronautics and Astronautics, 37 Xueyuan Road, Haidian District, Beijing Post Code: 100191 Email: jbuaa@buaa.edu.cn
Supported by:
Beijing Renhe Information Technology Co., Ltd.
DownLoad:
