基于自适应注入模型的遥感图像融合方法

doi:10.13700/j.bh.1001-5965.2019.0372

北京航空航天大学学报 ›› 2019, Vol. 45 ›› Issue (12): 2351-2363.doi: 10.13700/j.bh.1001-5965.2019.0372

基于自适应注入模型的遥感图像融合方法

杨勇¹, 卢航远¹, 黄淑英², 涂伟¹, 李露奕¹

1. 江西财经大学信息管理学院, 南昌 330032;
2. 江西财经大学软件与物联网工程学院, 南昌 330032

收稿日期:2019-07-09 出版日期:2019-12-20 发布日期:2019-12-31
通讯作者: 杨勇 E-mail:greatyangy@126.com
作者简介:杨勇男,博士,教授,博士生导师。主要研究方向:图像处理、模式识别;卢航远男,博士研究生。主要研究方向:图像处理;黄淑英女,博士,副教授。主要研究方向:图像处理、机器学习;涂伟男,博士研究生。主要研究方向:图像处理;李露奕女,硕士研究生。主要研究方向:图像处理。
基金资助:
国家自然科学基金（61662026，61862030）；江西省自然科学基金（20182BCB22006，20181BAB202010，20192ACB20002，20192ACBL21008）；江西省教育厅科学技术研究项目（GJJ170312，GJJ170318）；江西省研究生创新专项资金（YC2019-B094，YC2018-B065）

Remote sensing image fusion method based on adaptive injection model

YANG Yong¹, LU Hangyuan¹, HUANG Shuying², TU Wei¹, LI Luyi¹

1. School of Information Technology, Jiangxi University of Finance and Economics, Nanchang 330032, China;
2. School of Software and Internet Things Engineering, Jiangxi University of Finance and Economics, Nanchang 330032, China

Received:2019-07-09 Online:2019-12-20 Published:2019-12-31
Supported by:
National Natural Science Foundation of China (61662026,61862030); Natural Science Foundation of Jiangxi,China (20182BCB22006, 20181BAB202010,20192ACB20002,20192ACBL21008); Science Research Foundation of Education Bureau of Jiangxi Province, China (GJJ170312,GJJ170318); Knowledge Innovation Fund for the Graduate Students of Jiangxi Province (YC2019-B094,YC2018-B065)

摘要/Abstract

摘要： 遥感图像融合的目的是融合高光谱分辨率、低空间分辨率的多光谱（MS）图像和高空间分辨率、低光谱分辨率的全色（PAN）图像，得到高光谱分辨率与高空间分辨率的融合图像。遥感图像的注入模型中如何确定注入细节及注入系数是该技术研究的关键。针对注入细节优化，先通过模拟MS传感器的特性来定义一种多尺度高斯滤波器，再用该滤波器卷积PAN图像以提取细节，得到与MS图像高度相关的细节。针对注入系数优化，综合考虑光谱信息与细节信息提出一种自适应的注入量系数。为更好地保留边缘信息，提出一种新的边缘保持权重矩阵，实现光谱信息与空间的双保真。将优化后的注入系数与注入细节相乘注入到上采样后的MS图像中，得到融合结果。对所提方法进行性能分析，并在各卫星数据集上进行大量测试，与一些先进的遥感图像融合方法进行对比，实验结果表明，所提方法在主观与综合客观指标上都能达到最优。

关键词: 遥感图像融合, 高斯滤波, 注入系数, 边缘保持, 质量评价

Abstract: The purpose of remote sensing image fusion is to fuse high-spectral-resolution low-spatial-resolution multispectral (MS) images and high-spatial-resolution low-spectral-resolution panchromatic (PAN) images, so as to obtain the fusion images with high spectral resolution and high spatial resolution. How to determine the injection details and injection coefficients in the injection model is the key to image fusion research. For detail optimization, a multi-scale Gaussian filter is defined by simulating the characteristics of MS sensor, and then the filter is used to convolve with PAN image to extract the details and obtain the details highly related to MS image. In order to optimize the injection coefficient, an adaptive injection coefficient is proposed based on spectral information and detail information. To better preserve the edge information, a new edge preserving weight matrix is proposed to achieve the dual fidelity of spectral information and space. Finally, the optimized injection coefficient is multiplied by details and injected into the up-sampled MS image to obtain the final fusion result. Performance analysis of the method proposed in this paper has been carried out and a large number of tests have been conducted in each satellite dataset. The experimental results show that,compared with the most advanced methods, the proposed method performs best in both subjective and comprehensive objective assessment.

Key words: remote sensing image fusion, Gaussian filter, injection coefficient, edge preserving, quality evaluation

中图分类号:

TP391.41

杨勇, 卢航远, 黄淑英, 涂伟, 李露奕. 基于自适应注入模型的遥感图像融合方法[J]. 北京航空航天大学学报, 2019, 45(12): 2351-2363.

YANG Yong, LU Hangyuan, HUANG Shuying, TU Wei, LI Luyi. Remote sensing image fusion method based on adaptive injection model[J]. JOURNAL OF BEIJING UNIVERSITY OF AERONAUTICS AND A, 2019, 45(12): 2351-2363.

参考文献

[1] GHASSEMIAN H.A review of remote sensing image fusion methods[J]. Information Fusion,2016,32:75-89.
[2] GEMINE V,PAOLO A,ROCCO R,et al.Pansharpening based on deconvolution for multiband filter estimation[J].IEEE Transactions on Geoscience and Remote Sensing,2019,57(1):540-552.
[3] MALPICA J A.Hue adjustment to IHS pan-sharpened IKONOS imagery for vegetation enhancement[J].IEEE Geoscience and Remote Sensing Letters,2007,4(1):27-31.
[4] PSJR C,SIDES S C,ANDERSON J A.Comparison of three different methods to merge multiresolution and multispectral data:Landsat TM and SPOT panchromatic[J].Photogrammetric Engineering & Remote Sensing,1991,57(3):265-303.
[5] LABEN C A,BROWER B V.Process for enhancing the spatial resolution of multispectral imagery using pan-sharpening:U.S.6011875 A[P].2000-01-04.
[6] MENG X C,SHEN H F,LI H F,et al.Review of the pansharpening methods for remote sensing images based on the idea of meta-analysis:Practical discussion and challenges[J].Information Fusion,2019,46:102-113.
[7] LI S,KWOK J T,WANG Y.Using the discrete wavelet frame transform to merge Landsat TM and SPOT panchromatic images[J].Information Fusion,2002,3(1):17-23.
[8] NUNEZ J,OTAZU X,FORS O,et al.Multiresolution-based image fusion with additive wavelet decomposition[J].IEEE Transactions on Geoscience and Remote Sensing,1999,37(3):1204-1211.
[9] CUNHA A L D,ZHOU J,DO M N.The nonsubsampled contourlet transform:Theory,design,and applications[J].IEEE Transactions on Image Processing,2006,15(10):3089-3101.
[10] YIN M,LIU W,ZHAO X,et al.A novel image fusion algorithm based on nonsubsampled shearlet transform[J].Optik-International Journal for Light and Electron Optics,2014,125(10):2274-2282.
[11] YANG Y,WAN W,HUANG S Y,et al.Remote sensing image fusion based on adaptive HIS and multiscale guided filter[J].IEEE Access,2016,4:4573-4582.
[12] YANG Y,WU L,HUANG S Y,et al.Compensation details-based injection model for remote sensing image fusion[J].IEEE Geoscience and Remote Sensing Letters,2018,15(5):734-738.
[13] YANG Y,WU L,HUANG S Y,et al.Remote sensing image fusion based on adaptively weighted joint detail injection[J].IEEE Access,2018,6:6849-6864.
[14] GIUSEPPE M,DAVIDEC,LUISA V,et al.Pansharpening by convolutional neural networks[J].Remote Sensing,2016,8(7):594.
[15] AIAZZI B,ALPARONE L,BARONTI S,et al.MTF-tailored multiscale fusion of high-resolution MS and pan imagery[J].Photogrammetric Engineering and Remote Sensing,2006,72(5):591-596.
[16] VIVONE G,RESTAINO R,CHANUSSOT J.Full scale regression-based injection coefficients for panchromatic sharpening[J].IEEE Transactions on Image Processing,2018,27(7):3418-3431.
[17] YIN H,LI S.Pansharpening with multiscale normalized nonlocal means filter:A two-step approach[J].IEEE Transactions on Geoscience and Remote Sensing,2015,53(10):5734-5745.
[18] VIVONE G,ALPARONE L,CHANUSSOT J,et al.A critical comparison among pansharpening algorithms[J].IEEE Transactions on Geoscience and Remote Sensing,2015,53(5):2565-2586.
[19] RAHMANI S,STRAIT M,MERKURJEV D,et al.An adaptive IHS pan-sharpening method[J].IEEE Geoscience and Remote Sensing Letters,2010,7(4):746-750.
[20] LEUNG Y,LIU J,ZHANG J.An improved adaptive intensity-hue-saturation method for the fusion of remote sensing images[J].IEEE Geoscience and Remote Sensing Letters,2013,11(5):985-989.
[21] HE K,SUN J,TANG X.Guided image filtering[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2013,35(6):1397-1409.
[22] 杨勇,阙越,黄淑英,等.多视觉特征和引导滤波的鲁棒多聚焦图像融合[J].计算机辅助设计与图形学学报,2017,29(7):1324-1333.YANG Y,QUE Y,HUANG S Y,et al.Robust multifocus image fusion via multiple visual features and guided filtering[J].Journal of Computer-Aided Design & Computer Graphics,2017,29(7):1324-1333(in Chinese).
[23] 敬忠良,肖刚.图像融合:理论与应用[M].北京:高等教育出版社,2007:160-172.JING Z L,XIAO G.Image fusion:Principle and application[M].Beijing:Higher Education Press,2007:160-172(in Chinese).
[24] YANG Y,WANG W G,HUANG S H,et al.Anovel pan-sharpening framework based on matting model and multiscale transform[J].Remote Sensing,2017,9(4):391-750.
[25] YANG Y,WU L,HUANG S Y,et al.Pansharpening for multiband images with adaptive spectral-intensity modulation[J].IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing,2018,11(9):3196-3208.
[26] WALD L,RANCHIN T,MANGOLINI M.Fusion of satellite images of different spatial resolutions:Assessing the quality of resulting images[J].Photogrammetric Engineering and Remote Sensing,1997,63(6):691-699.
[27] OTAZU X,GONZÁLEZ-AUDÍCANA M,FORS O,et al.Introduction of sensor spectral response into image fusion methods.Application to wavelet-based methods[J].IEEE Transactions on Geoscience and Remote Sensing,2005,43(10):2376-2385.
[28] KAPLAN N H,ERER I.Bilateral filtering-based enhanced pansharpening of multispectral satellite images[J].IEEE Geoscience and Remote Sensing Letters,2014,11(11):1941-1945.
[29] WANG Z,BOVIK A C.A universal image quality index[J].IEEE Signal Processing Letters,2002,9(3):81-84.
[30] YANG Y,TONG S,HUANG S Y,et al.Multifocus image fusion based on NSCT and focused area detection[J].IEEE Sensors Journal,2015,15(5):2824-2838.
[31] RANCHIN T,WALD L.Fusion of high spatial and spectral resolution images:The ARSIS concept and its implementation[J].Photogrammetric Engineering and Remote Sensing,2000,66(1):49-61.
[32] ALPARONE L,WALD L,CHANUSSOT J,et al.Comparison of pansharpening algorithms:Outcome of the 2006 GRSS data fusion contest[J].IEEE Transactions on Geoscience and Remote Sensing,2007,45(10):3012-3021.
[33] WALD L.Quality of high resolution synthesized images:Is there a simple criterion?[C]//Proceedings of the Third Conference on Fusion of Earth Data,2000:99-103.
[34] ALPARONE L,AIAZZI B,BARONTI S,et al.Multispectral and panchromatic data fusion assessment without reference[J].Photogrammetric Engineering and Remote Sensing,2008,74(2):193-200.

基于自适应注入模型的遥感图像融合方法

Remote sensing image fusion method based on adaptive injection model

PDF (PC)

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 7

编辑推荐

Metrics

本文评价

[1]	翟宇轩, 刘怡桑, 徐艺文, 陈忠辉, 房颖, 赵铁松. 基于HTTP自适应流媒体传输的3D视频质量评价[J]. 北京航空航天大学学报, 2019, 45(12): 2456-2462.
[2]	滕怀亮, 李本威, 高永, 杨栋, 张赟. 基于飞行数据的无人机平飞动作质量评价模型[J]. 北京航空航天大学学报, 2019, 45(10): 2108-2114.
[3]	曲家慧, 李云松, 董文倩, 郑毓轩. 基于边缘保持滤波和结构张量的遥感图像融合[J]. 北京航空航天大学学报, 2018, 44(12): 2479-2488.
[4]	刘春辉, 齐越, 丁文锐. 基于大气光鲁棒估计的无人机图像去雾方法[J]. 北京航空航天大学学报, 2017, 43(6): 1105-1111.
[5]	庞丽萍, 曲洪权. 基于证据理论的潜艇舱室综合环境质量评价[J]. 北京航空航天大学学报, 2008, 34(11): 1243-1246.
[6]	杨威,赵剡,许东. 基于人眼视觉的结构相似度图像质量评价方法[J]. 北京航空航天大学学报, 2008, 34(01): 1-4.
[7]	宋志东, 李运华. 面向需求的通用弹药质量评价[J]. 北京航空航天大学学报, 2005, 31(05): 485-488.