| Citation: | JI L N，GUO X M，YANG F B. Adaptive layered fusion algorithm for infrared and visible video based on possibility theory[J]. Journal of Beijing University of Aeronautics and Astronautics，2024，50（10）：3021-3031 （in Chinese） doi: 10.13700/j.bh.1001-5965.2022.0765
|
The current infrared and visible video fusion model cannot dynamically adjust the fusion strategy according to the difference between videos, resulting in poor fusion effect or even failure. To address this issue,an adaptive layered fusion algorithm for infrared and visible video based on possibility theory was proposed. First, the magnitudes of various difference features of the region of interest in each frame of the video sequence were calculated, and the main difference features corresponding to each frame were obtained. Secondly, a layered fusion framework was built to determine the variables of each layer. The fusion effectiveness of different variables for each difference feature was calculated based on cosine similarity, and the possibility theory was used to construct the corresponding fusion effectiveness distribution.Then, the fusion effect of different variables for various difference features was analyzed layer by layer, and the optimal variable of each layer was selected. Finally, the adaptive layered fusion of infrared and visible video was realized through the optimal combination of variables. The experimental results show that the method in this paper has achieved remarkable fusion results in preserving typical infrared targets and visible structural details, and it is superior to other single fusion methods in quantitative analysis and qualitative evaluation.
| [1] |
赵志刚, 王鑫, 彭廷海, 等. 国外中长波双波段红外成像技术的发展及应用[J]. 红外技术, 2020, 42(4): 312-319. doi: 10.3724/SP.J.7101502294
ZHAO Z G, WANG X, PENG T H, et al. Status quo and application of middle and long wave dual-band infrared imaging technologies in occident[J]. Infrared Technology, 2020, 42(4): 312-319(in Chinese). doi: 10.3724/SP.J.7101502294
|
| [2] |
MA J Y, MA Y, LI C. Infrared and visible image fusion methods and applications: A survey[J]. Information Fusion, 2019, 45: 153-178.
|
| [3] |
DUJ, LI W S, XIAO B, et al. Union Laplacian pyramid with multiple features for medical image fusion[J]. Neurocomputing, 2016, 194: 326-339.
|
| [4] |
唐超影, 浦世亮, 叶鹏钊, 等. 基于卷积神经网络的低照度可见光与近红外图像融合[J]. 光学学报, 2020, 40(16): 1610001.
TANG C Y, PU S L, YE P Z, et al. Fusion of low-illuminance visible and near-infrared images based on convolutional neural networks[J]. Acta Optica Sinica, 2020, 40(16): 1610001(in Chinese).
|
| [5] |
LI H F, WANG Y T, YANG Z, et al. Discriminative dictionary learning-based multiple component decomposition for detail-preserving noisy image fusion[J]. IEEE Transactions on Instrumentation and Measurement, 2020, 69(4): 1082-1102.
|
| [6] |
王文卿, 马笑, 刘涵. 基于联合低秩稀疏分解的红外与可见光图像融合[J]. 信号处理, 2021, 37(9): 1770-1780.
WANG W Q, MA X, LIU H. Infrared and visible image fusion via joint low-rank and sparse decomposition[J]. Journal of Signal Processing, 2021, 37(9): 1770-1780(in Chinese).
|
| [7] |
HU H M, WU J W, LI B, et al. An adaptive fusion algorithm for visible and infrared videos based on entropy and the cumulative distribution of gray levels[J]. IEEE Transactions on Multimedia, 2017, 19(12): 2706-2719. doi: 10.1109/TMM.2017.2711422
|
| [8] |
ZHANG Q, WANG Y B, LEVINE M D, et al. Multisensor video fusion based on higher order singular value decomposition[J]. Information Fusion, 2015, 24: 54-71. doi: 10.1016/j.inffus.2014.09.008
|
| [9] |
ZHANG Q, WANG L, MA Z K, et al. A novel video fusion framework using surfacelet transform[J]. Optics Communications, 2012, 285(13-14): 3032-3041. doi: 10.1016/j.optcom.2012.02.064
|
| [10] |
郭小铭, 吉琳娜, 杨风暴. 基于可能性信息质量合成的双模态红外图像融合算法选取[J]. 光子学报, 2021, 50(3): 0310003.
GUO X M, JI L N, YANG F B. Dual-mode infrared image fusion algorithm selection based on possibility information quality synthesis[J]. Acta Photonica Sinica, 2021, 50(3): 0310003(in Chinese).
|
| [11] |
JI L N, YANG F B, GUO X M. Set-valued mapping cloud model and its application for fusion algorithm selection of dual mode infrared images[J]. IEEE Access, 2021, 9: 54338-54349.
|
| [12] |
杨风暴. 红外偏振与光强图像的拟态融合原理和模型研究[J]. 中北大学学报(自然科学版), 2017, 38(1): 1-8.
YANG F B. Research on theory and model of mimic fusion between infrared polarization and intensity images[J]. Journal of North University of China (Natural Science Edition), 2017, 38(1): 1-8(in Chinese).
|
| [13] |
张雷, 杨风暴, 吉琳娜. 差异特征指数测度的红外偏振与光强图像多算法融合[J]. 火力与指挥控制, 2018, 43(2): 49-54.
ZHANG L, YANG F B, JI L N. Multi algorithm fusion of infrared polarization and intensity image based on difference feature exponential measure[J]. Fire Control & Command Control, 2018, 43(2): 49-54(in Chinese).
|
| [14] |
JI L N, YANG F B, GUO X M. Image fusion algorithm selection based on fusion validity distribution combination of difference features[J]. Electronics, 2021, 10(15): 1752. doi: 10.3390/electronics10151752
|
| [15] |
杨风暴, 吉琳娜, 王肖霞. 可能性理论及应用[M]. 北京: 科学出版社, 2019: 41-45.
YANG F B, JI L N, WANG X X. Possibility theory and application[M]. Beijing: Science Press, 2019: 41-45(in Chinese).
|
| [16] |
LI S T, YANG B, HU J W. Performance comparison of different multi-resolution transforms for image fusion[J]. Information Fusion, 2011, 12(2): 74-84. doi: 10.1016/j.inffus.2010.03.002
|
| [17] |
HAN Y, CAI Y Z, CAO Y, et al. A new image fusion performance metric based on visual information fidelity[J]. Information Fusion, 2013, 14(2): 127-135. doi: 10.1016/j.inffus.2011.08.002
|
| [1] | GUO Z J，LU H，LIU N，et al. Total ionizing dose effect analysis and radiation hardening design method of Buck-Boost converter[J]. Journal of Beijing University of Aeronautics and Astronautics，2025，51（2）：389-396 （in Chinese）. doi: 10.13700/j.bh.1001-5965.2023.0050. |
| [2] | CHEN Zhao, LIU Zechao. Self-supervised optical fiber sensing signal separation based on linear convolutive mixing process[J]. Journal of Beijing University of Aeronautics and Astronautics. doi: 10.13700/j.bh.1001-5965.2024.0409 |
| [3] | WU Z Y，GAO Z X，CHEN X M，et al. Mach number effect in shock-wave/turbulent-boundary-layer interaction flow[J]. Journal of Beijing University of Aeronautics and Astronautics，2024，50（11）：3484-3494 （in Chinese）. doi: 10.13700/j.bh.1001-5965.2022.0857. |
| [4] | ZHANG Z B，JING S Z，YUAN S P，et al. Robust analysis of hydrodynamic performance under variable rotation speeds[J]. Journal of Beijing University of Aeronautics and Astronautics，2024，50（4）：1219-1228 （in Chinese）. doi: 10.13700/j.bh.1001-5965.2022.0480. |
| [5] | LIAO Yu-zhou, ZHANG Shu-guang, HAN Peng-xin, XIONG Zhi-yue. Transfer function model of sloshing force effect of liquid propellant and its application[J]. Journal of Beijing University of Aeronautics and Astronautics. doi: 10.13700/j.bh.1001-5965.2023.0626 |
| [6] | WANG J D，WANG X，TIAN Y R，et al. Threat assessment of radar radiation sources based on behavioral characteristics[J]. Journal of Beijing University of Aeronautics and Astronautics，2024，50（10）：3196-3207 （in Chinese）. doi: 10.13700/j.bh.1001-5965.2022.0848. |
| [7] | LI Jinjian, WANG Haibo, SONG Honglin, YANG Qingbo, BAO Maocheng, QIAN Huazheng, LI Bo. Research on network delay compensation strategy for large-span flexible support photovoltaic module installation equipment[J]. Journal of Beijing University of Aeronautics and Astronautics. doi: 10.13700/j.bh.1001-5965.2024.0371 |
| [8] | WANG Haipeng, LIU Haina, WANG Zhendong, MOU Cunxiao, ZHANG He, YE Wen. Pod integrated navigation system elastic lever arm error compensation method[J]. Journal of Beijing University of Aeronautics and Astronautics. doi: 10.13700/j.bh.1001-5965.2024.0155 |
| [9] | CHEN Y，FANG Y Z，HAN T，et al. Incremental guidance method for kinetic kill vehicles with target maneuver compensation[J]. Journal of Beijing University of Aeronautics and Astronautics，2024，50（3）：831-838 （in Chinese）. doi: 10.13700/j.bh.1001-5965.2022.0519. |
| [10] | ZHAO S，LIN L，LI Z，et al. Deck motion prediction and compensation technology based on BP neural network[J]. Journal of Beijing University of Aeronautics and Astronautics，2024，50（9）：2772-2780 （in Chinese）. doi: 10.13700/j.bh.1001-5965.2022.0743. |
| [11] | LI Zhonghua, CHEN Chan, WANG Xuejin, CHEN Weiling. Sonar Image Quality Assessment Based on Cross-Network Feature Compensation[J]. Journal of Beijing University of Aeronautics and Astronautics. doi: 10.13700/j.bh.1001-5965.2024.0440 |
| [12] | ZHANG D B，WANG L X，LI C. Simulation analysis of reduction effect of symmetrical winding method for multi-polar fiber ring on Shupe error[J]. Journal of Beijing University of Aeronautics and Astronautics，2023，49（7）：1715-1721 （in Chinese）. doi: 10.13700/j.bh.1001-5965.2021.0530. |
| [13] | WANG F F，TANG S J，SUN X Y，et al. Remaining useful life prediction based on multi source information with considering random effects[J]. Journal of Beijing University of Aeronautics and Astronautics，2023，49（11）：3075-3085 （in Chinese）. doi: 10.13700/j.bh.1001-5965.2021.0782. |
| [14] | ZHUANG Z B，WANG W H，TAI H D，et al. Influence of contrast threshold effect on runway visual range measurement[J]. Journal of Beijing University of Aeronautics and Astronautics，2023，49（11）：2906-2912 （in Chinese）. doi: 10.13700/j.bh.1001-5965.2022.0040. |
| [15] | CHEN Sheng-jiu, YANG You-xu, ZHANG Xing-cui, WU Yi-fei. A propeller design method considering slipstream effect and its application[J]. Journal of Beijing University of Aeronautics and Astronautics. doi: 10.13700/j.bh.1001-5965.2023.0533 |
| [16] | SHI Z，WANG B，YANG B，et al. Single-event radiation hardening method for 14 nm pFinFET device[J]. Journal of Beijing University of Aeronautics and Astronautics，2023，49（12）：3335-3342 （in Chinese）. doi: 10.13700/j.bh.1001-5965.2022.0071. |
| [17] | GUO Zhong-jie, REN Yuan, WANG Ya-peng, QIU Zi-yi, LI Meng-li. On-chip real-time monitoring with adaptive compensation for total dose bandgap[J]. Journal of Beijing University of Aeronautics and Astronautics. doi: 10.13700/j.bh.1001-5965.2023.0697 |
| [18] | WU X C，HONG L. Importance evaluation of JTC compensation capacitor based on reliability truth table[J]. Journal of Beijing University of Aeronautics and Astronautics，2023，49（10）：2579-2586 （in Chinese）. doi: 10.13700/j.bh.1001-5965.2021.0767. |
| [19] | ZHOU B J，YU C Q，TAN L L，et al. Fast leveling control technology of vehicle platform based on interference compensation[J]. Journal of Beijing University of Aeronautics and Astronautics，2023，49（6）：1495-1503 （in Chinese）. doi: 10.13700/j.bh.1001-5965.2021.0447. |
| [20] | SU Donglin, CUI Shuo, BAI Jiangfei, LI Yaoyao. Fast prediction method for radiated and scattered coupled fields in complex electromagnetic environment[J]. Journal of Beijing University of Aeronautics and Astronautics, 2022, 48(9): 1553-1560. doi: 10.13700/j.bh.1001-5965.2022.0705 |
Figures(10) / Tables(6)
Copyright © Journal of Beijing University of Aeronautics and Astronautics
Address: Editorial Department of Journal of Beijing University of Aeronautics and Astronautics, 37 Xueyuan Road, Haidian District, Beijing Post Code: 100191 Email: jbuaa@buaa.edu.cn
Supported by:
Beijing Renhe Information Technology Co., Ltd.
Wu Xingming, Chen Weihai, Yu Shouqian, et al. Development of PCI-based multi-axis controller[J]. Journal of Beijing University of Aeronautics and Astronautics, 2008, 34(01): 112-116. (in Chinese)
DownLoad:
