基于小波域清晰度评价的光场全聚焦图像融合

doi:10.13700/j.bh.1001-5965.2018.0739

摘要
图/表
参考文献
相关文章 (15)

全文: PDF (3852 KB) [HTML] ( )
输出: BibTeX | EndNote (RIS)

摘要传统全聚焦图像融合以相机多次曝光拍摄的多聚焦图像为基础，光场相机在单次曝光后可计算空间任意深度的重聚焦图像，为后期全聚焦图像的获取提供便利。提出了一种基于小波变换的光场全聚焦图像获取算法，可有效避免传统空域图像融合算法的块效应，获得较高质量的全聚焦图像。该算法通过对微透镜阵列光场相机获得的4D光场数据进行空间变换与投影，得到用于全聚焦图像融合的重聚焦图像，对各帧重聚焦图像进行小波分解提取高、低频子图像集，提出区域均衡拉普拉斯算子、像素可见度函数分别构建融合图像的高、低频小波系数实现图像融合，其性能优于传统的区域清晰度评价函数。实验验证了所提算法的正确性和有效性，采用Lytro光场相机的原始数据计算了融合全聚焦图像，与传统图像融合算法相比，人眼视觉效果更好，客观图像指标也得到了提高。

	服务

	把本文推荐给朋友
	加入我的书架
	加入引用管理器
	E-mail Alert
	RSS
	作者相关文章
	谢颖贤
	武迎春
	王玉梅
	赵贤凌
	王安红

关键词 ：光场相机, 数字重聚焦, 全聚焦, 小波变换, 拉普拉斯算子, 区域清晰度, 图像可见度

Abstract：Traditional all-in-focus image fusion based on the multi-focus images which are captured by multiple-exposure of the camera. Light field camera has the ability of calculating the refocused images at any depth after a single exposure, which makes it more advantageous in all-in-focus image calculation. A light field all-in-focus image fusion method based on wavelet transform is proposed in this paper. Compared with the spatial image fusion method, the proposed method can effectively avoid the block artifacts and obtain a fused image with high quality. First, the refocused images used for the all-in-focus image calculation can be computed through shearing and projecting the 4D light field captured by the microlens-based light field camera. Then, the wavelet transform are applied to the refocused images and the high-frequency and low-frequency sub-images are extracted respectively. Finally, the balanced Laplace operator and pixel visibility function are proposed to evaluate the sharpness of the sub-image and to get a high-quality fusion image.Compared to the traditional region based sharpness evaluation function, the proposed method has a better performance. The experiment results prove the correctness and validity of the proposed method. The raw images captured by Lytro light field camera are used to calculate the all-in-focus image. Compared with the traditional image fusion methods, the visual effect is better and the quantitative indices are also improved with the proposed method.

Key words： light field camera digital refocusing all-in-focus wavelet transform Laplace operator local sharpness image visibility

收稿日期: 2018-12-18

PACS:

TN911

基金资助:国家自然科学基金（61601318）；山西省青年科技研究基金（201601D021078）；山西省重点学科建设经费项目；山西省互联网+3D打印协同创新中心；山西省“1331工程”重点创新团队；山西省科技创新团队（201705D131025）；太原科技大学博士启动基金（20132023）；国家留学基金

通讯作者: 武迎春 E-mail: yingchunwu3030@foxmail.com

作者简介: 谢颖贤,男,硕士研究生。主要研究方向:光信息获取与处理;武迎春,女,博士,副教授,硕士生导师。主要研究方向:光信息获取与处理、光学三维传感。

引用本文:

谢颖贤, 武迎春, 王玉梅, 赵贤凌, 王安红. 基于小波域清晰度评价的光场全聚焦图像融合[J]. 北京航空航天大学学报, 2019, 45(9): 1848-1854.
XIE Yingxian, WU Yingchun, WANG Yumei, ZHAO Xianling, WANG Anhong. Light field all-in-focus image fusion based on wavelet domain sharpness evaluation. JOURNAL OF BEIJING UNIVERSITY OF AERONAUTICS AND A, 2019, 45(9): 1848-1854.

链接本文:

https://bhxb.buaa.edu.cn/CN/10.13700/j.bh.1001-5965.2018.0739 或 https://bhxb.buaa.edu.cn/CN/Y2019/V45/I9/1848

[1] NG R.Light field photography with a hand-held plenoptic camera:CSTR 2005-02[R].Stanford:Stanford University,2005.
[2] NG R.Fourier slice photography[J].ACM Transactions on Graphics,2005,24(3):735-744.
[3] TAO M W,HADAP S,MALIK J,et al.Depth from combining defocus and correspondence using light-field cameras[C]//IEEE International Conference on Computer Vision.Piscataway,NJ:IEEE Press,2013:673-680.
[4] BOK Y,JEON H G,KWEON I S.Geometric calibration of microlens-based light-field cameras using line features[C]//European Conference on Computer Vision.Berlin:Springer,2014:47-61.
[5] YOON Y,JEON H G,YOO D,et al.Light-field image super-resolution using convolutional neural network[J].IEEE Signal Processing Letters,2017,24(6):848-852.
[6] LIU J G.Smoothing filter-based intensity modulation:A spectral preserve image fusion technique for improving spatial details[J].International Journal of Remote Sensing,2000,21(18):3461-3472.
[7] Li S T,KANG X D,HU J W.Image fusion with guided filtering[J].IEEE Transactions on Image Processing,2013,22(7):2864-2875.
[8] FEICHTENHOFER C,FASSOLD H,SCHALLAUER P.A perceptual image sharpness metric based on local edge gradient analysis[J].IEEE Signal Processing Letters,2013,20(4):379-382.
[9] QIN X,ZHENG J,HU G,et al.Multi-focus image fusion based on window empirical mode decomposition[J].Infrared Physics & Technology,2017,85:251-260.
[10] FAKHARI F,MOSAVI M R,LAJVARDI M M.Image fusion based on multi-scale transform and sparse representation:Image energy approach[J].IET Image Processing,2017,11(11):1041-1049.
[11] NAYAR S K,NAKAGAWA Y.Shape from focus[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,1994,16(8):824-831.
[12] DENG C,MA W,YIN Y.An edge detection approach of image fusion based on improved Sobel operator[C]//IEEE International Congress on Image and Signal Processing.Piscataway,NJ:IEEE Press,2011,3:1189-1193.
[13] SHRIVAKSHAN G T,CHANDRASEKAR C.A comparison of various edge detection techniques used in image processing[J].International Journal of Computer Science Issues,2012,9(5):268-276.
[14] YANG Y,PARK D S,HUANG S,et al.Fusion of MT and MR images using an improved wavelet based method[J].Journal of X-ray Science and Technology,2010,18(2):157-170.
[15] HUANG W,JING Z.Evaluation of focus measures in multi-focus image fusion[J].Pattern Recognition Letters,2007,28(4):493-500.