一种用于实时数字稳像的全分辨率运动补偿方法

翟博; 郑锦; 王越

doi:10.13700/j.bh.1001-5965.2015.0293

一种用于实时数字稳像的全分辨率运动补偿方法

doi: 10.13700/j.bh.1001-5965.2015.0293

北京航空航天大学计算机学院, 北京 100083

基金项目: 国家自然科学基金(61370124);国家“863”计划(2014AA015104);国家留学基金(20130307020)

详细信息

作者简介:
翟博男,博士研究生。主要研究方向:图像匹配、视频稳像。 E-mail: bozhai@buaa.edu.cn;郑锦女,博士，讲师。主要研究方向:运动目标检测跟踪、视频稳像以及视频拼接。 Tel.: 010-82339024 E-mail: jinzheng@buaa.edu.cn;王越女,博士研究生。主要研究方向:图像配准、视频拼接。

通讯作者:
郑锦, Tel.: 010-82339024 E-mail: jinzheng@buaa.edu.cn

中图分类号: TP391
计量
- 文章访问数: 941
- HTML全文浏览量: 127
- PDF下载量: 554
- 被引次数: 0
出版历程
- 收稿日期: 2015-05-10
- 网络出版日期: 2016-04-20

A full-resolution motion compensation method used for real-time digital image stabilization

School of Computer Science and Engineering, Beijing University of Aeronautics and Astronautics, Beijing 100083, China

Funds: National Natural Science Foundation of China(61370124);National High-tech Research and Development Program of China(2014AA015104);China Scholarship Foundation (20130307020)

摘要

摘要: 以室外视频监控中帧间平移运动为研究对象,提出一种基于平衡位置修正与自适应存储帧更新的实时全分辨率数字稳像方法。首先利用卡尔曼滤波在线估计镜头的主动运动,预先确定抖动图像补偿后的平衡位置;然后针对图像补偿后产生的空白区域,通过选择合适的参考帧及预存帧构成存储帧队列,根据存储帧队列的覆盖范围对平衡位置进行修正,实现修正后空白区域像素的全部拼接填补;最后以修正后的平衡位置为基准,根据同时满足左上、右上、左下和右下4个偏移方向的原则对参考帧队列进行自适应在线更新,用最新采集帧替换时间上较早、空间内容上冗余的参考帧,使得存储帧队列在有限长度内保证尽可能大的空间覆盖。本文提出的方法可以满足实时数字全分辨率稳像的要求,适用于集成式、嵌入式等各类视频监控系统。
- 室外视频监控 /
- 实时数字稳像 /
- 卡尔曼滤波 /
- 全分辨率补偿 /
- 平衡位置
Abstract: With the foundation of inter-frame translation motion of the videos captured in outdoor video monitoring, a real-time video stabilization method was presented with equilibrium position modification and adaptive update of storage frames, which can realize the full-resolution video stabilization. Firstly, the Kalman filter was used to estimate the intentional motion of the camera, in which the equilibrium position of the currently stabilized frame was obtained. Secondly, the reference frames and subsequent frames were stored. Based on the spatial coverage of the storage frames, the equilibrium position was modified to reach the full-resolution in-painting of the compensated current frame. Finally, taking the modified equilibrium position as the standard, and guaranteeing the coexistence of the storage frames with deviation in upper left, upper right, lower left, and lower right directions, we substituted the newest captured frames online for the earliest and redundant reference frames, so the storage frames can achieve the greatest coverage and temporal-spatial correlation with limited storage resource. The presented video stabilization algorithm achieves the full-resolution stabilization and real-time processing, which can be applied to the integrated and embedded video surveillance systems.
- outdoor video monitoring /
- real-time digital image stabilization /
- Kalman filter /
- full-resolution compensation /
- equilibrium position

HTML全文

参考文献(18)

[1]	朱娟娟. 电子稳像理论及其应用研究[D].西安:西安电子科技大学,2009:6. ZHU J J.Research on theory and application of electronic image stabilization[D].Xi'an:Xidian University,2009:6(in Chinese).
[2]	邱家涛. 电子稳像算法和视觉跟踪算法研究[D].西安:西安电子科技大学,2013:16. QIU J T.A study of electronic image stabilization algorithms and visual tracking algorithms[D].Xi'an:Xidian University,2013:16(in Chinese).
[3]	KUMAR S, AZARTASH H,BISWAS M,et al.Real-time affine global motion estimation using phase correlation and its application for digital image stabilization[J].IEEE Transactions on Image Processing,2011,20(12):3046-3418.
[4]	吴浩,邓宏彬. 一种基于分块灰度投影运动估计的视频稳像方法[J].兵工学报,2013,34(4):406-411. WU H,DENG H B.A video stabilization method based on sub-block gray projection[J].Acta Armamentarii,2013,34(4):406-411(in Chinese).
[5]	LIU F,GLEICHER M, JIN H,et al.Content-preserving warps for 3D video stabilization[J].ACM Transactions on Graphics,2009,28(3):1-9.
[6]	LEE T H, LEE Y G,SONG B C.Fast 3D video stabilization using ROI-based warping[J].Journal of Visual Communication and Image Representation,2014,25(5):943-950.
[7]	GRUNDMANN M, KWATRA V,ESSA I.Auto-directed video stabilization with robust L1 optimal camera paths[C]//2011 IEEE Conference on Computer Vision and Pattern Recognition.Piscataway,NJ:IEEE Press,2011:225-232.
[8]	QU H, SONG L.Video stabilization with L1-L2 optimization[C]//20th IEEE International Conference on Image Processing.Piscataway,NJ:IEEE Press,2013:29-33.
[9]	ZHOU Z H, JIN H L,MA Y.Plane-based content preserving warps for video stabilization[C]//26th IEEE Conference on Computer Vision and Pattern Recognition.Piscataway,NJ:IEEE Press,2013:2299-2306.
[10]	TANAKIAN M J, REZAEI M,MOHANNA F.Real-time video stabilization by adaptive fuzzy filtering[C]//1st International Conference on Computer and Knowledge Engineering.Piscataway,NJ:IEEE Press,2011:126-131.
[11]	TSAI T H,FANG C L, CHUANG H M.Design and implementation of efficient video stabilization engine using maximum a posteriori estimation and motion energy smoothing approach[J].IEEE Transactions on Circuits and Systems for Video Technology,2012,22(6):817-830.
[12]	KWON O, SHIN J,PAIK J.Video stabilization using Kalman filter and phase correlation matching[J].Image Analysis and Recognition,2005,3656:141-148.
[13]	RYU Y G, CHUNG M J.Robust online digital image stabilization based on point-feature trajectory without accumulative global motion estimation[J].IEEE Signal Processing Letters,2012,19(4):223-226.
[14]	KIM Y G, JAYANTHI V R,KWEON I S.System-on-chip solution of video stabilization for CMOS image sensors in hand-held devices[J].IEEE Transactions on Circuits and Systems for Video Technology,2011,21(10):1401-1414.
[15]	钟平,于前洋,金光. 基于特征点匹配技术的运动估计及补偿方法[J].光电子·激光,2004,15(1):457-462. ZHONG P,YU Q Y,JIN G.Motion estimation and motion compensation based on matching technology of feature point[J].Journal of Optoelectronics·Laser,2004,15(1):457-462(in Chinese).
[16]	MATSUSHITA Y, OFEK E,GE W N,et al.Full-frame video stabilization with motion inpainting[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2006,28(7):1150-1163.
[17]	LIU Y K,YANG Z B. Motion compensation based on mosaic with near compatible frames[C]//4th International Congress on Image and Signal Processing.Piscataway,NJ:IEEE Press,2011,1:548-551.
[18]	LIU Y K, LV C Z,LI C.Motion correction with adaptive Kalman filter[J].Advanced Materials Research,2011,268-270:1768-1772.