北京航空航天大学学报 ›› 2016, Vol. 42 ›› Issue (4): 762-771.doi: 10.13700/j.bh.1001-5965.2015.0293

• 论文 • 上一篇    下一篇

一种用于实时数字稳像的全分辨率运动补偿方法

翟博, 郑锦, 王越   

  1. 北京航空航天大学计算机学院, 北京 100083
  • 收稿日期:2015-05-10 出版日期:2016-04-20 发布日期:2016-04-29
  • 通讯作者: 郑锦, Tel.: 010-82339024 E-mail: jinzheng@buaa.edu.cn E-mail:jinzheng@buaa.edu.cn
  • 作者简介:翟博 男,博士研究生。主要研究方向:图像匹配、视频稳像。 E-mail: bozhai@buaa.edu.cn;郑锦 女,博士,讲师。主要研究方向:运动目标检测跟踪、视频稳像以及视频拼接。 Tel.: 010-82339024 E-mail: jinzheng@buaa.edu.cn;王越 女,博士研究生。主要研究方向:图像配准、视频拼接。
  • 基金资助:
    国家自然科学基金(61370124);国家“863”计划(2014AA015104);国家留学基金(20130307020)

A full-resolution motion compensation method used for real-time digital image stabilization

ZHAI Bo, ZHENG Jin, WANG Yue   

  1. School of Computer Science and Engineering, Beijing University of Aeronautics and Astronautics, Beijing 100083, China
  • Received:2015-05-10 Online:2016-04-20 Published:2016-04-29
  • Supported by:
    National Natural Science Foundation of China(61370124);National High-tech Research and Development Program of China(2014AA015104);China Scholarship Foundation (20130307020)

摘要: 以室外视频监控中帧间平移运动为研究对象,提出一种基于平衡位置修正与自适应存储帧更新的实时全分辨率数字稳像方法。首先利用卡尔曼滤波在线估计镜头的主动运动,预先确定抖动图像补偿后的平衡位置;然后针对图像补偿后产生的空白区域,通过选择合适的参考帧及预存帧构成存储帧队列,根据存储帧队列的覆盖范围对平衡位置进行修正,实现修正后空白区域像素的全部拼接填补;最后以修正后的平衡位置为基准,根据同时满足左上、右上、左下和右下4个偏移方向的原则对参考帧队列进行自适应在线更新,用最新采集帧替换时间上较早、空间内容上冗余的参考帧,使得存储帧队列在有限长度内保证尽可能大的空间覆盖。本文提出的方法可以满足实时数字全分辨率稳像的要求,适用于集成式、嵌入式等各类视频监控系统。

关键词: 室外视频监控, 实时数字稳像, 卡尔曼滤波, 全分辨率补偿, 平衡位置

Abstract: With the foundation of inter-frame translation motion of the videos captured in outdoor video monitoring, a real-time video stabilization method was presented with equilibrium position modification and adaptive update of storage frames, which can realize the full-resolution video stabilization. Firstly, the Kalman filter was used to estimate the intentional motion of the camera, in which the equilibrium position of the currently stabilized frame was obtained. Secondly, the reference frames and subsequent frames were stored. Based on the spatial coverage of the storage frames, the equilibrium position was modified to reach the full-resolution in-painting of the compensated current frame. Finally, taking the modified equilibrium position as the standard, and guaranteeing the coexistence of the storage frames with deviation in upper left, upper right, lower left, and lower right directions, we substituted the newest captured frames online for the earliest and redundant reference frames, so the storage frames can achieve the greatest coverage and temporal-spatial correlation with limited storage resource. The presented video stabilization algorithm achieves the full-resolution stabilization and real-time processing, which can be applied to the integrated and embedded video surveillance systems.

Key words: outdoor video monitoring, real-time digital image stabilization, Kalman filter, full-resolution compensation, equilibrium position

中图分类号: 


版权所有 © 《北京航空航天大学学报》编辑部
通讯地址:北京市海淀区学院路37号 北京航空航天大学学报编辑部 邮编:100191 E-mail:jbuaa@buaa.edu.cn
本系统由北京玛格泰克科技发展有限公司设计开发