Advanced Search
Volume 42 Issue 4
Apr.  2016
Turn off MathJax
Article Contents
Journal of Beijing University of Aeronautics and Astronautics  > 2016  >  42(4): 762-771.
ZHAI Bo, ZHENG Jin, WANG Yueet al. A full-resolution motion compensation method used for real-time digital image stabilization[J]. Journal of Beijing University of Aeronautics and Astronautics, 2016, 42(4): 762-771. doi: 10.13700/j.bh.1001-5965.2015.0293(in Chinese)
Citation: ZHAI Bo, ZHENG Jin, WANG Yueet al. A full-resolution motion compensation method used for real-time digital image stabilization[J]. Journal of Beijing University of Aeronautics and Astronautics, 2016, 42(4): 762-771. doi: 10.13700/j.bh.1001-5965.2015.0293(in Chinese)
shu

A full-resolution motion compensation method used for real-time digital image stabilization

doi: 10.13700/j.bh.1001-5965.2015.0293

  • School of Computer Science and Engineering, Beijing University of Aeronautics and Astronautics, Beijing 100083, China

Funds:  National Natural Science Foundation of China(61370124);National High-tech Research and Development Program of China(2014AA015104);China Scholarship Foundation (20130307020)
  • Received Date: 10 May 2015
  • Publish Date: 20 Apr 2016
    Abstract
  • With the foundation of inter-frame translation motion of the videos captured in outdoor video monitoring, a real-time video stabilization method was presented with equilibrium position modification and adaptive update of storage frames, which can realize the full-resolution video stabilization. Firstly, the Kalman filter was used to estimate the intentional motion of the camera, in which the equilibrium position of the currently stabilized frame was obtained. Secondly, the reference frames and subsequent frames were stored. Based on the spatial coverage of the storage frames, the equilibrium position was modified to reach the full-resolution in-painting of the compensated current frame. Finally, taking the modified equilibrium position as the standard, and guaranteeing the coexistence of the storage frames with deviation in upper left, upper right, lower left, and lower right directions, we substituted the newest captured frames online for the earliest and redundant reference frames, so the storage frames can achieve the greatest coverage and temporal-spatial correlation with limited storage resource. The presented video stabilization algorithm achieves the full-resolution stabilization and real-time processing, which can be applied to the integrated and embedded video surveillance systems.

     

    • FullText(HTML)
  • loading
    • References(18)
  • [1]
    朱娟娟. 电子稳像理论及其应用研究[D].西安:西安电子科技大学,2009:6. ZHU J J.Research on theory and application of electronic image stabilization[D].Xi'an:Xidian University,2009:6(in Chinese).
    [2]
    邱家涛. 电子稳像算法和视觉跟踪算法研究[D].西安:西安电子科技大学,2013:16. QIU J T.A study of electronic image stabilization algorithms and visual tracking algorithms[D].Xi'an:Xidian University,2013:16(in Chinese).
    [3]
    KUMAR S, AZARTASH H,BISWAS M,et al.Real-time affine global motion estimation using phase correlation and its application for digital image stabilization[J].IEEE Transactions on Image Processing,2011,20(12):3046-3418.
    [4]
    吴浩,邓宏彬. 一种基于分块灰度投影运动估计的视频稳像方法[J].兵工学报,2013,34(4):406-411. WU H,DENG H B.A video stabilization method based on sub-block gray projection[J].Acta Armamentarii,2013,34(4):406-411(in Chinese).
    [5]
    LIU F,GLEICHER M, JIN H,et al.Content-preserving warps for 3D video stabilization[J].ACM Transactions on Graphics,2009,28(3):1-9.
    [6]
    LEE T H, LEE Y G,SONG B C.Fast 3D video stabilization using ROI-based warping[J].Journal of Visual Communication and Image Representation,2014,25(5):943-950.
    [7]
    GRUNDMANN M, KWATRA V,ESSA I.Auto-directed video stabilization with robust L1 optimal camera paths[C]//2011 IEEE Conference on Computer Vision and Pattern Recognition.Piscataway,NJ:IEEE Press,2011:225-232.
    [8]
    QU H, SONG L.Video stabilization with L1-L2 optimization[C]//20th IEEE International Conference on Image Processing.Piscataway,NJ:IEEE Press,2013:29-33.
    [9]
    ZHOU Z H, JIN H L,MA Y.Plane-based content preserving warps for video stabilization[C]//26th IEEE Conference on Computer Vision and Pattern Recognition.Piscataway,NJ:IEEE Press,2013:2299-2306.
    [10]
    TANAKIAN M J, REZAEI M,MOHANNA F.Real-time video stabilization by adaptive fuzzy filtering[C]//1st International Conference on Computer and Knowledge Engineering.Piscataway,NJ:IEEE Press,2011:126-131.
    [11]
    TSAI T H,FANG C L, CHUANG H M.Design and implementation of efficient video stabilization engine using maximum a posteriori estimation and motion energy smoothing approach[J].IEEE Transactions on Circuits and Systems for Video Technology,2012,22(6):817-830.
    [12]
    KWON O, SHIN J,PAIK J.Video stabilization using Kalman filter and phase correlation matching[J].Image Analysis and Recognition,2005,3656:141-148.
    [13]
    RYU Y G, CHUNG M J.Robust online digital image stabilization based on point-feature trajectory without accumulative global motion estimation[J].IEEE Signal Processing Letters,2012,19(4):223-226.
    [14]
    KIM Y G, JAYANTHI V R,KWEON I S.System-on-chip solution of video stabilization for CMOS image sensors in hand-held devices[J].IEEE Transactions on Circuits and Systems for Video Technology,2011,21(10):1401-1414.
    [15]
    钟平,于前洋,金光. 基于特征点匹配技术的运动估计及补偿方法[J].光电子·激光,2004,15(1):457-462. ZHONG P,YU Q Y,JIN G.Motion estimation and motion compensation based on matching technology of feature point[J].Journal of Optoelectronics·Laser,2004,15(1):457-462(in Chinese).
    [16]
    MATSUSHITA Y, OFEK E,GE W N,et al.Full-frame video stabilization with motion inpainting[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2006,28(7):1150-1163.
    [17]
    LIU Y K,YANG Z B. Motion compensation based on mosaic with near compatible frames[C]//4th International Congress on Image and Signal Processing.Piscataway,NJ:IEEE Press,2011,1:548-551.
    [18]
    LIU Y K, LV C Z,LI C.Motion correction with adaptive Kalman filter[J].Advanced Materials Research,2011,268-270:1768-1772.
    • Relative Articles
    • Supplements(0)
    • Cited By
  • 加载中

Catalog

    通讯作者: 陈斌, bchen63@163.com
    • 1. 

      沈阳化工大学材料科学与工程学院 沈阳 110142

    1. 本站搜索
    2. 百度学术搜索
    3. 万方数据库搜索
    4. CNKI搜索
    Get Citation
    PDF
    XML

    Article Metrics

    Article views(854) PDF downloads(554) Cited by()
    Proportional views
    Related

    Copyright © Journal of Beijing University of Aeronautics and Astronautics

    Address: Editorial Department of Journal of Beijing University of Aeronautics and Astronautics, 37 Xueyuan Road, Haidian District, Beijing Post Code: 100191 Email: jbuaa@buaa.edu.cn

    Supported by: Beijing Renhe Information Technology Co., Ltd.    

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return