一种基于曼哈顿距离的帧间加权预测算法

doi:10.13700/j.bh.1001-5965.2019.0371

北京航空航天大学学报 ›› 2019, Vol. 45 ›› Issue (12): 2415-2422.doi: 10.13700/j.bh.1001-5965.2019.0371

一种基于曼哈顿距离的帧间加权预测算法

郭红伟^1,2, 朱策², 李帅², 王永华²

1. 红河学院工学院, 蒙自 661100;
2. 电子科技大学信息与通信工程学院, 成都 611731

收稿日期:2019-07-09 出版日期:2019-12-20 发布日期:2019-12-31
通讯作者: 朱策 E-mail:eczhu@uestc.edu.cn
作者简介:郭红伟男,博士研究生,副教授。主要研究方向:视频编码与通信;朱策男,博士,教授,博士生导师。主要研究方向:视频编码与通信、视频分析和处理;李帅男,博士,副研究员。主要研究方向:视频编码、计算机视觉;王永华男,硕士研究生。主要研究方向:视频编码。
基金资助:
国家自然科学基金（61571102，41761079）；四川省科学技术厅重点项目（2018JY0035）；云南省地方本科高校基础研究联合专项资金（2018FH001-056）

Manhattan distance based inter-frame weighted prediction algorithm

GUO Hongwei^1,2, ZHU Ce², LI Shuai², WANG Yonghua²

1. School of Engineering, Honghe University, Mengzi 661100, China;
2. School of Information and Communication Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China

Received:2019-07-09 Online:2019-12-20 Published:2019-12-31
Supported by:
National Natural Science Foundation of China (61571102,41761079); Key Project of Sichuan Provincial Department of Science and Technology (2018JY0035); Yunnan Local Colleges Applied Basic Research Project (2018FH001-056)

摘要/Abstract

摘要： 合并模式通过共享邻域块的运动矢量（MV）来节省编码运动信息比特数，有效提升了编码器率失真性能。然而，当前合并模式中的运动补偿预测（MCP）不够准确。为此，分析了合并模式中的预测残差分布特点，并提出了一种基于曼哈顿距离的加权预测算法作为合并模式的附加候选项。首先，采用邻域合并候选项的运动矢量进行运动补偿预测得到多个预测块；然后，根据候选块位置与像素点的曼哈顿距离对获得的多个预测块进行加权平均得到附加候选项；最后，通过率失真优化（RDO）从附加候选项和原有候选项中选择出最佳的合并模式。实验结果显示：在联合探索测试模型JEM 7.0平台上，所提算法在不同的编码器配置下均获得了率失真性能的提升，其中低延迟P帧下达到了平均1.34%的比特率节省。

关键词: 视频编码, 率失真优化(RDO), 合并模式, 运动补偿, 加权预测

Abstract: Merge mode saves the number of bits required to encode motion information by sharing the motion vector (MV) in neighboring blocks, which improves the rate-distortion performance of encoders effectively. However, motion compensation prediction (MCP) is not accurate enough in the merge mode currently. Therefore, this paper analyses the characteristics of residual distribution after MCP in the merge mode, and presents a Manhattan distance based weighted prediction method as an additional candidate for the merge mode. First, several predicted blocks are obtained by MCP with motion vectors in neighboring candidates. Second, the additional candidate is obtained by a weighted average method according to Manhattan distances from the neighboring candidate to the pixel points in the predicted blocks obtained. Finally, the best merge mode is selected by rate distortion optimization (RDO) among the additional candidate and the original candidates. The experimental results show that, on the joint exploration test model 7.0 (JEM 7.0), the proposed method achieves rate distortion performance improvement under the different configurations of encoder, where a bitrate saving of 1.34% on average is obtained under the configuration of low delay P frame.

Key words: video coding, rate distortion optimization (RDO), merge mode, motion compensation, weighted prediction

中图分类号:

TN919.8

郭红伟, 朱策, 李帅, 王永华. 一种基于曼哈顿距离的帧间加权预测算法[J]. 北京航空航天大学学报, 2019, 45(12): 2415-2422.

GUO Hongwei, ZHU Ce, LI Shuai, WANG Yonghua. Manhattan distance based inter-frame weighted prediction algorithm[J]. JOURNAL OF BEIJING UNIVERSITY OF AERONAUTICS AND A, 2019, 45(12): 2415-2422.

参考文献

[1] 马思伟.AVS视频编码标准技术回顾及最新进展[J].计算机研究与发展,2015,52(1):27-37.MA S W.History and recent developments of AVS video coding standards[J].Journal of Computer Research and Development,2015,52(1):27-37(in Chinese).
[2] SULLIVAN G J,OHM J R,HAN W J,et al.Overview of the high efficiency video coding(HEVC) standard[J].IEEE Transactions on Circuits and Systems for Video Technology,2012,22(12):1649-1668.
[3] GAO Y,ZHU C,LI S,et al.Temporal dependent rate-distortion optimization for low-delay hierarchical video coding[J].IEEE Transactions on Image Processing,2017,26(9):4457-4470.
[4] LI S,ZHU C,GAO Y B,et al.Lagrangian multiplier adaptation for rate-distortion optimization with inter-frame dependency[J].IEEE Transactions on Circuits and Systems for Video Technology,2016,26(1):117-129.
[5] LI S,ZHU C,GAO Y,et al.Inter-frame dependent rate-distortion optimization using Lagrangian multiplier adaption[C]//Proceedings of IEEE International Conference on Multimedia and Expo(ICME).Piscataway,NJ:IEEE Press,2015:1-6.
[6] HELLE P,OUDIN S,BROSS B,et al.Block merging for quadtree-based partitioning in HEVC[J].IEEE Transactions on Circuits and Systems for Video Technology,2012,22(12):1720-1731.
[7] PAN Z Q,KWONG S,SUN M T,et al.Early merge mode decision based on motion estimation and hierarchical depth correlation for HEVC[J].IEEE Transactions on Broadcasting,2014,60(2):405-412.
[8] TARIQ J,KWONG S,YUAN H.Spatial/temporal motion consistency based merge mode early decision for HEVC[J].Journal of Visual Communication and Image Representation,2017,44:198-213.
[9] 蒋洁,叶德周,潘勉.一种基于自适应阈值的Merge模式快速选择方法[J].光电子·激光,2016,27(9):980-986.JIANG J,YE D Z,PAN M.A fast candidate selection method for Merge mode based on adaptive threshold[J].Journal of Optoelectronics·Laser,2016,27(9):980-986(in Chinese).
[10] KIM T S,RHEE C E,LEE H J.Merge mode estimation for a hardware-based HEVC encoder[J].IEEE Transactions on Circuits and Systems for Video Technology,2016,26(1):195-209.
[11] SONG Y X,JIA K B.Early merge mode decision for texture coding in 3D-HEVC[J].Journal of Visual Communication and Image Representation,2015,33:60-68.
[12] HEO Y S,BANG G,PARK G H.Adaptive merge list construction for 3D-HEVC fast encoder[J].Electronics Letters,2016,52(8):604-690.
[13] 宋雨新,贾克斌,吴强.3D-HEVC合并模式快速判决方法研究[J].信号处理,2016,32(1):46-55.SONG Y X,JIA K B,WU Q.Research on fast merge mode decision method for 3D-HEVC[J].Journal of Signal Processing,2016,32(1):46-55(in Chinese).
[14] WU J F,GUO B L,HOU J,et al.Fast CU encoding schemes based on merge mode and motion estimation for HEVC inter prediction[J].KSII Transactions on Internet and Information Systems,2016,10(3):1195-1211.
[15] CHENG Z X,SUN H M,ZHOU D J,et al.Accelerating HEVC inter prediction with improved merge mode handling[J].IEICE Transactions on Fundamentals of Electronics Communications and Computer Sciences,2017,100(2):546-554.
[16] VANNE J,VIITANEN M,HAMALAINEN T D.Efficient mode decision schemes for HEVC inter prediction[J].IEEE Transactions on Circuits and Systems for Video Technology,2014,24(9):1579-1593.
[17] ZHANG N,FAN X P,ZHAO D B,et al.Merge mode for deformable block motion information derivation[J].IEEE Transactions on Circuits and Systems for Video Technology,2017,27(11):2437-2449.
[18] CHEN J,ALSHINA E,SULLIVAN G J,et al.Algorithm description of joint exploration test model 7(JEM 7)[C]//Joint Video Exploration Team(JVET) of ITU-T SG16WP3 and ISO/IEC JTC 1/SC 29/WG 117th Meeting,2017:10-15.
[19] SUEHRING K,LI X.JVET common test conditions and software reference configurations[C]//Joint Video Exploration Team (JVET) of ITU-T SG16WP3 and ISO/IEC JTC 1/SC 29/WG112nd Meeting,2016:1-4.

一种基于曼哈顿距离的帧间加权预测算法

Manhattan distance based inter-frame weighted prediction algorithm

PDF (PC)

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 11

编辑推荐

Metrics

本文评价

[1]	冯立新, 陶品, 温江涛, 杨士强. 基于模板匹配整帧屏幕视频帧内无损编码方法[J]. 北京航空航天大学学报, 2015, 41(7): 1353-1358.
[2]	姜宏旭, 李辉勇, 刘亭杉, 段洣毅, 张萍. 基于FPGA的高效机载视频采集及预处理方法[J]. 北京航空航天大学学报, 2015, 41(1): 14-22.
[3]	艾明晶, 赵丽丽, 赵沁平. 基于偏振约束的立体视频快速运动估计算法[J]. 北京航空航天大学学报, 2010, 36(3): 363-367.
[4]	王瑞, 姜宏旭, 李波. 基于FPGA的可变尺寸块运动估计高效结构[J]. 北京航空航天大学学报, 2009, 35(11): 1339-1343.
[5]	王瑞, 姜宏旭, 李波. 基于FPGA的可变尺寸块运动估计高效结构[J]. 北京航空航天大学学报, 2009, 35(11): 1339-1343.
[6]	朱笛, 申功勋. 一种面向矢量视频处理器的并行存储结构[J]. 北京航空航天大学学报, 2008, 34(10): 1177-1181.
[7]	贾英宏, 徐世杰. 地球静止轨道卫星扫描镜运动补偿[J]. 北京航空航天大学学报, 2007, 33(08): 873-877.
[8]	白霞, 孙进平, 高飞. 0.1m分辨率机载SAR孔径依赖性运动补偿方法[J]. 北京航空航天大学学报, 2007, 33(08): 898-901.
[9]	姚春莲, 李炜, 孟庆磊. 场信号预处理的扩展视频编码器设计[J]. 北京航空航天大学学报, 2006, 32(09): 1046-1050.
[10]	叶少华, 周荫清. 用真实IMU/GPS数据进行机载SAR运动补偿处理[J]. 北京航空航天大学学报, 2005, 31(10): 1063-1065.
[11]	李立伟, 贾洪江, Asif Raza, 毛士艺. chirp-scaling算法中运动补偿问题研究[J]. 北京航空航天大学学报, 1999, 25(4): 398-401.