| Citation: | WU Zhishan, ZHANG Shuai, NIU Yuzhenet al. Retargeted image quality assessment based on multi-scale distortion-aware feature[J]. Journal of Beijing University of Aeronautics and Astronautics, 2019, 45(12): 2487-2494. doi: 10.13700/j.bh.1001-5965.2019.0368(in Chinese)
|
The subjective visual experience of viewing images using a variety of display devices is usually affected by image retargeting operation. To improve the consistency between subjective perception and objective assessment for the retargeted images, we present an objective retargeted image quality assessment (RIQA) method based on multi-scale distortion-aware (MSDA) features. Because semantic distortion and detail distortion appear on different scales of the image, we propose to extract distortion-aware features from multiple scales of the image. Specifically, we present an accurate measurement for the aspect ratio similarity (ARS) between the original and retargeted images. Furthermore, we use a fused visual attention map to simulate the subjective attention of the human visual system to the image. The experimental results on the two benchmark databases show that the Kendall rank correlation coefficient (KRCC), Pearson linear correlation coefficient (PLCC), and Spearman rank-order correlation coefficient (SRCC) indicators of the proposed MSDA method are 4.1%, 1.8%, and 4.5% higher than the optimal method in the comparative methods, respectively.
| [1] |
RUBINSTEIN M, SHAMIR A, AVIDAN S.Multi-operator media retargeting[J].ACM Transactions on Graphics, 2009, 28(3):23. http://d.old.wanfangdata.com.cn/NSTLQK/NSTL_QKJJ0211571020/
|
| [2] |
AVIDAN S, SHAMIR A.Seam carving for content-aware image resizing[J].ACM Transactions on Graphics, 2007, 26(3):10. doi: 10.1145/1276377.1276390
|
| [3] |
PRITCH Y, KAV-VENAKI E, PELEG S.Shift-map image editing[C]//IEEE 12th International Conference on Computer Vision.Piscataway, NJ: IEEE Press, 2009: 151-158.
|
| [4] |
WANG Y S, TAI C L, SORKINE O, et al.Optimized scale-and-stretch for image resizing[J].ACM Transactions on Graphics, 2008, 27(5):118. http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=1b3e06a85d52e7da49bb9107984b1852
|
| [5] |
KRÄHENBVHL P, LANG M, HORNUNG A, et al.A system for retargeting of streaming video[J].ACM Transactions on Graphics, 2008, 28(5):126. doi: 10.1038-clpt.2011.14/
|
| [6] |
WOLF L, GUTTMANN M, COHEN-OR D.Non-homogeneous content-driven video-retargeting[C]//IEEE 11th International Conference on Computer Vision.Piscataway, NJ: IEEE Press, 2007: 1-6.
|
| [7] |
RUBINSTEIN M, GUTIERREZ D, SORKINE O, et al.A comparative study of image retargeting[J].ACM Transactions on Graphics, 2010, 29(6):160. http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=c023cf2f49e97770db9b400f90de92bc
|
| [8] |
MA L, LIN W, DENG C, et al.Image retargeting quality assessment:A study of subjective scores and objective metrics[J].IEEE Journal of Selected Topics in Signal Processing, 2012, 6(6):626-639. doi: 10.1109/JSTSP.2012.2211996
|
| [9] |
SIMAKOV D, CASPI Y, SHECHTMAN E, et al.Summarizing visual data using bidirectional similarity[C]//IEEE Conference on Computer Vision and Pattern Recognition.Piscataway, NJ: IEEE Press, 2008: 1-8.
|
| [10] |
LIU Y J, LUO X, XUAN Y M, et al.Image retargeting quality assessment[J].Computer Graphics Forum, 2011, 30(2):583-592. doi: 10.1111/j.1467-8659.2011.01881.x
|
| [11] |
ZHANG Y, FANG Y, LIN W, et al.Backward registration based aspect ratio similarity for image retargeting quality assessment[J].IEEE Transactions on Image Processing, 2016, 25(9):4286-4297. doi: 10.1109/TIP.2016.2585884
|
| [12] |
ZHANG Y, LIN W, LI Q, et al.Multiple-level feature-based measure for retargeted image quality[J].IEEE Transactions on Image Processing, 2018, 27(1):451-463. http://cn.bing.com/academic/profile?id=5f76e0c196e9e0ce92cefe712625c044&encoded=0&v=paper_preview&mkt=zh-cn
|
| [13] |
ZHANG S, NIU Y Z, LIN J W, et al.Visual attention fusion framework for image retargeting quality assessment[J].IOP Conference Series:Earth and Environmental Science, 2019, 234(1):12-64. http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=IOP_9490483
|
| [14] |
CHEN Z, LIN J, LIAO N, et al.Full reference quality assessment for image retargeting based on natural scene statistics modeling and bi-directional saliency similarity[J].IEEE Transactions on Image Processing, 2017, 26(11):5138-5148. doi: 10.1109/TIP.2017.2736422
|
| [15] |
FANG Y, CHEN Z, LIN W, et al.Saliency detection in the compressed domain for adaptive image retargeting[J].IEEE Transactions on Image Processing, 2012, 21(9):3888-3901. doi: 10.1109/TIP.2012.2199126
|
| [16] |
QIN Y, LU H, XU Y, et al.Saliency detection via cellular automata[C]//IEEE Conference on Computer Vision and Pattern Recognition.Piscataway, NJ: IEEE Press, 2015: 110-119.
|
| [17] |
JOACHIMS T.Training linear SVMs in linear time[C]//ACM SIGKDD International Conference on Knowledge Discovery & Data Mining.New York: ACM, 2006: 217-226.
|
| [18] |
LIU C, YUEN J, TORRALBA A.SIFT flow:Dense correspondence across scenes and its applications[J].IEEE Transactions on Pattern Analysis & Machine Intelligence, 2010, 33(5):978-994. http://d.old.wanfangdata.com.cn/NSTLQK/NSTL_QKJJ0224487781/
|
| [19] |
PELE O, WERMAN M.Fast and robust earth mover's distances[C]//IEEE 12th International Conference on Computer Vision.Piscataway, NJ: IEEE Press, 2009: 460-467.
|
| [20] |
HSU C C, LIN C W, FANG Y, et al.Objective quality assessment for image retargeting based on perceptual geometric distortion and information loss[J].IEEE Journal of Selected Topics in Signal Processing, 2014, 8(3):377-389. doi: 10.1109/JSTSP.2014.2311884
|
| [21] |
KENDALL M G.A new measure of rank correlation[J].Biometrika, 1938, 30(1):81-93. http://d.old.wanfangdata.com.cn/OAPaper/oai_arXiv.org_1305.2038
|
| [22] |
DONG W, ZHOU N, PAUL J C, et al.Optimized image resizing using seam carving and scaling[J].ACM Transactions on Graphics, 2009, 28(5):125. http://d.old.wanfangdata.com.cn/NSTLQK/NSTL_QKJJ0216027791/
|
| [23] |
KARNI Z, FREEDMAN D, GOTSMAN C.Energy-based image deformation[J].Computer Graphics Forum, 2009, 28(5):1257-1268. doi: 10.1111/j.1467-8659.2009.01503.x
|
| [24] |
WANG Z, LU L, BOVIK A C.Video quality assessment based on structural distortion measurement[J].Signal Processing:Image Communication, 2004, 19(2):121-132. doi: 10.1016/S0923-5965(03)00076-6
|
| [25] |
SHEIKH H R, SABIR M F, BOVIK A C.A statistical evaluation of recent full reference image quality assessment algorithms[J].IEEE Transactions on Image Processing, 2006, 15(11):3440-3451. doi: 10.1109/TIP.2006.881959
|
| [26] |
WU Z, SU L, HUANG Q M.Cascaded partial decoder for fast and accurate salient object detection[EB/OL].(2018-04-18)[2019-07-09].https://arxiv.org/abs/1904.08739?context=cs.CV.
|
Figures(6) / Tables(8)
Copyright © Journal of Beijing University of Aeronautics and Astronautics
Address: Editorial Department of Journal of Beijing University of Aeronautics and Astronautics, 37 Xueyuan Road, Haidian District, Beijing Post Code: 100191 Email: jbuaa@buaa.edu.cn
Supported by:
Beijing Renhe Information Technology Co., Ltd.
DownLoad:
