Learning based intelligent image retargeting technique
-
摘要: 为适应不同的显示分辨率,出现了各式各样的图像适配显示(IR)的方法.提出了基于图像列的一种快速适配显示方法.在处理过程中,首先,计算一个原始图像的重要性图;其次,根据图像每列的重要性程度为其分配一个比例因子,对不同图像而言,应对比例因子设置不同的上限才可以得到较好的结果;最后,提出通过机器学习方法计算出不同图像的上限,从而可以高效率地得到理想的结果.根据每一列的比例因子采用像素融合的方式处理图片得到目标分辨率.本方法是基于列实现的,其复杂度低、便于计算;设置每列系数的上限控制了图像重要部分的宽度,从而减少了不连贯,处理结果更为自然.Abstract: There has been a wide range of image retargeting (IR) approaches, in order to solve the problem of adapting images to different display resolutions. A fast image retargeting method was proposed, which was based on image columns. Firstly, the method would calculate a saliency map of the original image. Secondly, a group of scaling factors were generated for image pixel fusion, which was used to get the result image of the target image size. Each image column corresponded to its scaling factor. For different images, an adaptive upper bound was obtained by machine learning, for scaling factor assignment. This upper bound was set to limit the column width and can reduce image distortion. The experiment results prove that this adaptive upper bound results in a better performance. Moreover, this method has a low complexity, thus it calculates fast, as it is based on image columns instead of pixels.
-
Key words:
- image retargeting (IR) /
- image resizing /
- machine learning /
- seam carving /
- low complexity
-
[1] Harel J, Koch C, Perona P, et al.Graph-based visual saliency[C]//Proceedings of the Twentieth Annual Conference on Neural Information Processing Systems.Vancouver, B.C.:NIPS, 2006:545-552. [2] Shamir A, Sorkine O.Visual media retargeting[C]//ACM SIGGRAPH ASIA 2009 Courses.New York:ACM, 2009. [3] Avidan S, Shamir A.Seam carving for content-aware image resizing[J].ACM Transactions on Graphics, 2007, 26(3):10. [4] Wolf L, Guttmann M, Cohen-Or D.Nonhomogeneous content-driven video-retargeting[C]//IEEE 11th International Conference on Computer Vision, ICCV 2007.Piscataway, NJ:IEEE Press, 2007, 10:14-21. [5] Dong W, Zhou N, Paul J C, et al.Optimized image resizing using seam carving and scaling[J].ACM Transactions on Graphics(TOG), 2009, 28(5):1-10. [6] Hwang D S, Chien S Y.Content-aware image resizing using perceptual seam carving with human attention model[C]//IEEE International Conference on Multimedia and Expo.Piscataway, NJ:IEEE Press, 2008:1029-1032. [7] Conge D D, Kumar M, Miller R L, et al.Improved seam carving for image resizing[C]//Proceedings of 2010 IEEE Workshop on Signal Processing Systems(SIPS).Piscataway, NJ:IEEE Press, 2010:345-349. [8] Domingues D, Alahi A, Vandergheynst P.Stream carving:An adaptive seam carving algorithm[C]//Proceedings of 2010 IEEE 17th International Conference on Image Processing(ICIP'2010).Piscataway, NJ:IEEE Press, 2010:901-904. [9] Conger D D, Kumar M, Radha H.Generalized multiscale seam carving[C]//Proceedings of 2010 IEEE International Workshop on Multimedia Signal Processing(MMSP).Piscataway, NJ:IEEE Press, 2010:367-372. [10] Han J W, Choi K S, Wang T S, et al.Improved seam carving using a modified energy function based on wavelet decomposition[C]//Proceedings of 2009 IEEE 13th International Symposium on Consumer Electronics(ISCE'09).Piscataway, NJ:IEEE Press, 2009:38-41. [11] Rubinstein M, Shamir A, Avidan S.Improved seam carving for video retargeting[J].ACM Transactions on Graphics(TOG), 2008, 27(3):1-9. [12] Frankovich M, Wong A.Enhanced seam carving via integration of energy gradient functionals[J].IEEE Signal Processing Letters, 2011, 18(6):375-378. [13] Chang C H, Chuang Y Y.A line-structure-preserving approach to image resizing[C]//Computer Vision and Pattern Recognition(CVPR).Piscataway, NJ:IEEE Press, 2012:1075-1082. [14] 全红艳, 曹桂涛.数字图像处理原理与实现方法[M].北京:机械工业出版社, 2014:51-53. Quan, Cao G T.The principle and realization method of digital image processing[M].Beijing:Machinery Industry Press, 2014:51-53(in Chinese). [15] Wang Y S, Tai C L, Sorkine O, et al.Optimized scale-and-stretch for image resizing[J].ACM Transactions on Graphics(TOG), 2008, 27(5):118. [16] Hu W, Luo Z, Fan X.Image retargeting via adaptive scaling with geometry preservation[J].IEEE Journal on Emerging and Selected Topics in Circuits and Systems, 2014, 4(1):70-81. [17] Liang Y, Liu Y J, Luo X N, et al.Optimal-scaling-factor assignment for patch-wise image retargeting[J].IEEE Computer Graphics and Applications, 2013, 33(5):67-78. [18] Sun K, Yan B, Gao Y.Lowcomplexity content-aware image retargeting[C]//Image Processing(ICIP), 2012 19th IEEE International Conference on.Piscataway, NJ:IEEE Press, 2012:2105-2108. [19] Rubinstein M, Gutierrez D, Sorkine O, et al.A comparative study of image retargeting[C]//Proceedings of ACM SIGGRAPH Asia 2010, SIGGRAPH Asia 2010.New York:ACM, 2010, 29(6):160.
点击查看大图
计量
- 文章访问数: 993
- HTML全文浏览量: 181
- PDF下载量: 802
- 被引次数: 0