留言板

尊敬的读者、作者、审稿人, 关于本刊的投稿、审稿、编辑和出版的任何问题, 您可以本页添加留言。我们将尽快给您答复。谢谢您的支持!

姓名
邮箱
手机号码
标题
留言内容
验证码

基于深度学习的图像拼接篡改检测

边亮 罗霄阳 李硕

边亮, 罗霄阳, 李硕等 . 基于深度学习的图像拼接篡改检测[J]. 北京航空航天大学学报, 2020, 46(5): 1039-1044. doi: 10.13700/j.bh.1001-5965.2019.0583
引用本文: 边亮, 罗霄阳, 李硕等 . 基于深度学习的图像拼接篡改检测[J]. 北京航空航天大学学报, 2020, 46(5): 1039-1044. doi: 10.13700/j.bh.1001-5965.2019.0583
BIAN Liang, LUO Xiaoyang, LI Shuoet al. Image mosaic tampering detection based on deep learning[J]. Journal of Beijing University of Aeronautics and Astronautics, 2020, 46(5): 1039-1044. doi: 10.13700/j.bh.1001-5965.2019.0583(in Chinese)
Citation: BIAN Liang, LUO Xiaoyang, LI Shuoet al. Image mosaic tampering detection based on deep learning[J]. Journal of Beijing University of Aeronautics and Astronautics, 2020, 46(5): 1039-1044. doi: 10.13700/j.bh.1001-5965.2019.0583(in Chinese)

基于深度学习的图像拼接篡改检测

doi: 10.13700/j.bh.1001-5965.2019.0583
详细信息
    作者简介:

    边亮  男, 硕士研究生。主要研究方向:图像信息融合与处理

    罗霄阳  男, 硕士研究生。主要研究方向:机器学习、图像取证

    李硕  男, 硕士研究生。主要研究方向:视频图像侦查

    通讯作者:

    边亮, E-mail:askquestionbl@163.com

  • 中图分类号: TP751;TP183

Image mosaic tampering detection based on deep learning

More Information
  • 摘要:

    传统图像拼接检测算法通过研究人员手动构造拼接特征,随着科技的进步以及图像处理技术的不断发展,手动构造特征的局限性逐渐体现出来,鲁棒性较弱,位置不易确定等。为了解决这些问题,构建了一种卷积神经网络(CNN),将卷积核前置并固定,自主学习相关特征从而检测拼接篡改的图像区域。经过一系列研究,发现拼接篡改图像的拼接篡改区域特征可以被CNN模型学习。在CNN模型之前,卷积核使用高通滤波器,激活函数采用指数线性单元(ELU),使得CNN模型具有识别拼接篡改图像边缘痕迹等特征的能力。检测结果表明:在IEEE IFS-TC图像拼接取证竞赛训练集上对拼接篡改图像拼接篡改区域定位的准确率为84.3%,对拼接篡改区域判定的真负类率为96.18%。

     

  • 图 1  传统检测模型与CNN拼接检测模型框架示意图

    Figure 1.  Framework sketch map of traditional detection model and CNN mosaic detection model

    图 2  最大池化示意图

    Figure 2.  Sketch map of maximum pooling

    图 3  CNN结构示意图

    Figure 3.  Structure map of CNN

    图 4  拼接篡改图像检测流程图

    Figure 4.  Flowchart of mosaic tampering image detection

    图 5  神经网络训练过程验证集上的准确率和损失函数下降的过程示意图

    Figure 5.  Process diagram of accuracy rate and loss function decline on verification set of neural network training process

    图 6  不同特征在IEEE IFS-TC训练集上的ROC曲线

    Figure 6.  ROC curves of different characteristics on IEEE IFS-TC training set

    图 7  实验结果

    Figure 7.  Experimental results

    表  1  不同分类器在测试集上的实验结果

    Table  1.   Experimental results of different classifiers on test sets %

    分类器 准确率 召回率 真负类率
    B_CNN 82.9 70.32 95.54
    R_CNN 82.1 69.82 95.15
    G_CNN 81.9 69.85 93.95
    RGB_CNN集成分类器 84.3 73.84 96.18
    下载: 导出CSV
  • [1] HAGHIGHI B B, TAHERINIA A H, MOHAJERZADEH A H.TRLG:Fragile blind quad watermarking for image tamper detection and recovery by providing compact digests with optimized quality using LWT and GA[J].Information Sciences, 2019, 486:204-230. doi: 10.1016/j.ins.2019.02.055
    [2] 李燕, 钟磊, 李健.基于LBP和共生矩阵的图像拼接篡改检测[J].武汉大学学报(理学版), 2015, 61(6):517-524. http://d.old.wanfangdata.com.cn/Periodical/whdxxb-zr201506003

    LI Y, ZHONG L, LI J.Detection of image splicing forgery based on LBP and co-occurrence matrix[J].Journal of Wuhan University(Natural Science Edition), 2015, 61(6):517-524(in Chinese). http://d.old.wanfangdata.com.cn/Periodical/whdxxb-zr201506003
    [3] LUO W, QU Z, HUANG J, et al.A novel method for detecting cropped and recompressed image block[C]//IEEE International Conference on Acoustics, Speech and Signal Processing.Piscataway, NJ: IEEE Press, 2007: 217-220.
    [4] SWAMINATHAN A, WU M, LIU K J R.Component forensics of digital cameras: A non-intrusive approach[C]//2006 40th Annual Conference on Information Sciences and Systems.Piscataway, NJ: IEEE Press, 2007: 1194-1199.
    [5] ZHANG Q, LU W, WANG R, et al.Digital image splicing detection based on Markov features in block DWT domain[J].Multimedia Tools and Applications, 2018, 77(23):31239-31260. doi: 10.1007/s11042-018-6230-z
    [6] KANG X, LI Y, QU Z, et al.Enhancing source camera identification performance with a camera reference phase sensor pattern noise[J].IEEE Transactions on Information Forensics and Security, 2012, 7(2):393-402. doi: 10.1109/TIFS.2011.2168214
    [7] ZENG H, ZHAN Y, KANG X, et al.Image splicing localization using PCA-based noise level estimation[J].Multimedia Tools and Applications, 2017, 76(4):4783-4799. doi: 10.1007/s11042-016-3712-8
    [8] YAO H, WANG S, ZHANG X, et al.Detecting image splicing based on noise level inconsistency[J].Multimedia Tools and Applications, 2017, 76(10):12457-12479. doi: 10.1007/s11042-016-3660-3
    [9] HAN J G, PARK T H, MOON Y H, et al.Quantization-based Markov feature extraction method for image splicing detection[J].Machine Vision and Applications, 2018, 29(3):543-552. doi: 10.1007/s00138-018-0911-5
    [10] BELFERDI W, BEHLOUL A, NOUI L.A Bayer pattern-based fragile watermarking scheme for color image tamper detection and restoration[J].Multidimensional Systems and Signal Processing, 2019, 30(3):1093-1112. doi: 10.1007/s11045-018-0597-x
    [11] RAJPUT V, ANSARI I A.Image tamper detection and self-recovery using multiple median watermarking[J/OL].Multimedia Tools and Applications, 2019: 1-17[2019-03-01].https://doi.org/10.1007/s11042-019-07971-w.
    [12] SHIN H C, ORTON M R, COLLINS D J, et al.Stacked autoencoders for unsupervised feature learning and multiple organ detection in a pilot study using 4D patient data[J].IEEE Transactions on Pattern Analysis & Machine Intelligence, 2013, 35(8):1930-1943. http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=b739bde4251b7ad954d369b069d501bf
    [13] VINCENT P, LAROCHELLE H, LAJOIE I, et al.Stacked denoising autoencoders:Learning useful representations in a deep network with a local denoising criterion[J].Journal of Machine Learning Research, 2010, 11(12):3371-3408. http://cn.bing.com/academic/profile?id=1b5321cd3b5fdc0bc4d9b0d4fa8975ef&encoded=0&v=paper_preview&mkt=zh-cn
    [14] LUKAS J, FRIDRICH J, GOLJAN M.Digital camera identification from sensor pattern noise[J].IEEE Transactions on Information Forensics and Security, 2006, 1(2):205-214. doi: 10.1109/TIFS.2006.873602
    [15] LECUN Y, BOTTOU L, BENGIO Y, et al.Gradient-based learning applied to document recognition[J].Proceedings of the IEEE, 1998, 86(11):2278-2324. doi: 10.1109/5.726791
  • 加载中
图(7) / 表(1)
计量
  • 文章访问数:  1149
  • HTML全文浏览量:  91
  • PDF下载量:  526
  • 被引次数: 0
出版历程
  • 收稿日期:  2019-11-13
  • 录用日期:  2019-11-29
  • 网络出版日期:  2020-05-20

目录

    /

    返回文章
    返回
    常见问答