留言板

尊敬的读者、作者、审稿人, 关于本刊的投稿、审稿、编辑和出版的任何问题, 您可以本页添加留言。我们将尽快给您答复。谢谢您的支持!

姓名
邮箱
手机号码
标题
留言内容
验证码

应用于智能芯片的可视化反馈系统研究

李欣致 董胜波 崔向阳 刘志哲 郭广浩

李欣致, 董胜波, 崔向阳, 等 . 应用于智能芯片的可视化反馈系统研究[J]. 北京航空航天大学学报, 2020, 46(8): 1494-1502. doi: 10.13700/j.bh.1001-5965.2019.0518
引用本文: 李欣致, 董胜波, 崔向阳, 等 . 应用于智能芯片的可视化反馈系统研究[J]. 北京航空航天大学学报, 2020, 46(8): 1494-1502. doi: 10.13700/j.bh.1001-5965.2019.0518
LI Xinzhi, DONG Shengbo, CUI Xiangyang, et al. Visual feedback system applied to AI chips[J]. Journal of Beijing University of Aeronautics and Astronautics, 2020, 46(8): 1494-1502. doi: 10.13700/j.bh.1001-5965.2019.0518(in Chinese)
Citation: LI Xinzhi, DONG Shengbo, CUI Xiangyang, et al. Visual feedback system applied to AI chips[J]. Journal of Beijing University of Aeronautics and Astronautics, 2020, 46(8): 1494-1502. doi: 10.13700/j.bh.1001-5965.2019.0518(in Chinese)

应用于智能芯片的可视化反馈系统研究

doi: 10.13700/j.bh.1001-5965.2019.0518
详细信息
    作者简介:

    李欣致  女,博士研究生,工程师。主要研究方向:控制科学与工程

    董胜波  男,博士,研究员,博士生导师。主要研究方向:控制科学与工程

    崔向阳  男,硕士,工程师。主要研究方向:智能信息处理

    刘志哲  男,博士,研究员。主要研究方向:SoC芯片和智能处理器

    郭广浩  男,博士研究生,工程师。主要研究方向:智能芯片处理

    通讯作者:

    董胜波, E-mail:shbdong@aliyun.com

  • 中图分类号: TP183

Visual feedback system applied to AI chips

More Information
  • 摘要:

    当前,市场上普遍使用的负责推理的终端人工智能(AI)芯片使用训练好的参数对数据进行快速高效运算。但在通常训练过程中使用的数据集和真实数据的分布不一致,由此获得的参数会导致终端AI芯片识别准确度降低。为此,提出了一种基于终端AI芯片的可视化反馈系统架构方法。使用反卷积特征可视化方法,在具有高效计算性能的终端AI芯片上,对卷积核参数进行迭代优化,达到可识别该图像目的。相比于CPU/GPU和FPGA,所提架构在卷积神经网络模型里,更具有高效处理能力和灵活可塑性。实验表明,该研究有效提高了终端AI芯片的普适性、识别准确度和处理效率。

     

  • 图 1  反卷积可视化处理流程

    Figure 1.  Deconvolution visualization process flow

    图 2  卷积神经网络结构

    Figure 2.  Convolutional neural network structure

    图 3  AI芯片云端和终端区别

    Figure 3.  Difference between AI chip cloud and terminal

    图 4  算法实现流程图

    Figure 4.  Algorithm implementation flow chart

    图 5  对图像进行快速卷积、激活和池化处理

    Figure 5.  Fast convolution, activation and pooling process of image

    图 6  对图像进行反激活和反卷积处理

    Figure 6.  Deactivate and deconvolve process of image

    图 7  卷积核优化前后反卷积图像和识别结果

    Figure 7.  Deconvolution image and recognition results before and after convolution kernel optimization

    图 8  可视化反馈AI处理器

    Figure 8.  Visual feedback AI processor

    图 9  AI芯片反卷积可视化硬件处理流程

    Figure 9.  AI chip deconvolution visualization hardware processing flow

    图 10  验证平台流程

    Figure 10.  Verification platform process

    表  1  不同模型实验结果对比

    Table  1.   Comparison of experimental results among different models

    模型 优化前识别率/% 优化后识别率/% 平均处理时间/ms 平均优化参数时间/s
    CPU GPU FPGA 本文架构 CPU GPU FPGA 本文架构
    AlexNet 54.71 56.26 1 315.1 26.3 3.87 1.94 75 938.3 1 518.65 371.8 48.88
    ResNet18 65.39 67.12 5 720.2 161.8 12.84 5.26 188 326.9 22 003.5 725.3 122.29
    ResNet50 66.82 67.87 21 736.95 441.8 38.15 14.08 327 688.8 54 300.6 1 964.5 301.73
    ResNet101 67.63 68.03 39 126.51 994.1 67.03 25.6 701 909.4 101 542.1 4 553.7 638.59
    YOLO3 54.95 56.42 169 065.6 4 682.5 289.64 116.28 2 816 060.9 459 684.2 22 003.5 2 701.6
    下载: 导出CSV
  • [1] HINTON G E, SALAKHUTDINOV R.Reducing the dimensionality of data with neural networks[J].Science, 2006, 313(5786):504-507. doi: 10.1126/science.1127647
    [2] MIROWSKI P, LECUN Y, MADHAVAN D, et al.Comparing SVM and convolutional networks for epileptic seizure prediction from intracranial EEG[C]//Proceedings of IEEE International Workshop on Machine Learning for Signal Processing.Piscataway: IEEE Press, 2008: 244-249.
    [3] 杨喜权.数字逻辑电路[M].成都:电子科技大学出版社, 2004:150.

    YANG X Q.Digital logic circuit[M].Chengdu:University of Electronic Science and Technology Press, 2004:150(in Chinese)
    [4] 施羽暇.人工智能芯片技术研究[J].电信网技术, 2016(12):11-13. http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=dxwjs201612003

    SHI Y X.Research on artificial intelligence process chip technology[J].Telecommunications Network Technology, 2016(12):11-13(in Chinese). http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=dxwjs201612003
    [5] HECHT-NIELSEN R.Theory of the backpropagation neural network[J].Neural Networks, 1988, 1(S1):445-448. http://cn.bing.com/academic/profile?id=3d38f7b0ec99dd230a147079cb5d6bd0&encoded=0&v=paper_preview&mkt=zh-cn
    [6] 张美芳, 王羽, 郑碧琪, 等.人工智能在汽车自动驾驶中的应用[J].汽车工业研究, 2019(3):2-7. doi: 10.3969/j.issn.1009-847X.2019.03.001

    ZHANG M F, WANG Y, ZHENG B Q, et al.Application of artificial intelligence in autonomous driving[J].Automotive Industry Research, 2019(3):2-7(in Chinese). doi: 10.3969/j.issn.1009-847X.2019.03.001
    [7] 张顺, 龚怡宏, 王进军.深度卷积神经网络的发展及其在计算机视觉领域的应用[J].计算机学报, 2019, 42(3):453-482. http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=jsjxb201903001

    ZHANG S, GONG Y H, WANG J J.The development of deep convolutional neural network and its application in the field of computer vision[J].Chinese Journal of Computers, 2019, 42(3):453-482(in Chinese). http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=jsjxb201903001
    [8] BURDEA G C, COIFFET P.Virtual reality technology[M].New York:John Wiley & Sons, 2003:12-13.
    [9] KRIZHEVSKY A, SUTSKEVER I, HINTON G E, et al.ImageNet classification with deep convolutional neural networks[J].Neural Information Processing Systems, 2012, 141(5):1097-1105. http://cn.bing.com/academic/profile?id=1dc5d01904d2c274eaec2181a93aa339&encoded=0&v=paper_preview&mkt=zh-cn
    [10] KOTHARI S C, OH H.Neural networks for pattern recognition[J].Advances in Computers, 1993, 37:119-166. doi: 10.1016/S0065-2458(08)60404-0
    [11] KRIZHEVSKY A, ILYA S, HINTON G E.Imagenet classification with deep convolutional neural networks[C]//Proceedings of the 25th International Conference on Neural Information Processing Systems-Volume 1.Red Hook: Curran Associates Inc., 2012: 1097-1105.
    [12] SIMONYAN K, ZISSERMAN A.Very deep convolutional networks for large-scale image recognition[EB/OL].(2015-04-10)[2019-09-20].https://arxiv.org/abs/1409.1556.
    [13] SZEGEDY C, LIU W, JIA Y, et al.Going deeper with convolutions[C]//IEEE Conference on Computer Vision and Pattern Recognition.Piscataway: IEEE Press, 2015: 1-9.
    [14] HE K, ZHANG X, REN S, et al.Deep residual learning for image recognition[C]//IEEE Conference on Computer Vision and Pattern Recognition.Piscataway: IEEE Press, 2016: 770-778.
    [15] HU J, SHEN L, SUN G, et al.Squeeze-and-excitation networks[EB/OL].(2019-05-16)[2019-09-20].https://arxiv.org/abs/1709.01507.
    [16] REDMON J, FARHADI A.YOLOv3: An incremental improvement[EB/OL].(2018-04-08)[2019-09-20].https://arxiv.org/abs/1804.02767.
    [17] ZEILER M D, FERGUS R.Visualizing and understanding convolutional networks[C]//European Conference on Computer Vision.Berlin: Springer, 2014: 818-833.
    [18] ZEILER M D, TAYLOR G W, FERGUS R, et al.Adaptive deconvolutional networks for mid and high level feature learning[C]//International Conference on Computer Vision.Piscataway: IEEE Press, 2011: 2018-2025.
    [19] GOODFELLOW I, POUGET-ABADIE J, MIRZA M, et al.Generative adversarial nets[C]//Advances in Neural Information Processing Systems.Red Hook: Curran Associates Inc., 2014: 2672-2680.
  • 加载中
图(10) / 表(1)
计量
  • 文章访问数:  479
  • HTML全文浏览量:  26
  • PDF下载量:  65
  • 被引次数: 0
出版历程
  • 收稿日期:  2019-09-24
  • 录用日期:  2020-02-21
  • 网络出版日期:  2020-08-20

目录

    /

    返回文章
    返回
    常见问答