Volume 47 Issue 3
Mar.  2021
Turn off MathJax
Article Contents
LI Hao, WANG Shan, GENG Yujie, et al. Wiring diagram detection and check based on deep learning and graph matching[J]. Journal of Beijing University of Aeronautics and Astronautics, 2021, 47(3): 539-548. doi: 10.13700/j.bh.1001-5965.2020.0478(in Chinese)
Citation: LI Hao, WANG Shan, GENG Yujie, et al. Wiring diagram detection and check based on deep learning and graph matching[J]. Journal of Beijing University of Aeronautics and Astronautics, 2021, 47(3): 539-548. doi: 10.13700/j.bh.1001-5965.2020.0478(in Chinese)

Wiring diagram detection and check based on deep learning and graph matching

doi: 10.13700/j.bh.1001-5965.2020.0478
Funds:

Science and Technology Project of State Grid Shandong Electric Power Company 5206021900TW

More Information
  • Corresponding author: LI Hao, E-mail: lihao-0717@163.com
  • Received Date: 31 Aug 2020
  • Accepted Date: 11 Sep 2020
  • Publish Date: 20 Mar 2021
  • The drawing and management of the traditional primary wiring diagram of plant and station mainly depend on the operators of power grid, which wastes time and labor and lacks scientific and verifiable reference standards. Towards this problem, based on the deep neural networks and digital image processing, we propose an algorithm for automatic detection, recognition and verification. Specifically, Faster R-CNN is first adopted to detect the electrical components of wiring diagram with 92% detection accuracy. In the meantime, an end-to-end text detection and recognition model is used to recognize the text with 94.2% detection accuracy and 92% character recognition accuracy. Then we take advantage of digital image processing technique to identify the connection of wiring diagram and topological relation. Finally, improved graph matching algorithm VF2 is used to check the difference between the electronic and manually maintained diagrams. The topological data is abstracted into an undirected graph, and the relative position information of components is obtained through the outline number. Based on the improved VF2 algorithm, we can compute the matching rate of two graphs to help the verification. Compared with the matching method of node traversal, the verification accuracy can be improved by 37.5%. Based on the first wiring diagram of some substations provided by a power supply company, this paper marks the electrical components of wiring diagram and contributes a small wiring diagram dataset.

     

  • loading
  • [1]
    刘建, 吴媛, 刘巩权. 配电馈线地理图到电气接线图的转换[J]. 电力系统自动化, 2005, 29(14): 73-77. https://www.cnki.com.cn/Article/CJFDTOTAL-DLXT200514016.htm

    LIU J, WU Y, LIU G Q. Conversion form GIS based feeder maps to electric diagrams[J]. Automation of Electrical Power Systems, 2005, 29(14): 73-77(in Chinese). https://www.cnki.com.cn/Article/CJFDTOTAL-DLXT200514016.htm
    [2]
    沙树名, 林峰. 一种基于CIM的厂站接线图自动生成技术[J]. 电力系统自动化, 2008, 32(21): 68-71. doi: 10.3321/j.issn:1000-1026.2008.21.015

    SHA S M, LIN F. A technique of automatic generation of substation wiring diagram based on CIM[J]. Automation of Electric Power Systems, 2008, 32(21): 68-71(in Chinese). doi: 10.3321/j.issn:1000-1026.2008.21.015
    [3]
    苏运光, 罗俊, 熊浩, 等. 基于存量图形拓扑分析的厂站接线图自动生成[J]. 电力系统自动化, 2020, 44(3): 162-168. https://www.cnki.com.cn/Article/CJFDTOTAL-DLXT202003020.htm

    SU Y G, LUO J, XIONG H, et al. Automatic generation of plant and station wiring diagram based on stock graphic topology analysis[J]. Automation of Electric Power Systems, 2020, 44(3): 162-168(in Chinese). https://www.cnki.com.cn/Article/CJFDTOTAL-DLXT202003020.htm
    [4]
    KLUMP R, SCHOOLEY D, OVERBYE T. Advanced visualization platform for real-time power system operations[C]//Proceedings of the 14th Computation, 2002: 1-8.
    [5]
    朱永利, 栗然, 刘艳. 电力系统厂站主接线图的自动生成[J]. 中国电力, 1999, 32(11): 56-58. https://www.cnki.com.cn/Article/CJFDTOTAL-ZGDL199911015.htm

    ZHU Y L, LI R, LIU Y. Automatic generation of main wiring diagram of power system plant[J]. China Electric Power, 1999, 32(11): 56-58(in Chinese). https://www.cnki.com.cn/Article/CJFDTOTAL-ZGDL199911015.htm
    [6]
    黄若航. 深度学习在热力管道工程设计上的研究和应用[D]. 成都: 电子科技大学, 2019.

    HUANG R H. Research and application of deep learning in thermal pipeline engineering design[D]. Chengdu: University of Electronic Science and Technology, 2019(in Chinese).
    [7]
    尹思宇. 深度学习在变电站电力设备缺陷检测中的应用研究[D]. 成都: 电子科技大学, 2020.

    YIN S Y. Research on application of deep learning in defect detection of power equipment in substation[D]. Chengdu: University of Electronic Science and Technology, 2020(in Chinese).
    [8]
    REDMON J, FARHADI A. YOLOv3: An incremental improvement[EB/OL]. (2018-04-08)[2020-08-01]. https://arxiv.org/abs/1804.02767.
    [9]
    REDMON J, FARHADI A. YOLO9000: Better, faster, stronger[C]//IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Piscataway: IEEE Press, 2017: 17355115.
    [10]
    REN S, HE K, GIRSHICK R, et al. Faster R-CNN: Towards real-time object detection with region proposal networks[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017, 39(6): 1137-1149. doi: 10.1109/TPAMI.2016.2577031
    [11]
    ZHOU X, YAO C, WEN H, et al. EAST: An efficient and accurate scene text detector[C]//IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Piscataway: IEEE Press, 2017: 17355294.
    [12]
    SMITH R. An overview of the Tesseract OCR engine[C]//Ninth International Conference on Document Analysis and Recognition. Piscataway: IEEE Press, 2007: 9870037.
    [13]
    SIMONYAN K, ZISSERMAN A. Very deep convolutional networks for large-scale image recognition[EB/OL]. (2014-09-04)[2020-08-01]. https://arxiv.org/abs/1409.1556.
    [14]
    RONNEBERGER O, FISCHER P, BROX T. U-Net: Convolutional networks for biomedical image segmentation[EB/OL]. (2015-05-18)[2020-08-01]. https://arxiv.org/abs/1505.04597.
    [15]
    WOINA Z, GORBAN A N, LEE D S, et al. Attention-based extraction of structured information from street view imagery[C]//2017 14th IAPR International Conference on Document Analysis and Recognition (ICDAR). Piscataway: IEEE Press, 2017, 1: 844-850.
    [16]
    CAI Z, VASCONCELOS N. Cascade R-CNN: Delving into high quality object detection[EB/OL]. (2017-12-03)[2020-08-01]. https://arxiv.org/abs/1712.00726.
    [17]
    XU K, BA J, KIROS R, et al. Show, attend and tell: Neural image caption generation with visual attention[C]//Proceedings of the 32nd International Conference on Machine Learning, 2015, 37: 2048-2057.
    [18]
    SUZUKI S, BE K. Topological structural analysis of digitized binaryimages by border following[J]. Computer Vision Graphics and Image Processing, 1985, 30(1): 32-46. doi: 10.1016/0734-189X(85)90016-7
    [19]
    CORDELLA L P, FOGGIA P, SANSONE C, et al. A (sub) graph is-omorphism algorithm for matching large graphs[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2004, 26(10): 1367-1372. doi: 10.1109/TPAMI.2004.75
    [20]
    FOGGIA P, SANSONE C, VENTO M. A database of graphs for isomor-phism and sub-graph isomorphism benchmarking[C]//Proceedings of the 3rd IAPR-TC-15 International Workshop on Graph-based Representations, 2001: 176-188.
    [21]
    李欣, 宋婷婷, 何险峰. 基于VF2算法的分子二维子结构检索[J]. 计算机与应用化学, 2007, 24(11): 1551-1554. doi: 10.3969/j.issn.1001-4160.2007.11.026

    LI X, SONG T T, HE X F. Molecular two-dimensional substructure retrieval based on VF2 algorithm[J]. Computer and Applied Chemistry, 2007, 24(11): 1551-1554(in Chinese). doi: 10.3969/j.issn.1001-4160.2007.11.026
    [22]
    楼昀恺, 王朝坤. 使用社区结构信息的子图匹配算法优化方法[J]. 计算机科学与探索, 2019, 13(1): 1-22. https://www.cnki.com.cn/Article/CJFDTOTAL-KXTS201901001.htm

    LOU Y K, WANG C K. Optimization method of subgraph matching algorithm using community structure information[J]. Computer Science and Exploration, 2019, 13(1): 1-22(in Chinese). https://www.cnki.com.cn/Article/CJFDTOTAL-KXTS201901001.htm
    [23]
    SHI B, YAO C, LIAO M, et al. ICDAR2017 competition on reading Chinese text in the wild (RCTW-17)[C]//2017 14th IAPR International Conference on Document Analysis and Recognition (ICDAR). Piscataway: IEEE Press, 2017, 1: 1429-1434.
    [24]
    CHRISTIAN S, SERHEY I, VINCENT V, et al. Inception-v4, inception-resnet and the impact of residual connections on learning[C]//Thirty-First AAAI Conference on Artifificial Intelligence, 2017: 1-12.
  • 加载中

Catalog

    通讯作者: 陈斌, bchen63@163.com
    • 1. 

      沈阳化工大学材料科学与工程学院 沈阳 110142

    1. 本站搜索
    2. 百度学术搜索
    3. 万方数据库搜索
    4. CNKI搜索

    Figures(8)  / Tables(4)

    Article Metrics

    Article views(674) PDF downloads(153) Cited by()
    Proportional views
    Related

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return