Volume 50 Issue 4
Apr.  2024
Turn off MathJax
Article Contents
ZHANG Y T,LI Q Y,LIU S K. Tabular subordination relation extraction based on graph convolutional networks[J]. Journal of Beijing University of Aeronautics and Astronautics,2024,50(4):1308-1315 (in Chinese) doi: 10.13700/j.bh.1001-5965.2022.0382
Citation: ZHANG Y T,LI Q Y,LIU S K. Tabular subordination relation extraction based on graph convolutional networks[J]. Journal of Beijing University of Aeronautics and Astronautics,2024,50(4):1308-1315 (in Chinese) doi: 10.13700/j.bh.1001-5965.2022.0382

Tabular subordination relation extraction based on graph convolutional networks

doi: 10.13700/j.bh.1001-5965.2022.0382
Funds:  Natural Science Foundation of Hubei Province (2018CFC800)
More Information
  • Corresponding author: E-mail:liusk@seu.edu.cn
  • Received Date: 18 May 2022
  • Accepted Date: 12 Aug 2022
  • Available Online: 16 Sep 2022
  • Publish Date: 14 Sep 2022
  • This study addresses the lack of research on extracting subordination relations between the cells in a table in the field of table recognition and analysis. It defines the table subordination relation extraction task. Based on the similarity between table and graph structures and the graph representation method for table cells, a subordination relation extraction model is proposed using graph convolutional networks(GCN). The proposed model predicts the subordination relation between cells by aggregating the features of table cells and their adjacent cells through the GCN, and then realizes relation extraction. To verify the effectiveness of the proposed model, two datasets, Chinese Rel-forms and English Rel-SciTSR, were annotated. The experiments achieve 98.61%, 96.55% and 97.05% F1 scores on the above two datasets and their joint datasets respectively, thus verifying the effectiveness of the proposed model. The effects of different factors such as text content, coordinate information, cell attributes and relative orientation between cells on the experimental results of subordination relation extraction are also analyzed.

     

  • loading
  • [1]
    WANG H Y, CHENG Y H, PHILTP CHEN C L , et al. Semisupervised classification of hyperspectral image based on graph convolutional broad network[J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2021, 14: 2995-3005. doi: 10.1109/JSTARS.2021.3062642
    [2]
    ZOU Y J, MA J W. A deep semantic segmentation model for image-based table structure recognition[C]//Proceeclings of the 2020 15th IEEE International Conference on Signal Processing. Piscataway: IEEE Press, 2020: 274-280.
    [3]
    SCHREIBER S, AGNE S, WOLF I, et al. DeepDeSRT: Deep learning for detection and structure recognition of tables in document images[C]//Proceeclings of the 2017 14th IAPR International Conference on Document Analysis and Recognition. Piscataway: IEEE Press, 2017: 1162-1167.
    [4]
    SIDDIQUI S A, KHAN P I, DENGEL A, et al. Rethinking semantic segmentation for table structure recognition in documents[C]//Proceeclings of the 2019 International Conference on Document Analysis and Recognition. Piscataway: IEEE Press, 2019: 1397-1402.
    [5]
    RAJA S, MONDAL A, JAWAHAR C V . Table structure recognition using top-down and bottom-up cues[C]//Proceeclings of the European Conference on Computer Vision.Berlin: Springer, 2020: 70-86.
    [6]
    LIN T Y, DOLLÁR P, GIRSHICK R, et al. Feature pyramid networks for object detection[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Piscataway: IEEE Press, 2017: 2117-2125.
    [7]
    GUO X L, ZHU S J, YANG Z W, et al. Consecutive missing data recovery method based on long-short term memory network[C]//Proceeclings of the 2021 3rd Asia Energy and Electrical Engineering Symposium. Piscataway: IEEE Press, 2021: 988-992.
    [8]
    KONG L J, BAO Y C, WANG Q W, et al. A gradient heatmap based table structure recognition[C]//Proceeclings of the 2021 13th International Conference on Machine Learning and Computing. New York: ACM, 2021: 456-463.
    [9]
    QIAO LS, LI ZS, CHENG Z, et al. LGPMA: Complicated table structure recognition with local and global pyramid mask alignment[C]//Proceeclings of the International Conference on Document Analysis and Recognition. Berlin: Springer, 2021: 99-114.
    [10]
    LONG R J, WANG W, XUE N, et al. Parsing table structures in the wild[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision. Piscataway: IEEE Press, 2021: 944-952.
    [11]
    ZHOU X Y, WANG D Q, KRHENBÜHL P. Objects as points[EB/OL]. (2019-04-25) [2022-03-24]. https://arxiv.org/abs/1904.07850.
    [12]
    CHI Z W, HUANG H Y, XU H D, et al. Complicated table structure recognition[EB/OL]. (2019-08-28)[2022-03-10]. https://arxiv.org/abs/1908.04729.
    [13]
    XUE W Y, YU B S, WANG W, et al. TGRNet: A table graph reconstruction network for table structure recognition[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision. Piscataway: IEEE Press, 2021: 1295-1304.
    [14]
    RIBA P, DUTTA A, GOLDMANN L, et al. Table detection in invoice documents by graph neural networks[C]//Proceeclings of the 2019 International Conference on Document Analysis and Recognition . Piscataway: IEEE Press, 2019: 122-127.
    [15]
    SCARSELLI F, GORI M, TSOI A C, et al. Computational capabilities of graph neural networks[J]. IEEE Transactions on Neural Networks, 2009, 20(1): 81-102. doi: 10.1109/TNN.2008.2005141
    [16]
    QASIM S R, MAHMOOD H, SHAFAIT F. Rethinking table recognition using graph neural networks[C]//Proceeclings of the 2019 International Conference on Document Analysis and Recognition. Piscataway: IEEE Press, 2019: 142-147.
    [17]
    LI Y R, HUANG Z, YAN J C, et al. GFTE: Graph-based financial table extraction[C]//Proceeclings of the International Conference on Pattern Recognition. Berlin: Springer, 2021: 644-658.
    [18]
    郑海潇, 文斌. 基于图卷积网络的比特币非法交易识别方法[J]. 信息网络安全, 2021, 21(9): 74-79. doi: 10.3969/j.issn.1671-1122.2021.09.011

    ZHENG H X, WEN B. Bitcoin illegal transaction identification method based on graph convolutional network[J]. Netinfo Security, 2021, 21(9): 74-79(in Chinese). doi: 10.3969/j.issn.1671-1122.2021.09.011
  • 加载中

Catalog

    通讯作者: 陈斌, bchen63@163.com
    • 1. 

      沈阳化工大学材料科学与工程学院 沈阳 110142

    1. 本站搜索
    2. 百度学术搜索
    3. 万方数据库搜索
    4. CNKI搜索

    Figures(8)  / Tables(2)

    Article Metrics

    Article views(200) PDF downloads(12) Cited by()
    Proportional views
    Related

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return