Citation: | ZHANG Y T,LI Q Y,LIU S K. Tabular subordination relation extraction based on graph convolutional networks[J]. Journal of Beijing University of Aeronautics and Astronautics,2024,50(4):1308-1315 (in Chinese) doi: 10.13700/j.bh.1001-5965.2022.0382 |
This study addresses the lack of research on extracting subordination relations between the cells in a table in the field of table recognition and analysis. It defines the table subordination relation extraction task. Based on the similarity between table and graph structures and the graph representation method for table cells, a subordination relation extraction model is proposed using graph convolutional networks(GCN). The proposed model predicts the subordination relation between cells by aggregating the features of table cells and their adjacent cells through the GCN, and then realizes relation extraction. To verify the effectiveness of the proposed model, two datasets, Chinese Rel-forms and English Rel-SciTSR, were annotated. The experiments achieve 98.61%, 96.55% and 97.05%
[1] |
WANG H Y, CHENG Y H, PHILTP CHEN C L , et al. Semisupervised classification of hyperspectral image based on graph convolutional broad network[J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2021, 14: 2995-3005. doi: 10.1109/JSTARS.2021.3062642
|
[2] |
ZOU Y J, MA J W. A deep semantic segmentation model for image-based table structure recognition[C]//Proceeclings of the 2020 15th IEEE International Conference on Signal Processing. Piscataway: IEEE Press, 2020: 274-280.
|
[3] |
SCHREIBER S, AGNE S, WOLF I, et al. DeepDeSRT: Deep learning for detection and structure recognition of tables in document images[C]//Proceeclings of the 2017 14th IAPR International Conference on Document Analysis and Recognition. Piscataway: IEEE Press, 2017: 1162-1167.
|
[4] |
SIDDIQUI S A, KHAN P I, DENGEL A, et al. Rethinking semantic segmentation for table structure recognition in documents[C]//Proceeclings of the 2019 International Conference on Document Analysis and Recognition. Piscataway: IEEE Press, 2019: 1397-1402.
|
[5] |
RAJA S, MONDAL A, JAWAHAR C V . Table structure recognition using top-down and bottom-up cues[C]//Proceeclings of the European Conference on Computer Vision.Berlin: Springer, 2020: 70-86.
|
[6] |
LIN T Y, DOLLÁR P, GIRSHICK R, et al. Feature pyramid networks for object detection[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Piscataway: IEEE Press, 2017: 2117-2125.
|
[7] |
GUO X L, ZHU S J, YANG Z W, et al. Consecutive missing data recovery method based on long-short term memory network[C]//Proceeclings of the 2021 3rd Asia Energy and Electrical Engineering Symposium. Piscataway: IEEE Press, 2021: 988-992.
|
[8] |
KONG L J, BAO Y C, WANG Q W, et al. A gradient heatmap based table structure recognition[C]//Proceeclings of the 2021 13th International Conference on Machine Learning and Computing. New York: ACM, 2021: 456-463.
|
[9] |
QIAO LS, LI ZS, CHENG Z, et al. LGPMA: Complicated table structure recognition with local and global pyramid mask alignment[C]//Proceeclings of the International Conference on Document Analysis and Recognition. Berlin: Springer, 2021: 99-114.
|
[10] |
LONG R J, WANG W, XUE N, et al. Parsing table structures in the wild[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision. Piscataway: IEEE Press, 2021: 944-952.
|
[11] |
ZHOU X Y, WANG D Q, KRHENBÜHL P. Objects as points[EB/OL]. (2019-04-25) [2022-03-24]. https://arxiv.org/abs/1904.07850.
|
[12] |
CHI Z W, HUANG H Y, XU H D, et al. Complicated table structure recognition[EB/OL]. (2019-08-28)[2022-03-10]. https://arxiv.org/abs/1908.04729.
|
[13] |
XUE W Y, YU B S, WANG W, et al. TGRNet: A table graph reconstruction network for table structure recognition[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision. Piscataway: IEEE Press, 2021: 1295-1304.
|
[14] |
RIBA P, DUTTA A, GOLDMANN L, et al. Table detection in invoice documents by graph neural networks[C]//Proceeclings of the 2019 International Conference on Document Analysis and Recognition . Piscataway: IEEE Press, 2019: 122-127.
|
[15] |
SCARSELLI F, GORI M, TSOI A C, et al. Computational capabilities of graph neural networks[J]. IEEE Transactions on Neural Networks, 2009, 20(1): 81-102. doi: 10.1109/TNN.2008.2005141
|
[16] |
QASIM S R, MAHMOOD H, SHAFAIT F. Rethinking table recognition using graph neural networks[C]//Proceeclings of the 2019 International Conference on Document Analysis and Recognition. Piscataway: IEEE Press, 2019: 142-147.
|
[17] |
LI Y R, HUANG Z, YAN J C, et al. GFTE: Graph-based financial table extraction[C]//Proceeclings of the International Conference on Pattern Recognition. Berlin: Springer, 2021: 644-658.
|
[18] |
郑海潇, 文斌. 基于图卷积网络的比特币非法交易识别方法[J]. 信息网络安全, 2021, 21(9): 74-79. doi: 10.3969/j.issn.1671-1122.2021.09.011
ZHENG H X, WEN B. Bitcoin illegal transaction identification method based on graph convolutional network[J]. Netinfo Security, 2021, 21(9): 74-79(in Chinese). doi: 10.3969/j.issn.1671-1122.2021.09.011
|