Volume 48 Issue 12
Dec.  2022
Turn off MathJax
Article Contents
JING Xin, WANG Huafeng, LIU Qianfeng, et al. Named entity recognition in nuclear power field based on ELMo-GCN[J]. Journal of Beijing University of Aeronautics and Astronautics, 2022, 48(12): 2556-2565. doi: 10.13700/j.bh.1001-5965.2021.0155(in Chinese)
Citation: JING Xin, WANG Huafeng, LIU Qianfeng, et al. Named entity recognition in nuclear power field based on ELMo-GCN[J]. Journal of Beijing University of Aeronautics and Astronautics, 2022, 48(12): 2556-2565. doi: 10.13700/j.bh.1001-5965.2021.0155(in Chinese)

Named entity recognition in nuclear power field based on ELMo-GCN

doi: 10.13700/j.bh.1001-5965.2021.0155
Funds:

Beijing Municipal Commission of Education Scientific Research Program KM202110009001

Scientific Research Program of Hebei Province 203777116D

More Information
  • Corresponding author: WANG Huafeng, E-mail: wanghuafeng@buaa.edu.cn
  • Received Date: 30 Mar 2021
  • Accepted Date: 31 May 2021
  • Publish Date: 13 Jul 2021
  • In the process of knowledge management in nuclear power, it's necessary to use named entity recognition to extract high-quality semantic entities for intelligent analysis and processing of text in nuclear power.On the basis of existing research, the recognition precision rate of the model for nested named entities is improved by enhancing the ability of the network rate to extract context information. The experimental results show that the proposed method improves the precision and recall rate significantly compared with the existing methods. Compared with the BiFlaG network, the precision rate is increased by 9.52%, the recall rate is increased by 8.51%, and the F1 value is increased by 9.02%.

     

  • loading
  • [1]
    王飞跃, 孙奇, 江国进, 等. 核能5.0: 智能时代的核电工业新形态与体系架构[J]. 自动化学报, 2018, 44(5): 922-934. https://www.cnki.com.cn/Article/CJFDTOTAL-MOTO201805015.htm

    WANG F Y, SUN Q, JIANG G J, et al. Nuclear energy 5.0: New formation and system architecture of nuclear power industry in the new IT era[J]. Acta Automatica Sinica, 2018, 44(5): 922-934(in Chinese). https://www.cnki.com.cn/Article/CJFDTOTAL-MOTO201805015.htm
    [2]
    国务院发展研究中心资源与环境政策研究所. 中国能源革命进展报告(2020)[M]. 北京: 石油工业出版社, 2020.

    Institute of Resources and Environmental Policy, Development Research Center of the State Council. The energy development report of China(2020)[M]. Beijing: Petroleum Industry Press, 2020(in Chinese).
    [3]
    KRIPKE S, DAVIDSON D, HARMAN G. Naming and necessity[M]. Cambridge: Harvard University Press, 1980: 253-355.
    [4]
    CHINCHOR N. MUC-6 named entity task definition[C] // Conference on Message Understanding, 1995.
    [5]
    FLEISCHMAN M. Automated subcategorization of named entities[C] // Association for Computational Linguistic, 2001.
    [6]
    LEE S, LEE G. Heuristic methods for reducing errors of geographic named entities learned by bootstrapping[C] // Natural Language Processing. Berlin: Springer, 2005, 3651: 658-669.
    [7]
    FLEISCHMAN M, HOVY E. Fine grained classification of named entities[C] // Proceedings of the 19th International Conference on Computational Linguistics, 2002: 1-7.
    [8]
    BODENREIDER O, ZWEIGENBAUM P. Identifying proper names in parallel medical terminologies[J]. Studies in Health Technology and Informatics, 2000, 77: 443-447.
    [9]
    SHEN D, ZHANG J, ZHOU G D, et al. Effective adaptation of a hidden Markov model-based named entity recognizer for biomedical domain[C] // Proceedings of the ACL 2003 Workshop on Natural Language Processing in Biomedicine, 2003, 13: 49-56.
    [10]
    GOYAL A, GUPTA V, KUMAR M. Recent named entity recognition and classification techniques: A systematic review[J]. Computer Science Review, 2018, 29: 21-43.
    [11]
    GOLLER C, KUCHER A. Learning task-dependent distributed representations by backpropagation through structure[C] //Proceedings of International Conference on Neural Networks. Piscataway: IEEE Press, 1996, 1: 347-352.
    [12]
    HAMMERTON J. Named entity recognition with long short-term memory[C] // Proceedings of the 7th Conference on Natural Language Learning, 2003, 4: 172-175.
    [13]
    HUANG Z H, XU W, YU K. Bidirectional LSTM-CRF models for sequence tagging[EB/OL]. (2015-08-09)[2021-03-01]. https://arxiv.org/abs/1508.01991.
    [14]
    PETERS M, NEUMANN M, IYYER M, et al. Deep contextualized word representations[C] // Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2018, 1: 2227-2237.
    [15]
    SUTSKEVER I, VINYAL S O, LE Q V. Sequence to sequence learning with neural networks[C]// Proceedings of the 27th International Conference on Neural Information Processing Systems. Cambridge: MIT Press, 2014, 2: 3104-3112.
    [16]
    VASWANI A, SHAZEER N, PARMAR N, et al. Attention is all you need[C]//Proceedings of the 31st International Conference on Neural Information Processing Systems, 2017: 5998-6008.
    [17]
    DEVLIN J, CHANG M W, LEE K, et al. BERT: Pre-training of deep bidirectional transformers for language understanding[C] // Proceedings of the 2019 Conference of the North, 2019, 1: 4171-4186.
    [18]
    KAZAMA J, MAKINO T, OHTA Y, et al. Tuning support vector machines for biomedical named entity recognition[C] // Proceedings of the ACL-02 Workshop on Natural Language Processing in the Biomedical Domain, 2002, 3: 1-8.
    [19]
    TAULÉ M, MARTÍ M A, RECASENS M. AnCora: Multilingual and multilevel annotated corpora[C] // LREC 2008, 2008: 96-101.
    [20]
    DODDINGTON G R, MITCHELL A, PRZYBOCKIM A, et al. The automatic content extraction(ACE) program-tasks, data, and evaluation[C]//LREC 2004, 2004: 837-840.
    [21]
    FINKEL J R, MANNING C D. Nested named entity recognition[C]// Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing, 2009, 1: 141-150.
    [22]
    ALEX B, HADDOW B, GROVER C. Recognising nested named entities in biomedical text[C] // Proceedings of the Workshop on BioNLP 2007 Biological, Translational, and Clinical Language Processing, 2007: 65-72.
    [23]
    LU W, DAN R. Joint mention extraction and classification with mention hypergraphs[C]// Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, 2015: 857-867.
    [24]
    XIA C Y, ZHANG C W, YANG T, et al. Multi-grained named entity recognition[C]// Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, 2019: 1430-1440.
    [25]
    LUO Y, ZHAO H. Bipartite flat-graph network for nested named entity recognition[C]// Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020: 6408-6418.
    [26]
    于平安, 朱瑞安, 喻真烷, 等. 核反应堆热工分析[M]. 3版. 上海: 上海交通大学出版社, 2002.

    YU P A, ZHU R A, YU Z W, et al. Nuclear reactor thermal analysis[M]. 3th ed. Shanghai: Shanghai Jiao Tong University Press, 2002(in Chinese).
    [27]
    谢仲生, 吴宏春, 张少鸿. 核反应堆物理分析(修订版)[M]. 西安: 西安交通大学出版社, 2002.

    XIE Z S, WU H C, ZHANG S H. Nuclear reactor physical analysis(Revised Edition)[M]. Xi'an: Xi'an Jiaotong University Press, 2020(in Chinese).
    [28]
    LAFFERTY J D, MCCALLUM A, PEREIRA F C N. Conditional random fields: Probabilistic models for segmenting and labeling sequence data[C] //Proceedings of the 18th International Conference on Machine Learning. San Francisco: Morgan Kaufmann Publishers Inc, 2001: 282-289.
    [29]
    LAMPLE G, BALLESTEROS M, SUBRAMANIAN S, et al. Neural architectures for named entity recognition[C] // Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2016: 260-270.
    [30]
    MA X Z, HOVY E. End-to-end sequence labeling via bi-directional LSTM-CNNs-CRF[C] // Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics, 2016, 1: 1064-1074.
    [31]
    YANG J, ZHANG Y. NCRF++: An open-source neural sequence labeling toolkit[C] // Proceedings of ACL 2018, 2018: 74-79.
    [32]
    KIPF T N, WELLING M. Semi-supervised classification with graph convolutional networks[EB/OL]. (2017-02-22)[2021-03-01]. https://arxiv.org/abs/1609.02907v3.
  • 加载中

Catalog

    通讯作者: 陈斌, bchen63@163.com
    • 1. 

      沈阳化工大学材料科学与工程学院 沈阳 110142

    1. 本站搜索
    2. 百度学术搜索
    3. 万方数据库搜索
    4. CNKI搜索

    Figures(7)  / Tables(5)

    Article Metrics

    Article views(271) PDF downloads(20) Cited by()
    Proportional views
    Related

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return