Chinese Entity Relation Joint Extraction Method Based on Deep Learning

doi:10.3969/j.issn.1006-2475.2025.08.002

Abstract

Abstract: Abstract: Entity-relationship extraction is an important part of artificial intelligence technologies such as building knowledge graphs and improving search engine efficiency. Due to the complexity， ambiguity， and implicit nature of Chinese text composition， the process of Chinese entity relationship extraction is prone to entity overlapping， entity nesting， and information redundancy. Therefore， this paper proposes a deep learning-based joint extraction model of Chinese entity relations（SRGP). The model firstly encodes the input text， obtains the set of specific relations through the specific relation prediction network， fuses the set of specific relations with the input text into the entity recognition module through the attention mechanism， and reduces the redundant computation in the extraction of Chinese entity relations. For the problems of insufficient extraction of overlapping entities and inaccurate recognition of nested entities， the global pointer annotation strategy based on specific relations is proposed by utilizing the idea of global normalization under the constraints of a specific set of relations. Two general Chinese datasets， DUIE1.0 and CMeIE， are selected respectively， and this paper’s model， SRGP， is compared with the typical models of entity-relationship joint extraction， such as CopyRE， PRGC， and CasRel， for the comparison experiments， and the experimental results show that this paper’s model achieves F1 values of 61.3% and 80.1% on the two datasets， which are respectively 1.5 and 2.2 percentage points higher than those of the best-performing baseline models CasRel and PRGC.

Key words: Key words: entity relationship extraction, deep learning, relationship-specific forecasting, redundant computing, global pointer labeling policy

CLC Number:

中图分类号：TP311

WEI Huimin1, 2, ZHOU Jiake1, 2, WEN Yongjun1, 2, TANG Lijun1, 2. Chinese Entity Relation Joint Extraction Method Based on Deep Learning[J]. Computer and Modernization, 2025, 0(08): 10-15.

References

［1］ WANG H L， QIN K， ZAKARI R Y， et al. Deep neural network-based relation extraction: An overview［J］. Neural Computing and Applications， 2022，34:4781-4801.
［2］ JI S X， PAN S R， CAMBRIA E， et al. A survey on knowledge graphs: Representation， acquisition， and applications［J］. IEEE Transactions on Neural Networks and Learning Systems， 2022，33（2）:494-514.
［3］ LIN Y C， LU K M， YU S， et al. Multimodal learning on graphs for disease relation extraction［J］. Journal of Biomedical Informatics， 2023，143. DOI: 10.1016/j.jbi.2023.104415.
［4］ ZHANG Q Q， CHEN M D， LIU L Z. A review on entity relation extraction［C］// 2017 2nd International Conference on Mechanical， Control and Computer Engineering （ICMCCE）. IEEE， 2017:178-183.
［5］ CEN Y K， ZHANG J， WANG G F， et al. Trust relationship prediction in Alibaba E-commerce platform［J］. IEEE Transactions on Knowledge and Data Engineering， 2020，32（5）:1024-1035.
［6］ MENG Z， TIAN S W， YU L， et al. Joint extraction of entities and relations based on character graph convolutional network and multi-head self-attention mechanism［J］. Journal of Experimental & Theoretical Artificial Intelligence， 2021，33（2）:349-362.
［7］ REN F L， ZHANG L H， YIN S J， et al. A novel global feature-oriented relational triple extraction model based on table filling［J］. arXiv preprint arXiv:2109.06705， 2021.
［8］ GUPTA P， SCHÜTZE H， ANDRASSY B. Table filling multi-task recurrent neural network for joint entity and relation extraction［C］// Proceedings of COLING 2016， the 26th International Conference on Computational Linguistics. The COLING 2016 Organizing Committee， 2016:2537-2547.
［9］ SUI D B， CHEN Y B， LIU K， et al. Joint entity and relation extraction with set prediction networks［J］. arXiv preprint arXiv:2011.01675， 2020.
［10］ DAI D， XIAO X Y， LYU Y J， et al. Joint extraction of entities and overlapping relations using position-attentive sequence labeling［C］// Proceedings of the 33rd AAAI Conference on Artificial Intelligence. AAAI， 2019，33（1）:6300-6308.
［11］ ZHENG H Y， WEN R， CHEN X， et al. PRGC: Potential relation and global correspondence based joint relational triple extraction［J］. arXiv preprint arXiv:2106.09895， 2021.
［12］ MA C X， ZHANG C. Joint pre-trained Chinese named entity recognition based on bi-directional language model［J］. International Journal of Pattern Recognition and Artificial Intelligence， 2021，35（9）. DOI: 10.1142/S021800142153 0037.
［13］王泽儒，柳先辉. 基于指针级联标注的中文实体关系联合抽取模型［J］. 武汉大学学报（理学版）， 2022，68（3）:304-310.
［14］禹克强，黄芳，吴琪，等. 基于双向语义的中文实体关系联合抽取方法［J］. 计算机工程， 2023，49（1）:92-99.
［15］ KANG H， XIAO J W， ZHANG Y P， et al. A research toward Chinese named entity recognition based on transfer learning［J］. International Journal of Computational Intelligence Systems， 2023，16（1）. DOI: 10.1007/s44196-023-00244-3.
［16］陈曙东，欧阳小叶. 命名实体识别技术综述［J］. 无线电通信技术， 2020，46（3）:251-260.
［17］冯钧，张涛，杭婷婷. 重叠实体关系抽取综述［J］. 计算机工程与应用， 2022，58（1）:1-11.
［18］ LIU Y H， OTT M， GOYAL N， et al. RoBERTa: A robustly optimized BERT pretraining approach［J］. arXiv preprint arXiv:1907.11692， 2019.
［19］ XU Z. RoBERTa-wwm-ext fine-tuning for Chinese text classification［J］. arXiv preprint arXiv:2103.00492， 2021.
［20］ SU J L， MURTADHA A， PAN S F， et al. Global pointer: Novel efficient span-based approach for named entity recognition［J］. arXiv preprint arXiv:2208.03054， 2022.
［21］ ALAMI N， MEKNASSI M， EN-NAHNAHI N. Enhancing unsupervised neural networks based text summarization with word embedding and ensemble learning［J］. Expert Systems with Applications， 2019，123:195-211.
［22］ GUAN T F， ZAN H Y， ZHOU X B， et al. CMeIE: Construction and evaluation of Chinese medical information extraction dataset［C］// 9th International Conference on Natural Language Processing and Chinese Computing. Springer， 2020:270-282.
［23］ AGRAWAL S， DUTTA S， PATRA B K. Sentiment analysis of short informal text by tuning BERT-Bi-LSTM model［C］// IEEE EUROCON 2021-19th International Conference on Smart Technologies. IEEE， 2021:98-102.
［24］ ZENG D J， ZHANG H R， LIU Q Y. Copymtl: Copy mechanism for joint extraction of entities and relations with multi-task learning［C］// Proceedings of the 34th AAAI Conference on Artificial Intelligence. AAAI, 2020，34（5）:9507-9514.
［25］ WEI Z P， SU J L， WANG Y， et al. A novel cascade binary tagging framework for relational triple extraction［C］// Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. ACL， 2020:1476-1488.
［26］ SHANG Y M， HUANG H Y， MAO X L. OneRel: Joint entity and relation extraction with one module in one step［C］// Proceedings of the 36th AAAI Conference on Artificial Intelligence. AAAI， 2022，36（10）:11285-11293.

[1]	LI Jia. Classification and Diagnosis of Breast Cancer Histopathological Images Based on Transfer Learning [J]. Computer and Modernization, 2025, 0(08): 89-96.
[2]	LIU Shaojun, SHA Yitian, JIN Qianqian, CHEN Peng, WU Yue. LDA-IDF Process Log Anomaly Detection Method for Smart Grids [J]. Computer and Modernization, 2025, 0(06): 114-119.
[3]	LI Zhuoqi, ZHAO Lihui. Image Encryption Method Based on Poisoning Attack Strategy [J]. Computer and Modernization, 2025, 0(05): 41-47.
[4]	WANG Dongfang1, YANG Yan1, ZHANG Dong1, HAN Wenrui2, LI Mingchang2. DSA De-artifacting Algorithm Based on Deformation Field Registration [J]. Computer and Modernization, 2025, 0(05): 86-90.
[5]	WEI Yunsong1, 2, LI Jiaqiang1, 2, HE Chao1, 2, 3, YU Haisheng1, 2, CHEN Yanlin1, 2, ZHAO Longqing1, 2, WEI Rongkun1, 2. Research Advances on 3D Object Detection Method Based on Visual Information and LiDAR for Intelligent Driving [J]. Computer and Modernization, 2025, 0(05): 91-102.
[6]	XU Ling1, ZHANG Dong1, WEN Shen1, HU Ping2. Glioma Segmentation and Classification Network Assisted by Object Detection [J]. Computer and Modernization, 2025, 0(05): 111-116.
[7]	ZHUANG Yu, FU Xiaojin, LI Sha, WU Zheng. UAV Small Target Detection Based on XMB-YOLOv5s [J]. Computer and Modernization, 2025, 0(04): 29-35.
[8]	LI Kai, JIN Yunpeng, LI Haiyang, KONG Shasha, YANG Peng, FANG Chengwu, HUANG Xiangjie, HAN Yaosheng, LI Chunmei. AGP Calculation Methods in UAV Imagery Based on Image Segmentation [J]. Computer and Modernization, 2025, 0(04): 83-88.
[9]	WANG Jiale, SONG Wenai, FU Lizhen. Occupational Pneumoconiosis Screening Based on HA-Net Model [J]. Computer and Modernization, 2025, 0(04): 103-110.
[10]	TANG Rui1, WU Jianchao1, CHEN Jianbo1, CHAI Jiang1, WANG Qian1, HE Yuchen2. Improved YOLOv8s Algorithm Based on GiraffeDet for Transmission Line Icing Detection [J]. Computer and Modernization, 2025, 0(03): 6-11.
[11]	LI Haoran1, HE Wenxue1, XU Jiazhen1, YANG Banghua2. Classification Method of EEG Signals for Depression Based on Multi-Scale Dynamic Convolution and Attention Mechanism [J]. Computer and Modernization, 2025, 0(03): 60-65.
[12]	PU Yaya, WANG Yanbo, SU Yongdong, XU Zhongcheng. Multi-scale Feature Image Defogging Algorithm Based on Content-guided Attention Fusion [J]. Computer and Modernization, 2025, 0(03): 78-85.
[13]	LUO Hao, LI Xianfeng. Remote Sensing Image Classification Based on Multi-scale Feature Extraction [J]. Computer and Modernization, 2025, 0(03): 86-92.
[14]	ZHANG Yue, GUO Zixin, HUANG Yibin, YAN Tao. Network Intrusion Detection Method Based on Convolutional Neural Networks with convLSTM [J]. Computer and Modernization, 2025, 0(03): 119-126.
[15]	LIU Chongyi, LI Hua, REN Dejun, LIU Yaokai, WANG Yulong. Anomaly Detection Algorithm Based on Bidirectional Multi-scale Knowledge Distillation [J]. Computer and Modernization, 2025, 0(02): 58-63.