基于语义分割的嵌套命名实体识别方法

doi:10.3969/j.issn.1006-2475.2024.02.011

摘要/Abstract

摘要： 摘要：命名实体识别旨在从非结构化文本中提取实体，实体之间通常存在嵌套结构。然而，以往的研究大多只关注平面命名实体的识别，而忽略了嵌套实体。因此本文提出一种基于语义分割的嵌套命名实体识别方法，该方法将嵌套命名实体识别任务表述为一个语义分割任务。首先，计算单词和单词之间的元素相似性、余弦相似性以及双线性相似性；然后将3种相似性特征拼接作为一个图像输入到语义分割模型中，得到单词和单词之间的关系矩阵；最后，从关系矩阵提取出嵌套实体。实验结果表明，本文方法可以有效地识别出嵌套实体，在公开嵌套命名实体识别数据集GENIA上的F1值达到80.0%，优于现有大多数嵌套实体识别方法。

关键词: 关键词：嵌套命名实体识别, 关系矩阵, 语义分割, 相关性特征

Abstract: Abstract： Named entity recognition aims to extract entities from an unstructured text， and a nested structure often exists between entities. However， most of the previous studies only focused on the recognition of flat named entities while ignoring nested entities. Therefore， a nested named entity recognition method based on semantic segmentation is proposed， which describes the task of nested named entity recognition as a semantic segmentation task. First， we calculate the element similarity， cosine similarity and bilinear similarity between words and words. Then， the 3 similarity features are spliced as an image which will be input into the semantic segmentation model to obtain the relationship matrix between words and words. Finally， we extract nested entity from the relationship matrix. The experimental results show that the proposed method can effectively recognize nested entities， and the F1 value on the public nested named entity recognition dataset GENIA reaches 80.0%， which is superior to most existing nested entity recognition methods.

Key words: Key words： nested named entity recognition, relation matrix, semantic segmentation, correlation feature

中图分类号:

TP391.1

崔少国, 胡光平. 基于语义分割的嵌套命名实体识别方法[J]. 计算机与现代化, 2024, 0(02): 69-74.

CUI Shao-guo, HU Guang-ping. Nested Named Entity Recognition Based on Semantic Segmentation[J]. Computer and Modernization, 2024, 0(02): 69-74.

参考文献

［1］冀振燕，孔德焱，刘伟，等. 基于深度学习的命名实体识别研究［J］. 计算机集成制造系统， 2022（6）：1603-1615.
［2］ HUANG Z H， XU W， YU K. Bidirectional LSTM-CRF models for sequence tagging［J］. arXiv preprint arXiv：1508.01991， 2015．
［3］ JU M Z， MIWA M， ANANIADOU S. A neural layered model for nested named entity recognition［C］// Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics. 2018：1446-1459.
［4］ LUO Y， ZHAO H. Bipartite flat-graph network for nested named entity recognition［J］. arXiv preprint arXiv：2005.00436， 2020.
［5］ WANG J， SHOU L D， CHEN K， et al. Pyramid： A layered model for nested named entity recognition［C］// Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. 2020：5918-5928.
［6］ LU W， ROTH D. Joint mention extraction and classification with mention hypergraphs［C］// Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing. 2015：857-867.
［7］ MUIS A O， LU W. Labeling gaps between words： Recognizing overlapping mentions with mention separators［J］. arXiv preprint arXiv：1810.09073， 2018.
［8］ KATIYAR A， CARDIE C. Nested named entity recognition revisited［C］// Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics. 2018：861-871.
［9］ WANG B L， LU W. Neural segmental hypergraphs for overlapping mention recognition［J］. arXiv preprint arXiv：1810.01817， 2018.
［10］ STRAKOVÁ J， STRAKA M， HAJIČ J. Neural architectures for nested NER through linearization［J］. arXiv preprint arXiv：1908.06926， 2019.
［11］ YAN H， GUI T， DAI J Q， et al. A unified generative framework for various NER subtasks［J］. arXiv preprint arXiv：2106.01223， 2021．
［12］ SOHRAB M G， MIWA M. Deep exhaustive model for nested named entity recognition［C］// Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing. 2018： 2843-2849.
［13］ ZHENG C M， CAI Y， XU J Y， et al. A boundary-aware neural model for nested named entity recognition［C］// Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing. 2019：357-366．
［14］ TAN C Q， QIU W， CHEN M S， et al. Boundary enhanced neural span classification for nested named entity recognition［J］. Proceedings of the AAAI Conference on Artificial Intelligence， 2020，34（5）：9016-9023.
［15］ XU Y X， HUANG H Y， FENG C， et al. A supervised multi-head self-attention network for nested named entity recognition［J］. Proceedings of the 2021 AAAI Conference on Artificial Intelligence. 2021，35（16）：14185-14193.
［16］ WAN J C， RU D Y， ZHANG W N， et al. Nested named entity recognition with span-level graphs［C］// Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics. 2022，1：892-903.
［17］ LIU Q， CHEN B， LOU J G， et al. Incomplete utterance rewriting as semantic segmentation［C］// Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing. 2020：2846-2857
［18］ DEVLIN J， CHANG M W， LEE K T， et al. BERT： Pre-training of deep bidirectional transformers for language understanding［C］// Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics. 2019：4171-4186．
［19］ VASWANI A， SHAZEER N， PARMAR N， et al. Attention is all you need［J］. arXiv preprint arXiv：1706.03762， 2017．
［20］ RONNEBERGER O， FISCHER P， BROX T. U-Net： Convolutional networks for biomedical image segmentation［C］// Medical Image Computing and Computer-Assisted Intervention – MICCAI 2015. 2015：234-241.
［21］ ZHANG Y， YANG J. Chinese NER using lattice LSTM［J］. arXiv preprint arXiv：1805.02023， 2018.
［22］ SANG E F T K， MEULDER F D. Introduction to the coNLL-2003 shared task： Language-independent named entity recognition［C］// Proceedings of the 7th Conference on Natural Language Learning at HLT-NAACL 2003 - Volume 4. 2003：142-147.
［23］ LEE J H Y， YOON W， KIM S， et al. BioBERT： A pre-trained biomedical language representation model for biomedical text mining［J］. Bioinformatics， 2020，36（4）：1234-1240.
［24］ XUAN Z Y， BAO R， JIANG S Y. FGN： Fusion glyph network for chinese named entity recognition［C］// 2021 Knowledge Graph and Semantic Computing： Knowledge Graph and Cognitive Intelligence. 2021：28-40．
［25］ LI X， YAN H， QIU X， et al. FLAT： Chinese NER using flat-lattice transformer［C］// Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. 2020：6836-6842
［26］ LAMPLE G， BALLESTEROS M， SUBRAMANIAN S， et al. Neural architectures for named entity recognition［C］// Proceedings of the 2016 North American Chapter of the Association for Computational Linguistics. 2016：260-270.
［27］ WANG X Y， JIANG Y， BACH N， et al. Automated concatenation of embeddings for structured prediction［J］. arXiv preprint arXiv：2010.05006， 2020.

[1]	胡崇佳, 刘金洲, 方立. 基于无监督域适应的室外点云语义分割[J]. 计算机与现代化, 2024, 0(01): 74-79.
[2]	许鸿奎, 李振业, 郭文涛, 赵京政, 郭旭斌. 基于分割的任意形状场景文本实时检测[J]. 计算机与现代化, 2023, 0(11): 95-100.
[3]	叶思佳, 魏延, 杜韩宇, 邓金枝. 结合注意力机制的HRNet图像语义分割算法[J]. 计算机与现代化, 2023, 0(10): 65-69.
[4]	刘续, 查可可. 一种用于机场特种车辆作业的环境目标识别方法[J]. 计算机与现代化, 2023, 0(08): 18-24.
[5]	牛玉珩, 李永可, 陈燕红, 蒋平安. 基于改进SegFormer模型的棉田地表残膜图像分割方法[J]. 计算机与现代化, 2023, 0(07): 93-98.
[6]	叶力鸣, 陈蔚文. 一种结合语义分割和目标检测的级联式绝缘子缺陷检测方法[J]. 计算机与现代化, 2023, 0(06): 82-88.
[7]	唐舒放, 王志胜. 基于双注意力机制的街景语义分割[J]. 计算机与现代化, 2021, 0(10): 69-74.
[8]	周贤来. 基于语义分割的异构多核平台大数据挖掘算法[J]. 计算机与现代化, 2020, 0(10): 40-43.
[9]	朱大庆, 曹国. 基于全卷积网络的砂石图像粒径检测[J]. 计算机与现代化, 2020, 0(07): 111-116.
[10]	周晨轶，王文，卢杉，徐亦白. 基于多层信息融合的实时语义分割及其在电力场景中的应用[J]. 计算机与现代化, 2019, 0(08): 17-.
[11]	王文，徐亦白，卢杉，冯宇. 一种结合区域检测和语义分割的SLAM技术[J]. 计算机与现代化, 2019, 0(07): 55-.
[12]	杨志尧1,2，彭召意1,2，文志强1,2. 一种基于区域建议网络的图像语义分割方法[J]. 计算机与现代化, 2018, 0(02): 122-.
[13]	郭建业;程家兴;胡冰. 时间规划中受资源约束的R_时刻表求解[J]. 计算机与现代化, 2009, 1(12): 10-13,1.