Tibetan Named Entity Recognition Based on Small Sample Learning

Abstract

Abstract: The task of Tibetan named entity recognition is to identify the names of people， places and organizations in the text. This paper proposed a Tibetan named entity recognition method based on small sample learning. In the training process， the feature fusion of entity location information， word segmentation information and Tibetan syllable information in the form of dimensional splicing could better represent the boundary information of Tibetan long entities. Ablation experiments were designed to explore the effect of different feature information on model performance. The experimental results show that our method is effective， and the F1 value is improved by 22.22~38 percentage points compared with the baseline experiment.

Key words: small sample learning, Tibetan, named entity recognition, entity feature information fusion

YU Tao, ZHANG Ying, Yong Tso, . Tibetan Named Entity Recognition Based on Small Sample Learning[J]. Computer and Modernization, 2023, 0(05): 13-19.

References

［1］王丽客，孙媛，夏天赐. 基于远程监督的藏文实体关系抽取［J］. 中文信息学报， 2020，34（3）:72-79.
［2］慈祯嘉措，桑杰端珠，孙茂松，等. 基于迭代式回译策略的藏汉机器翻译方法研究［J］. 中文信息学报， 2020，34（11）:67-73.
［3］姜磊，刘琦，袁鹏，等. 面向知识图谱的信息抽取技术综述［J］. 计算机系统应用， 2022，31（7）:46-54.
［4］胡晗，刘鹏远. 小样本关系分类研究综述［J］. 中文信息学报， 2022，36（2）:1-11.
［5］ MORWAL S，CHOPRA D. NERHMM: A tool for named entity recognition based on hidden Markov model［J］. International Journal on Natural Language Computing， 2013，2（2）:43-49.
［6］ BORTHWICK A， STERLING J， AGICHTEIN E， et al. Exploiting diverse knowledge sources via maximum entropy in named entity recognition［C］// Proceedings of the 6th Workshop on Very Large Corpora. 1998:152-160.
［7］ HAN A L F，WONG D F，CHAO L S. Chinese named entity recognition with conditional random fields in the light of Chinese characteristics［C］// Proceedings of Intelligent Information Systems Symposium. 2013:57-68.
［8］ HAMMERTON J. Named entity recognition with long short-term memory［C］// Proceedings of the 7th Conference on Natural Language Learning at HLT-NAACL. 2003:172-175.
［9］ CHANGKI L. LSTM-CRF models for named entity recognition［J］. IEICE TRANS. INF. & SYST.， 2017，D（4）:882-887.
［10］ COLLOBERT R， WESTON J， BOTTOU， et al. Natural language processing from scratch［J］. Journal of Machine Learning Research， 2011，12（1）:2493-2537.
［11］ HUANG Z H，XU W，YU K. Bidirectional LSTM-CRF models for sequence tagging［J］. arXiv preprint arXiv:1508.01991， 2015.
［12］ LAMPLE G，BALLESTEROS M，SUBRAMANIAN S，et al. Neural architectures for named entity recognition［C］// Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics. 2016:260-270.
［13］ ZHANG Y， YANG J. Chinese NER using lattice LSTM ［C］// Proceedings of the 56th International Conference on Computational Linguistics. 2018:1554-1564.
［14］ WU Y，HUANG J，XU C E，et al. Research on named entity recognition of electronic medical records based on RoBERTa and radical-level feature［J］. Wireless Communications and Mobile Computing，2021（10）:1-10.
［15］ YU H Z， JIANG T， MA N. Named entity recognition for Tibetan texts using case-auxiliary grammars［C］// 2010 International MulitiConference of Engineers and Computer Scientists（IMECS 2010）. 2010:601-604.
［16］ SUN Y，YAN X D，ZHAO X B，et al. Research on automatic recognition of Tibetan personal names based on multi-features［C］// Proceedings of International Conference on Natural Language Processing and Knowledge Engineering. 2010. DOI: 10.1109/NLPKE.2010.5587820.
［17］华却才让，姜文斌，赵海兴，等. 基于感知机模型藏文命名实体识别［J］. 计算机工程与应用， 2014，50（15）:172-176.
［18］加羊吉，李亚超，宗成庆，等. 最大熵和条件随机场模型相融合的藏文人名识别［J］. 中文信息学报， 2014，28（1）:107-112.
［19］康才畯，龙从军，江荻. 基于条件随机场的藏文人名识别研究［J］. 计算机工程与应用， 2015，51（3）:109-111.
［20］珠杰，李天瑞，刘胜久. 基于条件随机场的藏文人名识别技术研究［J］. 南京大学学报（自然科学版）， 2016，52（2）:289-299.
［21］刘飞飞，王志娟. 基于层次特征的藏文人名识别研究［J］. 计算机应用研究， 2018，35（9）:2583-2587.
［22］珠杰，李天瑞. 深度学习模型的藏文人名识别方法［J］.高原科学研究， 2017，1（1）:112-124.
［23］贡保才让. 深层神经网络的藏文命名实体识别研究［D］. 西宁:青海师范大学， 2018.
［24］头旦才让，仁青东主，尼玛扎西. 基于CRF的藏文地名识别技术研究［J］. 计算机工程与应用， 2019，55（18）:111-115.
［25］孙朋. 基于弱监督学习的藏文命名实体识别研究［D］.北京:中央民族大学， 2020.
［26］李晓敏. 基于深度学习的藏文命名实体识别研究［D］. 兰州:兰州大学， 2021.
［27］环科尤. 基于深度学习的格萨尔史诗命名实体识别关键技术研究［D］. 西宁:青海师范大学， 2022.
［28］洛桑嘎登，群诺，索南尖措，等. 融合音节部件特征的藏文命名实体识别方法［J］. 厦门大学学报（自然科学版）， 2022，61（4）:624-629..
［29］ ZAREMBA W，SUTSKEVER I，VINYALS O. Recurrent neural network regularzation［J］. arXiv preprint arXiv:1409.2329，2014.
［30］ GERS F A. Learning to forget: Continual prediction with LSTM［C］// Proceedings of the 9th International Conference on Artificial Neural Networks. 1999:850-855.
［31］ CHO K，MERRIENBOER B V，GULCEHRE C，et al. Learning phrase representations using RNN encoder-decoder for statistical machine translation［J］. arXiv preprint arXiv:1406.1078， 2014.
［32］ MA P C，JIANG B，LU Z G，et al. Cybersecurity named entity recognition using bidirectional long short-term memory with conditional random fields［J］. Tsinghua Science and Technology， 2021，26（3）:259-265.
［33］ DENG J F，CHENG L L，WANG Z W. Self-attention-based BiGRU and capsule network for named entity recognition［J］. arXiv preprint arXiv:2002.00735， 2020.

[1]	Renqingzhuoma1, 2, 3, Yongcuo1, 2, 3, TANG Chaochao1, 2, 3. Data Filtering Strategies for Tibetan-Chinese Neural Machine Translation [J]. Computer and Modernization, 2024, 0(06): 19-24.
[2]	QIAO Lu, SUN You-chao, WU Hong-lan. Information Extraction for Aircraft Fault Text [J]. Computer and Modernization, 2024, 0(03): 61-66.
[3]	CUI Shao-guo, HU Guang-ping. Nested Named Entity Recognition Based on Semantic Segmentation [J]. Computer and Modernization, 2024, 0(02): 69-74.
[4]	ZHENG Li-rui, XIAO Xiao-xia, ZOU Bei-ji, LIU Bin, ZHOU Zhan. Named Entity Recognition in Electronic Medical Record Based on BERT [J]. Computer and Modernization, 2024, 0(01): 87-91.
[5]	ZHU Ya-jun, Yong Tso, Nyima Tashi, . Tibetan Medical Entity Recognition Based on Tibetan BERT [J]. Computer and Modernization, 2023, 0(01): 43-48.
[6]	YU Peng, CHEN Yu-feng, XU Jin-an, ZHANG Yu-jie. Entity Recognition Method on EMR Based on Multi-task Learning [J]. Computer and Modernization, 2022, 0(09): 40-50.
[7]	YANG Zheng, CAI Di, LI Hui-bin. Hierarchical Representation of Power Text Named Entity Recognition and Project-expert Matching [J]. Computer and Modernization, 2022, 0(05): 75-81.
[8]	SUN Yi-dong, YONG Cuo, YANG Dan, . Tibetan-Chinese Bidirectional Machine Translation Based on VOLT [J]. Computer and Modernization, 2022, 0(05): 28-32.
[9]	LI Jian, ZHANG Ke-liang, TANG Liang, XIA Rong-jing, REN Jing-jing. Data Augmentation for Chinese Named Entity Recognition Task [J]. Computer and Modernization, 2022, 0(04): 1-6.
[10]	WANG Yun-qian, WANG Yi-song, CHEN Pan-feng, ZOU Long. Named Entity Recognition of Medicinal Plant Texts Integrated with Attention Mechanism [J]. Computer and Modernization, 2021, 0(11): 100-105.
[11]	ZHANG Cen-fang. Named Entity Recognition Algorithm Based on Active Learning [J]. Computer and Modernization, 2021, 0(07): 18-22.
[12]	ZHU Yan, ZHANG Li, WANG Yu. Named Entity Recognition on Chinese Electronic Medical Records Based on RoBERTa-WWM [J]. Computer and Modernization, 2021, 0(02): 51-55.
[13]	XU Meng-di, WANG Jin-hua. Requirements Document Named Entity Recognition Based on Deep Learning and Grammatical Regulations [J]. Computer and Modernization, 2021, 0(01): 105-110.
[14]	ZHANG Lei. Research on Named Entity Recognition Method in Specific Fields [J]. Computer and Modernization, 2018, 0(03): 60-.
[15]	ZHANG Jian, WU Qing, YANG Xin-yi, WANG Bin-cong, WU Xuan-wei, XU Xiang-ying, LYU Qiang. Chinese Agricultural Named Entity Recognition Based on Conditional Random Fields [J]. Computer and Modernization, 2018, 0(01): 123-126.