Chinese Agricultural Named Entity Recognition Based on Conditional Random Fields

doi:10.3969/j.issn.1006-2475.2018.01.024

Abstract

Abstract: To meet the requirement of diversification, the paper introduces named entities model based on conditional random fields, divides agricultural named entities into 4 classes, which are diseases and pests, crops, chemical fertilizer, pesticide and annotates. These entities are labeled with custom annotation set. It is segmented collected corpus with ICTCLAS segment system and added features to raise the recognition rate. Ultimately, the accuracy rate reaches over 93% and the recalling rate reaches over 84%. This result confirms that recognizing multiple entities after classifying them is feasible.

Key words: Chinese named entity recognition, conditional random field, agriculture

CLC Number:

TP391.1

ZHANG Jian, WU Qing, YANG Xin-yi, WANG Bin-cong, WU Xuan-wei, XU Xiang-ying, LYU Qiang. Chinese Agricultural Named Entity Recognition Based on Conditional Random Fields[J]. Computer and Modernization, 2018, 0(01): 123-126.

References

［1］李保利,陈玉忠,俞士汶. 信息抽取研究综述［J］. 计算机工程与应用, 2003,39(10):1-5.
［2］戴新宇,尹存燕,陈家骏,等. 机器翻译研究现状与展望［J］. 计算机科学, 2004,31(11):176-179.
［3］毛先领,李晓明. 问答系统研究综述［J］. 计算机科学与探索, 2012,6(3):193-207.
［4］孙镇,王惠临. 命名实体识别研究进展综述［J］. 现代图书情报技术, 2010,26(6):42-47.
［5］Rau L F. Extracting company names from text［C］// Proceedings of the 7th IEEE Conference on Artificial Intelligence Applications. 1991:29-32.
［6］Grishman R, Sundheim B. Message understanding conference-6: A brief history［C］// Conference on Computational Linguistics. 1996,96:466-471.
［7］Bikel D M, Schwartz R, Weischedel R M. An algorithm that learns what’s in a name［J］. Machine Learning, 1999,34(1-3):211-231.
［8］Lafferty J, McCallum A, Pereira F. Conditional random fields:Babilistic models for segmenting and labeling sequence data［C］// Proceedings of the 18th International Conference on Machine Learning. 2001:282-289.
［9］张华平,刘群. 基于角色标注的中国人名自动识别研究［J］. 计算机学报, 2004,27(1):85-91.
［10］Berger A L, Pietra V J D, Pietra S A D. A maximum entropy approach to natural language processing［J］. Computational linguistics, 1996,22(1):39-71.
［11］Rabiner L, Juang B. An introduction to hidden Markov models［J］. IEEE ASSP Magazine, 1986,3(1):4-16.
［12］郭剑毅,薛征山,余正涛,等. 基于层叠条件随机场的旅游领域命名实体识别［J］. 中文信息学报, 2009,23(5):47-53.
［13］叶枫,陈莺莺,周根贵,等. 电子病历中命名实体的智能识别［J］. 中国生物医学工程学报, 2011,30(2):256-262.
［14］王程. 语义网——网络检索的未来发展［J］. 现代情报, 2005,25(4):72-73.
［15］王春雨,王芳. 基于条件随机场的农业命名实体识别研究［J］. 河北农业大学学报, 2014,37(1):132-135.

[1]	WANG Zi-chen, QU You-li. A Partition Inverted Index Compression Algorithm Based on CRF [J]. Computer and Modernization, 2024, 0(02): 36-42.
[2]	ZHENG Li-rui, XIAO Xiao-xia, ZOU Bei-ji, LIU Bin, ZHOU Zhan. Named Entity Recognition in Electronic Medical Record Based on BERT [J]. Computer and Modernization, 2024, 0(01): 87-91.
[3]	WANG Yun-qian, WANG Yi-song, CHEN Pan-feng, ZOU Long. Named Entity Recognition of Medicinal Plant Texts Integrated with Attention Mechanism [J]. Computer and Modernization, 2021, 0(11): 100-105.
[4]	CHEN Xiao-lei, WANG Xing-xing, SHEN Hao-yang. Combination Forecasting Model of Time Series Data in Smart Agriculture [J]. Computer and Modernization, 2021, 0(09): 121-126.
[5]	SHAO Shi-yun, ZHOU Yu, YANG Lei, ZHONG Mao-sheng, DAI Rui, ZHAO Jia-le. An Efficient Entity Identification Method for Electric Bidding Documents Based on Conditional Random Field [J]. Computer and Modernization, 2020, 0(12): 72-77.
[6]	XU Jian-peng, ZHANG Hui, WU Qiong, WANG Hui, WANG Bing. Design and Application of Big Data Platform of Anhui Meteorological Service for Agriculture [J]. Computer and Modernization, 2020, 0(08): 105-108.
[7]	WU Shi-hai, BAO Yi-dong, CHEN Guo, CHEN Qiu-shi. Reduced-reference Crop Image Quality Assessment Based on Random Gabor Feature [J]. Computer and Modernization, 2020, 0(05): 70-.
[8]	ZHANG Lei. Research on Named Entity Recognition Method in Specific Fields [J]. Computer and Modernization, 2018, 0(03): 60-.
[9]	LI Dong-yuan;ZHOU Wen-hui;MO Jian-bin. Design of Agriculture Information Integrated Service Platform Based on .NET [J]. Computer and Modernization, 2011, 1(4): 88-91,9.
[10]	JIANG Wen-zhi;GU Jiao-jiao;HU Wen-xuan;LI Fei. Research on Applications of Conditional Random Fields and Its Improvement [J]. Computer and Modernization, 2011, 1(11): 55-4.