Implementation of Quality Control Systems Based on Bi-LSTM-CRF #br# Algorithm for Meteorological Warning Information

doi:10.3969/j.issn.1006-2475.2019.06.019

Abstract

Abstract: This paper adopts the bi-directional long short-term memory conditional random field (Bi-LSTM-CRF) algorithm to train the existing legal early-warning information database and the open domain Chinese parsing database through the bi-directional long short-term memory. At the same time, the conditional random field (CRF) model is used to label the word segmentation by effectively combining the label information before and after the warning. The quality control system of meteorological early-warning information based on the above algorithm has already been applied in the emergency warning information issuing system of Anhui Province. In the process of practical application, it has been proved that such system can directly and effectively monitor sensitive keywords and misspellings in the upcoming warning information, so as to help monitoring stuff make better judgments and play an important role in the quality controls of the issued weather warning information.

Key words: Bi-LSTM-CRF, Chinese word segmentation, meteorological warning, information quality control, intelligent monitoring

CLC Number:

TP391

ZHANG Shu-jing1, MIAO Kai-chao1, ZHANG Ya-li1, YANG Bin1, LI Teng2, LIU Yi-xuan1, WANG Xiang1. Implementation of Quality Control Systems Based on Bi-LSTM-CRF #br# Algorithm for Meteorological Warning Information[J]. Computer and Modernization, doi: 10.3969/j.issn.1006-2475.2019.06.019.

References

［1］曹之玉,赵晶晶. 预警质量控制技术研究［J］. 科技成果管理与研究, 2017,131(9):40-43.
［2］孙健,姚秀萍,王丽娟,等. 我国气象预警信息覆盖率的初步分析［J］. 气象科技进展, 2013,3(5):19-23.
［3］百家号. 暴雨天，小心“短时强僵尸”出没［N］．环球时报公号, 2018-08-12.
［4］ KWOK K L. A neural network for probabilistic information retrieval［J］. ACM SIGIR Forum, 1989,23(SI):21-30.
［5］〖JP4〗BAHDANAU D, CHO K, BENGIO Y. Neural Machine Translation by Jointly Learning to Align and Translate［DB/OL］. (2015-05-19)［2019-01-29］. https://arxiv.org/pdf/1409.0473.pdf.
［6］ SANTOS C N D, GATTIT M. Deep convolutional neural networks for sentiment analysis of short texts［C］// Proceedings of the 25th International Conference on Computational Linguistics. 2014:69-78.
［7］ SAGARA T, HAGIWARA M. Natural language neural network and its application to question-answering system［J］. Neurocomputing, 2014,142(1):201-208.
［8］ LAMPLE G, BALLESTEROS M, SUBRAMANIAN S, et al. Neural Architectures for Named Entity Recognition［DB/OL］. (2016-04-07)［2019-01-29］. https://arxiv.org/pdf/1603.01360.pdf.
［9］ CHEN X C, QIU X P, ZHU C X, et al. Long short-term memory neural networks for Chinese word segmentation［C］// Proceedings of 2015 Conference on Empirical Methods in Natural Language Processing. 2015:1197-1206.
［10］YAO Y S, HUANG Z. Bi-directional LSTM recurrent neural network for Chinese word segmentation［C］// Proceedings of 2016 International Conference on Neural Information Processing. 2016:345-353.
［11］MA X Z, HOVY E. End-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRF［DB/OL］. (2015-05-29)［2019-01-29］. https://arxiv.org/pdf/1603.01354.pdf.
［12］胡锡衡. 正向最大匹配法在中文分词技术中的应用［J］. 鞍山师范学院学报, 2008,10(2):42-45.
［13］ZHEN L, LI Y S. Reverse backtracking research of Chinese segmentation based on dictionary of hash structure［C］// Proceedings of 2010 2nd International Conference on Information Technology & Computer Science. 2010:265-267.
［14］王靖. 基于机械切分和标注的中文分词研究［D］. 长沙:湖南大学, 2009.
［15］RABINER L R, JUANG B H. An introduction to hidden Markov models［J］. IEEE ASSP Magazine, 1986,3(1):4-16.
［16］BERGER A L, PIETRA V J D, PIETRA S A D. A maximum entropy approach to natural language processing［J］. Computational Linguistics, 1996,22(1):39-71.
［17］LAFFERTY J, MCCALLUM A, PEREIRA F C N. Conditional random fields: Probabilistic models for segmenting and labeling sequence data［J］. Proceedings of ICML, 2001,3(2):282-289.
［18］DENG L, YU D. Deep learning: Methods and applications［J］. Foundations & Trends in Signal Processing, 2014,7(3):197-387.
［19］GRAVES A. Long Short-term Memory［M］// Supervised Sequence Labeling with Recurrent Neural Networks. Springer, 2012:37-45.
［20］HOCHREITER S, SCHMIDHUBER J. Long short-term memory［J］. Neural Computation, 1997,9(8):1735-1780.
［21］SINGH B, MARKS T K, JONES M, et al. A multi-stream bi-directional recurrent neural network for fine-grained action detection［C］// Proceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition. 2016:1961-1970.
［22］LIN B Y, XU F, LUO Z, et al. Multi-channel Bi-LSTM-CRF model for emerging named entity recognition in social media［C］// Proceedings of the 3rd Workshop on Noisy User-generated Text. 2017:160-165.

[1]	LI Yan-man, WANG Bi-heng, ZHAO Ling-yan. Safety Helmet Detection Based on Lightweight YOLOv5 [J]. Computer and Modernization, 2023, 0(10): 59-64.
[2]	ZHOU Hui, XU Ming-hai, XU Xiao-dong. Chinese Word Segmentation Model Based on Attention-BIGRU-CRF [J]. Computer and Modernization, 2022, 0(08): 7-12.
[3]	MA Long, WANG Wei. Monitoring System for Distributed PV System Based on ZigBee and Android Phone [J]. Computer and Modernization, 2014, 0(4): 152-156.
[4]	FENG Guang;QIAO Dan-dan;CHANG Jing-yi. Research on Subjective Question Automatic Marking Technology  Based on Word Segmentation Matching [J]. Computer and Modernization, 2013, 1(3): 212-214,.
[5]	CAO Qian;ZHAO Jia-bao;YU Qing-rong. Research and Design of Intelligent Monitoring System of Photovoltaic Equipment Based on CAN [J]. Computer and Modernization, 2013, 1(3): 148-151.
[6]	HAN Ying;FENG Jilin;YUAN Jing;WANG Maofa;ZHANG Yanxia; CHEN Fuming;CHEN Xinfang;PAN Zhian. Research on Dictionary Mechanism Based on Binary of Trie Index Trees [J]. Computer and Modernization, 2013, 1(1): 5-7.
[7]	MU Jun-peng;DONG Kui-feng;ZHANG Ming. Research on E-mail Classification Based on Dynamic Characteristics Library [J]. Computer and Modernization, 2012, 203(7): 120-123.
[8]	MU Jun-peng;DONG Kui-feng;ZHANG Ming. Research on E-mail Classification Based on Dynamic Characteristics Library [J]. Computer and Modernization, 2012, 203(7): 120-123.
[9]	YANG Wei-chao;LIU Yang;LI Shu-xia . Design and Implementation of Unified Search Platform Based on Search Engine [J]. Computer and Modernization, 2012, 1(11): 220-222.
[10]	JIANG Wen-zhi;GU Jiao-jiao;HU Wen-xuan;LI Fei. Research on Applications of Conditional Random Fields and Its Improvement [J]. Computer and Modernization, 2011, 1(11): 55-4.
[11]	SUN Dian-zhe;WEI Hai-ping;CHEN Yan. Realization and Evaluation of Paodingjieniu Chinese Segmentation in Nutch [J]. Computer and Modernization, 2010, 1(6): 187-0190.