Topic Event Extraction Technology Based on LDA Model and AP Clustering Method

doi:10.3969/j.issn.1006-2475.2017.12.015

Abstract

Abstract: At present, the event extraction technology is usually the direct extraction of the event information of the text, ignoring the information structure of text, and the result is susceptible to the distribution of the words in texts. This paper analyzes the hierarchical concept structure of the text, and proposes a method of extracting the topic event information of news based on two-stage clustering and subdividing. This method can extract the hierarchical topic-event information, and reduce the influence of the information of the relevant events by the two-stage extraction of information words. This way optimizes the performance of the extraction. And experiment shows that this method can extract the topic event information of the text effectively.

Key words: topic event extraction, LDA topic model, AP clustering method, hierarchical information, two-stage extraction

CLC Number:

TP391.1

ZHANG Jian-heng, HUANG Wei, HU Guo-chao. Topic Event Extraction Technology Based on LDA Model and AP Clustering Method[J]. Computer and Modernization, 2017, 0(12): 77-81+87.

References

［1］高强，游宏梁. 事件抽取技术研究综述［J］. 情报理论与实践, 2013,36(4):114-117. ［2］Zhou Deyu， Chen Liangyu， He Yulan. A simple Bayesian modelling approach to event extraction from Twitter［C］//Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (ACL). 2014：700-705. ［3］唐浩浩，席耀一，周杰，等. 基于维基知识的微博事件追踪方法［J］. 计算机应用与软件, 2015,32(10):21-25. ［4］陈箫箫，刘波. 微博中的开放域事件抽取［J］. 计算机应用与软件, 2016,33(8):18-22. ［5］吴刚. 基于主题的中文事件抽取技术研究与应用［D］. 苏州：苏州大学, 2009. ［6］韩永峰，许旭阳，李弼程，等. 基于事件抽取的网络新闻多文档自动摘要［J］. 中文信息学报, 2012,26(1):58-66. ［7］邹晓辉，孙静. LDA主题模型［J］. 智能计算机与应用, 2014,4(5):105-106. ［8］张志飞，苗夺谦，高灿. 基于LDA主题模型的短文本分类方法［J］. 计算机应用, 2013,33(6):1587-1590. ［9］胡吉明，陈果. 基于动态LDA主题模型的内容主题挖掘与演化［J］. 图书情报工作, 2014,58(2):138-142. ［10］Soucy P， Mineau G W. Beyond TFIDF weighting for text categorization in the vector space model［J］. International Joint Conference on Artificial Intelligence, 2005,26(2):1130-1135. ［11］Heinrich G. Parameter Estimation for Text Analysis［R］. Fraunhofer IGD, Darmstadt, Germany, 2008. ［12］余艳. 融合KL散度和移地距离的高斯混合模型相似性度量方法［J］. 计算机应用, 2014,34(3):828-832. ［13］Frey B J, Dueck D. Clustering by passing messages between data points［J］. Science, 2007,315(5814):972-976. ［14］Gui Bin, Yang Xiaoping, Zhang Zhongxia, et al. Research on affinity propagation clustering［J］. Journal of Shanxi University(Natural Science Edition), 2014(1). ［15］Kumarshrivastava S， Rana J L， Jain R C. Text document clustering based on phrase similarity using affinity propagation［J］. International Journal of Computer Applications, 2013,61(18):38-44. ［16］倪丽萍,刘小军,马驰宇. 基于LDA模型和AP聚类的主题演化分析［J］. 计算机技术与发展, 2016,26(12):6-11. ［17］孙兴东，李爱平，李树栋. 一种基于聚类的微博关键词提取方法的研究与实现［J］. 信息网络安全, 2014(12):27-31. ［18］Mihalcea R， Tarau P. TextRank: Bringing order into texts［C］//Proceedings of the 2004 Conference on Empirical Methods in Natural Language Processing. 2004:404-411.

[1]	QI Jun1, 2, QU Ruiting2, JIAO Chuanming2, ZHOU Qiaoni2, GUO Yanliang3, TAN Wenjun3. Enhanced Big Language Model Dual Carbon Domain Services Based on Knowledge Graph [J]. Computer and Modernization, 2024, 0(09): 8-14.
[2]	ZHAO Dun1, SHE Xuebing2, WU Changxing3. Named Entity Recognition in Field of Party Building Based on BERT-BiLSTM-CRF [J]. Computer and Modernization, 2024, 0(09): 91-94.
[3]	CHEN Xuesong1, LI Heng1, WANG Haochang2. Short Text Classification Combining Attention Mechanism and Mengzi Model [J]. Computer and Modernization, 2024, 0(09): 101-106.
[4]	ZHANG Ke1, AI Zhongliang2, LIU Zhonglin3, GU Pingli1, LIU Xuelin4. Judicial Argumentation Understanding Method Based on Multiplet Loss [J]. Computer and Modernization, 2024, 0(06): 115-120.
[5]	CUI Shao-guo, HU Guang-ping. Nested Named Entity Recognition Based on Semantic Segmentation [J]. Computer and Modernization, 2024, 0(02): 69-74.
[6]	ZHENG Li-rui, XIAO Xiao-xia, ZOU Bei-ji, LIU Bin, ZHOU Zhan. Named Entity Recognition in Electronic Medical Record Based on BERT [J]. Computer and Modernization, 2024, 0(01): 87-91.
[7]	XU Hong-kui, LI Zhen-ye, GUO Wen-tao, ZHAO Jing-zheng, GUO Xu-bin. Real-time Detection of Arbitrary Shape Scene Text Based on Segmentation [J]. Computer and Modernization, 2023, 0(11): 95-100.
[8]	CUI Shao-guo, ZHANG Gang, WANG Ao-di. Deep Cross Network Recommendation Model Based on Attention Perception [J]. Computer and Modernization, 2023, 0(07): 54-60.
[9]	JIA Jian-zhong. Handwritten Signature Identification Based on Wavelet Transform and CPN Network [J]. Computer and Modernization, 2020, 0(07): 27-31.
[10]	WU Di， AI Zhong-liang， LIU Zhong-lin， LI Chang-bao . Knowledge Portrait Model for Research Project Documents [J]. Computer and Modernization, 2020, 0(02): 60-.
[11]	XIANG Wei. Reviews on Event Knowledge Graph Construction Techniques and Application [J]. Computer and Modernization, 2020, 0(01): 10-.
[12]	YUE Yi-feng, HUANG Wei, REN Xiang-hui. An Automatic Text Summarization Model Construction Method Based on BERT Embedding [J]. Computer and Modernization, 2020, 0(01): 63-.
[13]	LI Pan1, LI Yi-guang2, XU Chun1. Hot Network Information Extraction Based on Key Nodes [J]. Computer and Modernization, 2019, 0(09): 60-.
[14]	ZHANG Hao1,2, ZHONG Min1,2. Chinese Short Text Classification Based on Sentence-LDA Topic Model [J]. Computer and Modernization, 2019, 0(03): 102-.
[15]	FENG Jun, LIU Jing-hua, KONG Sheng-qiu. Chinese Collective Entity Linking Method Based on Multiple Features [J]. Computer and Modernization, 2019, 0(01): 69-.