An Improved Text Clustering Algorithm Based on Latent Semantic Indexing

doi:10.3969/j.issn.1006-2475.2014.07.005

Abstract

Abstract: This paper presents an improved text clustering algorithm based on latent semantic indexing. This algorithm introduces the theory of latent semantic index, improves the traditional SOM algorithm. By using the latent semantic indexing text feature vector representation theory, we mine the semantic structure relationships hidden among the words in text, thereby eliminating the correlation among words, to reduce the feature vector dimension. The limitations of the traditional SOM algorithm are improved to accurately give the number of clustering classes. Experimental results show that the clustering effect of this algorithm is better, and the clustering time is less.

Key words: text clustering, latent semantic index, self-organizing maps

CLC Number:

TP182

HOU Ze-min, JU Xiao. An Improved Text Clustering Algorithm Based on Latent Semantic Indexing[J]. Computer and Modernization, doi: 10.3969/j.issn.1006-2475.2014.07.005.

References 17

[1]	王礼礼. 基于潜在语义索引的文本聚类算法研究[D]. 成都:西南交通大学, 2008.
[2]	罗克刚. 基于自组织映射的文本聚类研究[D]. 哈尔滨:哈尔滨工业大学, 2007.
[3]	郭武斌,周宽久,张世荣. 基于潜在语义索引的SVM文本分类模型[J]. 情报学报, 2009,28(6):827-833.
[4]	廖一星. 一种新的监督潜在语义模型[J]. 计算机工程与应用, 2009,45(33):117-119.
[5]	常利伟. 基于多系统融合的潜在语义分析技术研究[D]. 沈阳:沈阳航空航天大学, 2013.
[6]	吴志媛. 基于潜在语义索引的Web文本挖掘[D]. 无锡:江南大学, 2013.
[7]	刘远超. 基于动态自组织映射模型的文本聚类研究[D]. 哈尔滨:哈尔滨工业大学, 2006.
[8]	刘旭政,张春荣,陈水生. 基于模糊神经网络的拉索耐久性评价模型[J]. 华东交通大学学报, 2010,27(2):8-12.
[9]	刘云峰. 基于潜在语义分析的中文概念检索研究[D]. 武汉:华中科技大学, 2005.
[10]	Alahakoon D, Halgamuge S K, Srinivasan B. Dynamic self-organizing maps with controlled growth for knowledge discovery[J]. IEEE Transactions on Neural Networks, 2000,11(3):601-614.
[11]	Jin Huidong, Shum Wing-Ho, Leung Kwong-Sak, et al. Expanding self-organizing map for data visualization and cluster analysis[J]. Information Sciences, 2004,163(1-3):157-173.
[12]	尹峻松,胡德文,陈爽,等. DSOM: 一种基于NO时空动态扩散机理的新型自组织模型[J]. 中国科学(E辑:信息科学), 2004,34(10):1094-1109.
[13]	Pal S K, Dasgupta B, Mitra P. Rough self-organizing map[J]. Applied Intelligence, 2004,21(3):289-299.
[14]	Hussin M F, Kamel M. Document clustering using hierarchical SOMATR neural network[C]// Proceedings of the 2003 IEEE International Joint Conference on Neural Networks. 2003,3:2238-2242.
[15]	刘远超,王晓龙,刘秉权. 一种改进的k-means文档聚类初值选择算法[J]. 高技术通讯, 2006,16(1):11-15.
[16]	Hearst M A. TextTiling: Segmenting text into multi-paragraph subtopic passages[J]. Computational Linguistics, 1997,23(1):33-64.
[17]	Ayad H, Kamel M. Topic discovery from text using aggregation of different clustering methods[C]// Proceedings of the 15th Conference of the Canadian Society for Computational Studies of Intelligence. 2002:161-175.