关键词: 聚类算法, 垃圾邮件, 分词处理, 文本聚类

Abstract: For spam recognition methods used in the past, in the face of today’s fast updating and a wide variety of word segmentation, it is difficult to accurately identify the key word segmentation in a e-mail, the application ability of the recognition methods needs to be further improved. To this end, a spam recognition method based on cluster analysis algorithm is proposed. Firstly, we preprocess e-mail samples to get the key word segmentation of the e-mail text content, remove the stop words, and calculate the weight of the word segmentation according to the frequency of the word segmentation in the e-mail text. Then, combining with the e-mail feature attributes, we construct the e-mail feature space, and quantify the e-mail feature. Lastly, the features of the e-mail are extracted and processed for dimensionality reduction, which is used as the input of the clustering algorithm, and the output result is iteratively calculated to complete the identification of spam. The experimental results show that the designed spam e-mail recognition method based on cluster analysis algorithm is more accurate in keyword extraction and word segmentation, and can accurately identify spam e-mails, which shows the practical application ability of the designed spam e-mail recognition method based on cluster analysis algorithm has been improved.

Key words: clustering algorithm, spam, word segmentation, text clustering