关键词: 支持向量机, 文本分类, 半监督学习, 特征选择

Abstract: This paper proposes an effective short text classification method based on support vector machine for short texts with sparse features, non-standard features and unclear topics. Due to the low accuracy and time efficiency of Chinese dependency grammar analysis, in view of the characteristics of client text consultation, this paper did not analyze the dependency grammar of sentences, but mainly uses syntactic features for analysis. Two syntactic features of substrings and subsequences of sentences are find out. Then three feature measure methods such as information gain, mutual information and chi-square statistics are used to realize feature selection effectively. Finally support vector machine method is used to classify text. The model proposed in this paper is applied into a set of real data, and the experimental results show that the average accuracy could reach 84.19%, thus verifying the robustness and effectiveness of the classification method.

Key words: support vector machine, text categorization, semi-supervised, feature selection