关键词: Word2vec, LDA, 文本分类, 卷积神经网络

Abstract: Mining information in Weibo text is of great significance to automatic question and answer, public opinion analysis and other applied research. The text classification study is the basis of text mining. This paper proposes to input simultaneously the text representations of Word2vec and LDA(Latent Dirichlet Allocation) into convolutional neural network model for high-level semantic feature abstraction and classification learning. The input word vectors can represent both the semantic information between the words and the theme of the text. First, We get the word vectors respectively based on the Word2vec model and LDA. Then the word vectors generated by the two models are cascaded to obtain their text matrix representations. Finally, We put the text matrices into the convolutional neural network simultaneously as two channels to classify the texts, and the effectiveness of the method is verified by experiments on Weibo data.

Key words: Word2Vec, LDA, text classification, convolutional neural network