基于图核算法的文本分类

doi:10.3969/j.issn.1006-2475.2017.11.003

计算机与现代化

基于图核算法的文本分类

(北京工业大学信息学部，北京 100124)

收稿日期:2016-11-24 出版日期:2017-11-21 发布日期:2017-11-21
作者简介:蒋强荣(1964-)，女，北京人，北京工业大学信息学部副教授，博士研究生，研究方向：模式识别，机器学习; 通信作者：宋烈金(1989-)，男，河南周口人，硕士研究生，研究方向：自然语言处理。

Text Categorization Based on Graph Kernel

(Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China)

Received:2016-11-24 Online:2017-11-21 Published:2017-11-21

摘要/Abstract

摘要： 在文本分类研究中，向量空间模型具有表示形式简单的特点，但只能表示特征词的词频信息而忽视了特征词间的结构信息和语义语序信息，所以可能导致不同文档被表示为相同向量。针对这种问题，本文采用图结构模型表示文本，把文本表示成一个有向图（简称文本图），可有效解决结构化信息缺失的问题。本文将图核技术应用于文本分类，提出适用于文本图之间的相似度计算的图核算法——间隔通路核，然后利用支持向量机对文本进行分类。在文本集上的实验结果表明：与向量空间模型相比，间隔通路核相比于其他核函数的分类准确率更高，所以间隔通路核是一种很好的图结构相似性计算算法，能广泛应用于文本分类中。

关键词: 图结构, 向量空间模型, 间隔通路核, 支持向量机, 文本分类

Abstract: In text classification, vector space model has the characteristic of simple representation, but only represents frequency information of feature word and ignores the structural information and semantic information of word order between words, which may lead to different documents to be represented as vectors of the same. In view of this problem, this paper uses the graph structure model to represent text, and a text is represented as a directed graph (abbreviated as text graph), which effectively solves the problem of the lack of structured information. In this paper, the graph kernel technique is applied to text classification, and a graph kernel algorithm, which is suitable for the computation of the similarity between text graphs, is proposed. Then support vector machine is used to classify the texts. The experimental results on the text set show that compared with the vector space model, the classification accuracy of interval walk kernel is better than other kernel functions, so it is a good graph structure similarity calculation algorithm and it can be widely used in text classification.

Key words: graph structure, vector space model, gap walk kernel, support vector machine, text categorization

中图分类号:

TP391

蒋强荣，宋烈金. 基于图核算法的文本分类[J]. 计算机与现代化, doi: 10.3969/j.issn.1006-2475.2017.11.003.

JIANG Qiang-rong, SONG Lie-jin. Text Categorization Based on Graph Kernel[J]. Computer and Modernization, doi: 10.3969/j.issn.1006-2475.2017.11.003.

参考文献

[1] Feng Guozhong, Guo Jianhua, Jing Bingyi, et al. Feature subset selection using naive Bayes for text classification[J]. Pattern Recognition Letters, 2015,65:109-115.

[2] Wajeed M A, Adilakshmi T. Different similarity measures for text classification using KNN[C]// Proceedings of the 2nd International Conference on Computer and Communication Technology. 2011:41-45.

[3] Haddoud M, Mokhtari A, Lecroq T, et al. Combining supervised term-weighting metrics for SVM text classification with extended term representation[J]. Knowledge and Information Systems, 2016,49(3):909-931.

[4] Salton G. The SMART Retrieval System: Experiments in Automatic Document Processing[M]. Prentice-Hall, 1971.

[5] Gee K R, Cook D J. Text classification using graph-encoded linguistic elements[C]// Proceedings of the 18th International Florida Artificial Intelligence Research Society Conference. 2005:487-492.

[6] 周昭涛,卜东波,程学旗. 文本的图表示初探[J]. 中文信息学报, 2005,19(2):36-43.

[7] Schenker A, Last M, Bunke H, et al. Classification of Web documents using a graph model[C]// Proceedings of the 7th International Conference on Document Analysis and Recognition. 2003,1:240-244.

[8] Kondor R I, Lafferty J D. Diffusion kernels on graphs and other discrete input spaces[C]// Proceedings of the 19th International Conference on Machine Learning. 2002:315-322.

[9] 王立鹏,费飞,接标,等. 基于子图选择和图核降维的脑网络分类方法[J]. 计算机科学与探索, 2014,8(10):1246-1253.

[10] Zhao Ruiqi, Martinez A M. Labeled graph kernel for behavior analysis[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2016,38(8):1640-1650.

[11] Yang Yiming, Pedersen J O. A comparative study on feature selection in text categorization[C]// Proceedings of the 14th International Conference on Machine Learning. 1997:412-420.

[12] 吴金源,冀俊忠,赵学武,等. 基于特征选择技术的情感词权重计算[J]. 北京工业大学学报, 2016,42(1):142-151.

[13] Quinlan J R. C4.5: Programs for Machine Learning[M]. Morgan Kaufmann Publishers, 1993.

[14] Mladenic D, Grobelnik M. Feature selection for unbalanced class distribution and naive Bayes[C]// Proceedings of the 16th International Conference on Machine Learning. 1999:258-267.

[15] 梅玲,张亚丽. 结构化数据核函数综述[J]. 计算机工程, 2010,36(23):199-201.

[16] Gärtner T. A survey of kernels for structured data[J]. ACM SIGKDD Explorations Newsletter, 2003,5(1):49-58.

[17] Gärtner T, Flach P, Wrobel S. On graph kernels: Hardness results and efficient alternatives[C]// Proceedings of the 16th Annual Conference on Computational Learning Theory and 7th Kernel Workshop. 2003:129-143.

基于图核算法的文本分类

Text Categorization Based on Graph Kernel

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

本文评价

[1]	杨博, 庄毅. 基于AOA-MSVM的控制集群故障检测方法[J]. 计算机与现代化, 2023, 0(12): 112-116.
[2]	杨孙哲, 孙爱珍. 基于HSV颜色与LBP纹理特征的水稻氮素营养诊断[J]. 计算机与现代化, 2023, 0(07): 86-92.
[3]	申志, 李元 . 基于KPCA和SSA优化SVM的非线性过程故障检测#br#[J]. 计算机与现代化, 2023, 0(06): 15-20.
[4]	尹建丰, 卫鑫, 顾雄伟, 黄凯, 魏敏捷. 基于图像阈值优化及改进SVM的电表数字识别[J]. 计算机与现代化, 2023, 0(05): 106-110.
[5]	徐涯昕, 何泽恩, 徐绪堪. 基于CNN-BiLSTM网络的数控机床故障文本自动分类[J]. 计算机与现代化, 2023, 0(04): 7-14.
[6]	张军, 邱龙龙. 一种基于BERT和池化操作的文本分类模型[J]. 计算机与现代化, 2022, 0(06): 1-7.
[7]	赵延平, 王芳, 夏杨. 基于支持向量机的短文本分类方法[J]. 计算机与现代化, 2022, 0(02): 92-96.
[8]	赵聪慧, 冯庆胜. 基于DT-CWT和SVM的踏面旋转不变纹理提取算法[J]. 计算机与现代化, 2021, 0(12): 85-90.
[9]	郭书武, 陈军华. 基于深度学习的教材德目分类方法[J]. 计算机与现代化, 2021, 0(09): 106-112.
[10]	贾澎涛, 孙炜. 基于深度学习的文本分类综述[J]. 计算机与现代化, 2021, 0(07): 29-37.
[11]	代继鹏, 邵峰晶, 孙仁诚. 基于改进CHI和TF-IDF的短文本分类的研究[J]. 计算机与现代化, 2021, 0(06): 6-11.
[12]	陈翔, 邹庆年, 谢绍宇, 陈翠琼. 基于迁移学习策略的压板开关状态识别[J]. 计算机与现代化, 2021, 0(05): 120-126.
[13]	尼格拉木·买斯木江, 艾孜尔古丽·玉素甫. 基于BERT及双向GRU模型的慕课用户评论情感倾向性分析[J]. 计算机与现代化, 2021, 0(04): 20-26.
[14]	王文蔚, 肖军弼, 程鹏, 张悦. 基于SDN的DDoS攻击防御系统[J]. 计算机与现代化, 2021, 0(02): 117-121.
[15]	周灵, 张英俊, 潘理虎. 一种基于情感特征的短文本分类方法[J]. 计算机与现代化, 2020, 0(07): 80-84.