Chinese Text Classification Based on fastText

doi:10.3969/j.issn.1006-2475.2018.05.008

Abstract

Abstract: A goal of text classification is to shorten the classification time under the premise of ensuring the accuracy of classification. In order to solve the problem that the current text classification process is complex and time-consuming, fastText, a library for efficient learning of word representations and sentence classification proposed by Facebook is applied to Chinese text classification field to test its effect. Compared with the mainstream text classification method, fastText can guarantee the classification accuracy and greatly shorten the classification time. At the same time, this paper further studies and analyzes the classification accuracy and parameters and gets some optimization rules.

Key words: text classification, fastText, linear classifier, fast text classification model

CLC Number:

TP391

DAI Ling-ling, JIANG Kan. Chinese Text Classification Based on fastText[J]. Computer and Modernization, doi: 10.3969/j.issn.1006-2475.2018.05.008.

References

［1］夏从零,钱涛,姬东鸿,等. 基于事件卷积特征的新闻文本分类［J］. 计算机应用研究, 2017(4):991-994.
［2］石文娟,龙舜,云飞. 基于背景学习的迭代式文本分类框架［J］. 计算机工程与应用, 2015,51(9):129-134.
［3］ Debole F, Sebastiani F. Supervised term weighting for automated text categorization［M］// Text Mining and Its Applications. Springer Berlin Heidelberg, 2004:81-97.
［4］ Sebastiani F. Machine learning in automated text categorization［J］. ACM Computing Surveys (CSUR), 2002,34(1):1-47.
［5］唐明,朱磊,邹显春. 基于Word2Vec的一种文档向量表示［J］. 计算机科学,2016, 43(6):214-217.
［6］闫琰. 基于深度学习的文本表示与分类方法研究［D］. 北京：北京科技大学, 2016.
［7］ Mikolov T, Chen K, Corrado G, et al. Efficient estimation of word representations in vector space［J］. Computer Science, 2013: arXiv:1301.3781.
［8］ Mitchell J, Lapata M. Composition in distributional models of semantics［J］. Cognitive Science, 2010,34(8):1388-1429.
［9］ Zanzotto F M, Korkontzelos I, Fallucchi F, et al. Estimating linear models for compositional distributional semantics［C］// Proceedings of International Conference on Computational Linguistics. 2010:1263-1271.
［10］〖ZK（#〗Yessenalina A, Cardie C. Compositional matrix-space models for sentiment analysis［C］// Conference on Empirical Methods in Natural Language Processing. 2011:172-182.
［11］Le Q, Mikolov T. Distributed representations of sentences and documents［C］// Proceedings of the 31st International Conference on Machine Learning. 2014:1188-1196.
［12］ Wang S, Manning C D. Baselines and bigrams: Simple, good sentiment and topic classification［C］// Meeting of the Association for Computational Linguistics. 2012:90-94. 
［13］Agarwal A, Chapelle O, Dudik M, et al. A reliable effective terascale linear learning system［J］. Journal of Machine Learning Research, 2011,15(1):1111-1133.
［14］Joulin A, Grave E, Bojanowski P, et al. Bag of tricks for efficient text classification［J］. Computer Science, 2016: arXiv:1607.01759.
［15］Bojanowski P, Grave E, Joulin A, et al. Enriching word vectors with subword information［J］. Computer Science, 2016:arXiv:1607.04606.
［16］孙茂松,李景阳,郭志芃,等. THUCTC:一个高效的中文文本分类工具包［DB/OL］. http://thuctc.thunlp.org, 2016-01-25.
［17］杨宇婷,王名扬,田宪允,等. 基于文档分布式表达的新浪微博情感分类研究［J］. 情报杂志, 2016,35(2):151-156.
［18］吕超镇,姬东鸿,吴飞飞. 基于LDA特征扩展的短文本分类［J］. 计算机工程与应用, 2015,51(4):123-127.
［19］Zolotov V, Kung D. Analysis and optimization of fastText linear text classifier［J］. Computer Science, 2017:arXiv:1702.05531.

[1]	XU Ya-xin, HE Ze-en, XU Xu-kan. Automatic Classification Method of CNC Machine Tool Fault Text Based on CNN-BiLSTM [J]. Computer and Modernization, 2023, 0(04): 7-14.
[2]	ZHNAG Jun, QIU Long-long. A Text Classification Model Based on BERT and Pooling Operation [J]. Computer and Modernization, 2022, 0(06): 1-7.
[3]	GUO Shu-wu, CHEN Jun-hua. Textbook Classification Method of Index of Moral Education Based on Deep Learning [J]. Computer and Modernization, 2021, 0(09): 106-112.
[4]	JIA Peng-tao, SUN Wei. A Survey of Text Classification Based on Deep Learning [J]. Computer and Modernization, 2021, 0(07): 29-37.
[5]	DAI Ji-peng, SHAO Feng-jing, SUN Ren-cheng. Short Text Classification Based on Improved CHI and TF-IDF [J]. Computer and Modernization, 2021, 0(06): 6-11.
[6]	Nigara Masimjan, Azragul Yusuf. Analysis of Emotional Tendency of MOOC User Comments Based on BERT and Bidirectional GRU Model#br# [J]. Computer and Modernization, 2021, 0(04): 20-26.
[7]	ZHOU Ling, ZHANG Ying-jun, PAN Li-hu. A Short Text Classification Method Based on Emotional Features [J]. Computer and Modernization, 2020, 0(07): 80-84.
[8]	JING Dong-sheng, XUE Jing-song, FENG Ren-jun. Spam Text Classification Method Based on Deep Q-network [J]. Computer and Modernization, 2020, 0(06): 89-.
[9]	PENG Lu1, ZHU Jun2, ZOU Yun-feng2. Prediction of Power Customer Demands Based on Deep Neural Network [J]. Computer and Modernization, 2020, 0(05): 22-.
[10]	NIU Xue-ying. CNN Text Classification Based on Topic Model Word Vectors [J]. Computer and Modernization, 2019, 0(10): 7-.
[11]	MA Jian-hong， LIU Guang-sen， YAO Shuang， YANG Zhi . Text Feature Selection and Text Representation for Short Essays [J]. Computer and Modernization, 2019, 0(03): 95-.
[12]	ZHANG Hao1,2, ZHONG Min1,2. Chinese Short Text Classification Based on Sentence-LDA Topic Model [J]. Computer and Modernization, 2019, 0(03): 102-.
[13]	LI Peng-peng， FAN Hui-min. Research on Improvement of Feature Weights in Text Classification [J]. Computer and Modernization, 2018, 0(02): 66-.
[14]	YANG Dong, WANG Yi-zhi. An Attention-based C-GRU Neural Network for Text Classification [J]. Computer and Modernization, 2018, 0(02): 96-.
[15]	GUO Dong-liang, LIU Xiao-ming, ZHENG Qiu-sheng. Internet Short-text Classification Method Based on CNNs [J]. Computer and Modernization, 2017, 0(4): 78-81.