Application Study of Automatic Text Classification Combined with Language Model

doi:10.3969/j.issn.1006-2475.2010.03.040

Computer and Modernization ›› 2010, Vol. 1 ›› Issue (3): 141-3.doi: 10.3969/j.issn.1006-2475.2010.03.040

• 中文信息技术 • Previous Articles Next Articles

Application Study of Automatic Text Classification Combined with Language Model

ZHAO Min-ya

Department of Computer Engineering, Suzhou Vocation University, Suzhou 215104, China

Received:2009-02-19 Revised:1900-01-01 Online:2010-03-20 Published:2010-03-20

Abstract

Abstract:

This paper studies the application of bigram model from statistical language model in the automatic text classification. Referring to the shortcoming of the hypothesis that the terms are independent from each other in VSM (Vector Space Model), it puts forward a method to improve the result of text classification with mutual words’ information and sequence. The experiment shows that the method is feasible and efficient.

Key words: statistical language model, text classification, smoothing, bigram

ZHAO Min-ya. Application Study of Automatic Text Classification Combined with Language Model[J]. Computer and Modernization, 2010, 1(3): 141-3.

[1]	ZHOU Xianxi, MU Li. News Long Text Classification Model Based on Improved TF-IDF and AGLCNN [J]. Computer and Modernization, 2024, 0(08): 120-126.
[2]	ZHANG Ke1, AI Zhongliang2, LIU Zhonglin3, GU Pingli1, LIU Xuelin4. Judicial Argumentation Understanding Method Based on Multiplet Loss [J]. Computer and Modernization, 2024, 0(06): 115-120.
[3]	XU Ya-xin, HE Ze-en, XU Xu-kan. Automatic Classification Method of CNC Machine Tool Fault Text Based on CNN-BiLSTM [J]. Computer and Modernization, 2023, 0(04): 7-14.
[4]	DU Chuan-sheng, GAO Huan-bing, HOU Yu-xiang, WANG Zi-jian. Path Planning of Fire Robot Based on Improved Bidirectional A* Algorithm [J]. Computer and Modernization, 2023, 0(04): 15-19.
[5]	ZHNAG Jun, QIU Long-long. A Text Classification Model Based on BERT and Pooling Operation [J]. Computer and Modernization, 2022, 0(06): 1-7.
[6]	GUO Shu-wu, CHEN Jun-hua. Textbook Classification Method of Index of Moral Education Based on Deep Learning [J]. Computer and Modernization, 2021, 0(09): 106-112.
[7]	JIA Peng-tao, SUN Wei. A Survey of Text Classification Based on Deep Learning [J]. Computer and Modernization, 2021, 0(07): 29-37.
[8]	DAI Ji-peng, SHAO Feng-jing, SUN Ren-cheng. Short Text Classification Based on Improved CHI and TF-IDF [J]. Computer and Modernization, 2021, 0(06): 6-11.
[9]	Nigara Masimjan, Azragul Yusuf. Analysis of Emotional Tendency of MOOC User Comments Based on BERT and Bidirectional GRU Model#br# [J]. Computer and Modernization, 2021, 0(04): 20-26.
[10]	GU Guo-qing, LI Xiao-hui. Exponential Weighted Smoothing Prediction Model Based on Abnormal Detection of Box-plot [J]. Computer and Modernization, 2021, 0(01): 28-33.
[11]	ZHOU Ling, ZHANG Ying-jun, PAN Li-hu. A Short Text Classification Method Based on Emotional Features [J]. Computer and Modernization, 2020, 0(07): 80-84.
[12]	JING Dong-sheng, XUE Jing-song, FENG Ren-jun. Spam Text Classification Method Based on Deep Q-network [J]. Computer and Modernization, 2020, 0(06): 89-.
[13]	PENG Lu1, ZHU Jun2, ZOU Yun-feng2. Prediction of Power Customer Demands Based on Deep Neural Network [J]. Computer and Modernization, 2020, 0(05): 22-.
[14]	WANG Yu-fei1, DU Tian-cang1,2 . Analysis and Application of Time Series Prediction Based on #br# Holt-Winters in Big Data Monitoring System [J]. Computer and Modernization, 2019, 0(11): 29-.
[15]	NIU Xue-ying. CNN Text Classification Based on Topic Model Word Vectors [J]. Computer and Modernization, 2019, 0(10): 7-.

Application Study of Automatic Text Classification Combined with Language Model

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics

Comments