An Improved Feature Selection Algorithm Based on Category Distinguished Words

doi:10.3969/j.issn.1006-2475.2019.03.014

Abstract

Abstract: The traditional category distinguished words(CDW) feature selection algorithm, which takes inter-class dispersion degree and intra-class importance degree as comprehensive metrics, ignores the fact that contribution weights of the two indicators to feature scoring function are often different, and thus affects feature selection efficiency to some extent. A CDW feature selection algorithm combining with balance factor(ICDW) is proposed. During feature selection, the contribution weights of two indicators to feature scoring function are adjusted by continuously adjusting the value of the balance factor to complete more efficient feature selection. Using Nave Bayes classification algorithm for text categorization, experiments show that classification performance of ICDW algorithm not only outperforms that of CDW algorithm, but also exceeds that of ECE, IG and CHI, which are commonly used for feature selection.

Key words: text categorization, feature selection, balance factor, category distinguished words

CLC Number:

TP391

LI Fu-xing，MENG Zu-qiang . An Improved Feature Selection Algorithm Based on Category Distinguished Words[J]. Computer and Modernization, doi: 10.3969/j.issn.1006-2475.2019.03.014.

References

［1］周茜,赵明生,扈旻. 中文文本分类中的特征选择研究［J］. 中文信息学报, 2004,18(3):17-23.
［2］ WU G, XU J. Optimized approach of feature selection based on information gain［J］. Computer Engineering & Applications, 2011,47(12):157-161.
［3］刘海峰,刘守生,宋阿羚. 基于词频分布信息的优化IG特征选择方法［J］. 计算机工程与应用, 2017,53(4):113-117.
［4］郭亚维, 刘晓霞. 文本分类中信息增益特征选择方法的研究［J］. 计算机工程与应用, 2012, 48(27):119-122.
［5］ LI Y H. Text feature selection algorithm based on CHI-square rank correlation factorization［J］. Journal of Interdisciplinary Mathematics, 2017,20(1):153-160.
［6］ CAI Z, WANG J, LIU J. Novel feature selection algorithm for Chinese text categorization based on CHI［C］// IEEE International Conference on Signal Processing. IEEE, 2017:1035-1039.
［7］吴金源, 冀俊忠, 赵学武,等. 基于特征选择技术的情感词权重计算［J］. 北京工业大学学报, 2016, 42(1):142-151.
［8］ WANG H. Study on the application of feature selection for big text data using expected cross entropy［J］. Journal of Information & Computational Science, 2015,12(18):6835-6843.
［9］单丽莉, 刘秉权, 孙承杰. 文本分类中特征选择方法的比较与改进［J］. 哈尔滨工业大学学报, 2011(S1):319-324.
［10］周奇年,张振浩,徐登彩. 用于中文文本分类的基于类别区分词的特征选择方法［J］. 计算机应用与软件, 2013,30(3):193-195.
［11］李铂鑫. 文本分类中基于综合度量特征选择算法的研究［D］. 武汉：华中科技大学, 2015.
［12］阿不都萨拉木·达吾提, 于斯音·于苏普, 艾斯卡尔·艾木都拉. 类别区分词与情感词典相结合的维吾尔文句子情感分类［J］. 清华大学学报(自然科学版), 2017(2):197-201.
［13］YANG Y, PEDERSEN J O. A comparative study on feature selection in text categorization［C］// The 14th International Conference on Machine Learning. Morgan Kaufmann Publishers Inc., 1997:412-420.
［14］GAO Z, XU Y, MENG F, et al. Improved information gain-based feature selection for text categorization［C］// IEEE International Conference on Wireless Communications, Vehicular Technology, Information Theory and Aerospace & Electronic Systems. 2014:1-5.
［15］范小丽,刘晓霞. 文本分类中互信息特征选择方法的研究［J］. 计算机工程与应用, 2010,46(34):123-125.
［16］LIU Y, CHEN F, KONG W, et al. Identifying Web spam with the wisdom of the crowds［J］. ACM Transactions on the Web, 2012,6(1):1-30.
［17］DEBOLE F , SEBASTIANI F . An analysis of the relative hardness of Reuters-21578 subsets［J］. Journal of the American Society for Information Science and Technology, 2014,56(6):584-596.
［18］TONG S, KOLLER. Support vector machine active learning with application to text classification［J］. Machine Learning Research, 2002,2(1):999-1006.
［19］TANG B, HE H, BAGGENSTOSS P M, et al. A Bayesian classification approach using class-specific features for text categorization［J］. IEEE Transactions on Knowledge & Data Engineering, 2016,28(6):1602-1606.
［20］TANG B, KAY S, HE H. Toward Optimal Feature Selection in Naive Bayes for Text Categorization［M］. IEEE Educational Activities Department, 2016.
［21］江小平, 李成华, 向文,等. 云计算环境下朴素贝叶斯文本分类算法的实现［J］. 计算机应用, 2011, 31(9):2551-2554.
［22］周志华. 机器学习［M］. 北京：清华大学出版社, 2016:30-32.
［23］MA L, LU Z, SHANG L, et al. Multimodal convolutional neural networks for matching image and sentence［C］// IEEE International Conference on Computer Vision. IEEE Computer Society, 2015:2623-2631.

[1]	WANG Yang, CHEN Mei, LI Hui. FOCoR: A Course Recommendation Approach Based on Feature Selection Optimization [J]. Computer and Modernization, 2022, 0(10): 1-7.
[2]	ZHAO Ying-li, ZHU Xu. Association Analysis of Image Genetic Data Based on Group Sparse Joint Leraning [J]. Computer and Modernization, 2022, 0(08): 43-49.
[3]	MO Yun. EEG Decoding Method Based on Hybrid Feature Selection [J]. Computer and Modernization, 2022, 0(04): 92-96.
[4]	ZHAO Yan-ping, WANG Fang, XIA Yang. Short Text Classification Method Based on Support Vector Machine [J]. Computer and Modernization, 2022, 0(02): 92-96.
[5]	ZHANG Dong-fang, CHEN Hai-yan, YUAN Li-gang. S2R2: Semi-supervised Feature Selection Based on Analysis of Relevance and Redundancy [J]. Computer and Modernization, 2021, 0(09): 113-120.
[6]	DAI Ji-peng, SHAO Feng-jing, SUN Ren-cheng. Short Text Classification Based on Improved CHI and TF-IDF [J]. Computer and Modernization, 2021, 0(06): 6-11.
[7]	CHEN Si-yu, ZHUANG Yi, LI Jing. Multi Feature Load Forecasting Model for LSTM Network in Mobile Cloud Computing [J]. Computer and Modernization, 2021, 0(06): 74-85.
[8]	YANG Qiu-liang, WANG Yu, YANG Xing-li, LI Ji-hong. Classification of Ground-based Meteorological Cloud Images Based on Feature Selection Technique of Mutual Information F-statistics [J]. Computer and Modernization, 2021, 0(02): 18-23.
[9]	JIANG Wan-ming1,2, GUO Chun1,2, JIANG Chao-hui1,2. A Low-rate DDoS Attack Detection Method Based on BiLSTM [J]. Computer and Modernization, 2020, 0(05): 120-.
[10]	YAN Yi, LI Bo, CHEN Shou-ming, LIN Qiang, HUANG Ju-tao, Wen Bo-jian. A Causal Feature Selection Algorithm for Feedback Networks and Its Applications [J]. Computer and Modernization, 2019, 0(12): 95-.
[11]	MA Jian-hong， LIU Guang-sen， YAO Shuang， YANG Zhi . Text Feature Selection and Text Representation for Short Essays [J]. Computer and Modernization, 2019, 0(03): 95-.
[12]	WANG Wei1,2. Intelligent Text Classification Method Based on VAE-DBN Dual-Model [J]. Computer and Modernization, 2018, 0(12): 77-.
[13]	LIU Wei, YANG Hui-jie, LIU Shou-yin. A Feature Selection Algorithm of Battery SOH Based on ACCA-FCM and SVM-RFE [J]. Computer and Modernization, 2018, 0(01): 11-18.
[14]	HAN Jing-dan, SUN Lei, WANG Shuai-li, WANG Ze-wu. Android Malware Application Detection Method Based on BPSO-NB [J]. Computer and Modernization, 2017, 0(4): 109-113.
[15]	WU Ke-yan, ZHANG Shu-ya, HUANG Yan-zi, LIU Shou-yin. Feature Set Optimization Algorithm of Fall Detection Based on Neighborhood Consistency and DBPSO [J]. Computer and Modernization, 2017, 0(11): 6-12.