一种基于文本卷积神经网络的推荐算法

摘要/Abstract

摘要： 传统的矩阵因子分解模型不能有效提取用户和物品特征，而基于深度学习模型可以很好地提取特征信息。当前，主流的基于深度学习推荐算法只是单一地将神经网络的输出或物品特征与用户特征乘积的形式来做推荐预测，不能充分挖掘用户和物品之间的关系。基于此，本文提出一种基于文本卷积神经网络与带偏置项的奇异值分解(BiasSVD)结合的推荐算法，利用文本卷积神经网络(TextCNN)来充分提取用户和物品的特征信息，然后用奇异值分解方法来做推荐，深层次理解文档上下文信息，进一步提高推荐的准确性。将该算法在MovieLens的2个真实数据集上做广泛的评估分析，推荐的准确度要明显优于ConvMF算法及主流深度学习推荐算法。

关键词: 矩阵分解, 奇异值分解, 深度学习, 文本卷积神经网络

Abstract: The traditional matrix factorization model can not effectively extract the features of users and items, while the deep learning model can extract the feature information well. At present, the mainstream recommendation algorithm based on deep learning only uses the output of neural network or the product of item features and user features to make recommendation prediction, which can not fully mine the relationship between users and items. Based on this, this paper proposes a recommendation algorithm based on the combination of text convolutional neural network and bias singular value decomposition (BiasSVD). Text convolutional neural network (TextCNN) is used to fully extract the feature information of users and items, and then singular value decomposition method is used to make recommendations, which can deeply understand the document context information and further improve the accuracy of recommendation. After extensive evaluation and analysis on two real datasets of MovieLens, the recommendation accuracy of this algorithm is obviously better than that of ConvMF algorithm and mainstream deep learning recommendation algorithm.

Key words: matrix decomposition, singular value decomposition, deep learning, text convolutional neural network

杨辉, 王月海, 豆震泽. 一种基于文本卷积神经网络的推荐算法[J]. 计算机与现代化, 2020, 0(10): 7-11.

YANG Hui, WANG Yue-hai, DOU Zhen-ze. A Recommendation Algorithm Based on Text Convolutional Neural Network[J]. Computer and Modernization, 2020, 0(10): 7-11.

参考文献

［1］陶雪娇,胡晓峰,刘洋. 大数据研究综述［J］. 系统仿真学报, 2013,25(S1):142-146.
［2］ YU S, YANG M, QU Q, et al. Contextual-boosted deep neural collaborative filtering model for interpretable recommendation［J］. Expert Systems with Applications, 2019,136:365-375.
［3］ KOREN Y. Collaborative filtering with temporal dynamics［J］. Communications of the ACM, 2010,53(4):89-97.
［4］ KOREN Y, BELL R, VOLINSKY C. Matrix factorization techniques for recommender systems［J］. Computer, 2009,42(8):30-37.
［5］〖JP+2〗MIKOLOV T, CHEN K, CORRADO G, et al. Efficient estimation of word representations in vector space［C］// Proceedings of the 1st International Conference on Learning Representations. 2013.
［6］ PENNINGTON J, SOCHER R, MANNING C D. GloVe: Global vectors for word representation［C］// Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing. 2014:1532-1543.
［7］ HE K M, ZHANG X Y, REN S Q, et al. Deep residual learning for image recognition［C］// Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition. 2016:770-778.
［8］ SAINATH T N, KINGSBURY B, MOHAMED A-R, et al. Improvements to deep convolutional neural networks for LVCSR［C］// Proceedings of the 2013 IEEE Workshop on Automatic Speech Recognition and Understanding. 2013:315-320.

［9］ HE X N, LIAO L Z, ZHANG H W, et al. Neural collaborative filtering［C］// Proceedings of the 26th International Conference on World Wide Web. 2017:173-182.

［10］WANG H, WANG N Y, YEUNG D-Y. Collaborative deep learning for recommender systems［C］// Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2015:1235-1244.
［11］KIM D H, PARK C, OH J, et al. Convolutional matrix factorization for document context-aware recommendation［C］// Proceedings of the 10th ACM Conference on Recommender Systems. 2016:233-240.
［12］WU C-Y, AHMED A, BEUTEL A, et al. Joint training of ratings and reviews with recurrent recommender networks［C］// Proceedings of the 5th International Conference on Learning Representations. 2017.
［13］曾安,聂文俊. 基于深度双向LSTM的股票推荐系统［J］. 计算机科学, 2019,46(10):84-89.
［14］李南星,盛益强,倪宏. 用于个性化推荐的条件卷积隐因子模型［J/OL］. 计算机工程, (2019-05-28)［2020-02-16］. https://doi.org/10.19678/j.issn.1000-3428.0054209.
［15］KIM Y. Convolutional neural networks for sentence classification［C］// Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing. 2014:1746-1751.
［16］WU Y, DUBOIS C, ZHENG A X, et al. Collaborative denoising auto-encoders for top-n recommender systems［C］// Proceedings of the 9th ACM International Conference on Web Search and Data Mining. 2016:153-162.
［17］STRUB F, MARY J. Collaborative filtering with stacked denoising autoencoders and sparse inputs［C］// NIPS Workshop on Machine Learning for eCommerce. 2015.
［18］SEDHAIN S, MENON A K, SANNER S, et al. AutoRec: Autoencoders meet collaborative filtering［C］// Proceedings of the 24th International Conference on World Wide Web. 2015:111-112.
［19］SHIBATA H, TAKAMA Y. Behavior analysis of RBM for estimating latent factor vectors from rating matrix［C］// Proceedings of the 2017 6th International Conference on Informatics, Electronics and Vision, 2017 7th International Symposium in Computational Medical and Health Technology (ICIEV-ISCMHT). 2017.
［20］SARWAR B, KARYPIS G, KONSTAN J, et al. Incremental singular value decomposition algorithms for highly scalable recommender systems［C］// Proceedings of the 2002 International Conference on Computer and Information Science. 2002:27-28.
［21］ZHAO L L, LU Z Q, PAN S J L, et al. Matrix factorization+ for movie recommendation［C］// Proceedings of the 25th International Joint Conference on Artificial Intelligence. 2016:3945-3951.
［22］HE X N, CHUA T-S. Neural factorization machines for sparse predictive analytics［C］// Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval. 2017:355-364.
［23］SALAKHUTDINOV R, MNIH A, HINTON G. Restricted Boltzmann machines for collaborative filtering［C］// Proceedings of the 24th International Conference on Machine Learning. 2007:791-798.

[1]	祁贤, 刘大铭, 常佳鑫. 基于改进自注意力机制的多视图三维重建[J]. 计算机与现代化, 2024, 0(11): 106-112.
[2]	陈凯1, 李宜汀1, 2, 全华凤1 . 基于改进YOLOv8的河道废弃瓶检测方法[J]. 计算机与现代化, 2024, 0(11): 113-120.
[3]	杨骏1, 胡为1, 朱文福2. 基于改进MobileNetV3的视觉SLAM回环检测算法[J]. 计算机与现代化, 2024, 0(10): 21-26.
[4]	王莹莹, 郝潇. 基于Res2Net和递归门控卷积的细粒度图像分类[J]. 计算机与现代化, 2024, 0(10): 74-79.
[5]	史星宇1, 李强2, 庄莉3, 梁懿3, 王秋琳3, 陈锴3, 伍臣周3, 常胜1. 一种面向工业部署的目标检测模型蒸馏技术[J]. 计算机与现代化, 2024, 0(10): 93-99.
[6]	张泽1, 张建权2, 3, 周国鹏2, 3. 基于改进YOLOv8s的摄像头模组缺陷检测[J]. 计算机与现代化, 2024, 0(09): 107-113.
[7]	程亚子1, 雷亮1, 2, 陈瀚1, 赵毅然1. 基于转置注意力的多尺度深度融合单目深度估计[J]. 计算机与现代化, 2024, 0(09): 121-126.
[8]	程萌, 李浩. 改进YOLOv5s的落叶树鸟巢检测方法[J]. 计算机与现代化, 2024, 0(08): 24-29.
[9]	王梦溪, 李峻. 老年人跌倒检测技术研究综述[J]. 计算机与现代化, 2024, 0(08): 30-36.
[10]	时现伟1, 范鑫2. 基于轻量化的视频帧场景语义分割方法[J]. 计算机与现代化, 2024, 0(08): 49-53.
[11]	徐新爱, 李钢. 基于DCGAN的课堂表情图像生成方法[J]. 计算机与现代化, 2024, 0(08): 88-91.
[12]	高帅鹏, 王怡凡. 基于图像的群体情绪识别综述[J]. 计算机与现代化, 2024, 0(08): 98-107.
[13]	黄文栋, 王怡凡. 基于模态类别的多模态信息处理与融合综述[J]. 计算机与现代化, 2024, 0(07): 47-62.
[14]	武丽1, 张征浩2, 葛彩成2, 俞俊2. 基于改进SCNN网络的车道线检测算法[J]. 计算机与现代化, 2024, 0(07): 87-92.
[15]	张可1, 艾中良2, 刘忠麟3, 顾平莉1, 刘学林4. 基于多元组匹配损失的司法论辩理解方法[J]. 计算机与现代化, 2024, 0(06): 115-120.