基于多模双线性池化方法的虚假新闻检测模型

摘要/Abstract

摘要： 社交媒体的兴起促进了新闻行业的发展，使虚假新闻的传播也变得更为便利，然而多样化的新闻表现形式带来了很多负面影响，比如新闻内容夸大事实、恶意篡改新闻文本或图像内容、构造虚假新闻事实引起社会舆论，这促使了虚假新闻检测工作成为新闻领域新的挑战。为了应对虚假新闻检测工作的研究，将新闻文本与图像信息结合起来，通过多模双线性池化方法，改变传统特征融合方法，构建出基于新特征融合方法的虚假新闻检测模型，并且采用虚假新闻检测领域标准数据集验证模型的性能，实验结果表明，文本与图像的融合特征表现在虚假新闻检测领域不可替代，且所提方法能够有效提升虚假新闻检测性能。

关键词: 虚假新闻检测, 社交多媒体, 多模态特征融合, 双线性池化, 深度学习

Abstract: The rise of social media has promoted the development of the news industry and made the spread of fake news more convenient. However, diversified news expressions have brought many negative effects, such as news content exaggerating facts, malicious tampering of news text or image content, the construction of fake news facts arousing public opinion, which makes fake news detection a new challenge in the news field. In order to deal with the research of fake news detection work, the news text and image information are combined, the traditional feature fusion method is changed through the multimodal bilinear pooling method, and a fake news detection model based on the new feature fusion method is constructed. The standard data set in the detection field verifies the performance of the model. The experimental results show that the fusion feature of text and image is irreplaceable in the field of fake news detection, and the proposed method can effectively improve the performance of fake news detection.

Key words: fake news detection, social multimedia, multimodal feature fusion, bilinear pooling, deep learning

李国栋, 彭敦陆. 基于多模双线性池化方法的虚假新闻检测模型[J]. 计算机与现代化, 2021, 0(11): 17-21.

LI Guo-dong, PENG Dun-lu. Multimodal Bilinear Pooling Method for Fake News Detection[J]. Computer and Modernization, 2021, 0(11): 17-21.

参考文献［23］

［1］	QI P, CAO J, YANG T Y, et al. Exploiting multi-domain visual information for fake news detection［C］// 2019 IEEE International Conference on Data Mining. 2019:518-527.
［2］	ALDWAIRI M, ALWAHEDI A. Detecting fake news in social media networks［J］. Procedia Computer Science,2018,141:215-222.
［3］	〖JP+1〗CASTILLO C, MENDOZA M, POBLETE B. Information credibility on Twitter［C］// Proceedings of the 20th ACM International Conference on World Wide Web. 2011:675-684.
［4］	CONROY N J, RUBIN V L, CHEN Y M. Automatic deception detection: Methods for finding fake news［C］// Proceedings of the 2015 Association for Information Science and Technology. 2015. DOI: 10.1002/pra2.2015.145052010082.
［5］	JIN Z W, CAO J, ZHANG Y D, et al.Novel visual and statistical image features for microblogs news verification［J］. IEEE Transactions on Multimedia, 2017,19(3):598-608.
［6］	MA J, GAO W, MITRA P, et al. Detecting rumors from microblogs with recurrent neural networks［C］// 2016 International Joint Conference on Artificial Intelligence. 2016:3818-3824.
［7］	RUCHANSKY N, SEO S Y, LIU Y. CSI: A hybrid deep model for fake news detection［C］// Proceedings of the 2017 ACM Conference on Information and Knowledge Management. 2017:797-806.
［8］	张尚田,陈光,邱天. 基于融合特征的LSTM评分预测［J］. 计算机与现代化, 2020(3):49-53.
［9］	王威,李志华,吴世宇. 基于多特征融合的车辆阴影检测与去除［J］. 计算机与现化, 2019(12):49-54.
［10］	JIN Z W, CAO J, GUO H, et al. Multimodal fusion with recurrent neural networks for rumor detection on microblogs［C］// Proceedings of the 2017 ACM Multimedia Conference. 2017:795-816.
［11］	周晨轶,冯宇,徐亦白,等. 基于增强多重注意力机制的深度神经网络的细粒度检测［J］. 计算机与现代化, 2019(9):83-89.
［12］	WANG Y Q, MA F L, JIN Z W, et al. EANN: Event adversarial neural networks for multi-modal fake news detection［C］// Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 2018:849-857.
［13］	KHATTAR D, GOUD J S, GUPTA M, et al. MVAE: Multimodal variational autoencoder for fake news detection［C］// The 2019 World Wide Web Conference. 2019: 2915-2921.
［14］	GENTZKOW M, SHAPIRO J M, STONE D F. Media Bias in the Marketplace: Theory［R］. National Bureau of Economic Research, 2014:623-645.
［15］	KIM Y. Convolutional neural networks for sentence classification［J］. arXiv preprint arXiv:1408.5882, 2014.
［16］	SIMONYAN K, ZISSERMAN A. Very deep convolutional networks for large-scale image recognition［J］. arXiv preprint arXiv:1409.1556, 2014.
［17］	ANTOL S, AGRAWAL A, LU J S, et al. VQA: Visual question answering［C］// Proceedings of the 2015 IEEE International Conference on Computer Vision. 2015:2425-2433.
［18］	LIN T Y, ROYCHOWDHURY A, MAJI S. Bilinear CNN models for fine-grained visual recognition［C］// Proceedings of the 2015 IEEE International Conference on Computer Vision. 2015:1449-1457.
［19］	GAO Y, BEIJBOM O, ZHANG N, et al. Compact bilinear pooling［C］// Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition. 2016:317-326.
［20］	FUKUI A, PARK D H, YANG D, et al. Multimodal compact bilinear pooling for visual question answering and visual grounding［J］. arXiv preprint arXiv:1606.01847, 2016.
［21］	WU K, YANG S, ZHU K Q. False rumors detection on Sina Weibo by propagation structures［C］// 2015 IEEE 31st International Conference on Data Engineering. 2015:651-662.
［22］	BOIDIDOU C, MIDDLETON S E, JIN Z W, et al. Verifying information with multimedia content on Twitter［J］. Multimedia Tools and Applications, 2018,77(12):15545-15571.
［23］	MIKOLOV T, SUTSKEVER I, CHEN K, et al. Distributed representations of words and phrases and their compositionality［C］// 2013 Advances in Neural Information Processing Systems. 2013:3111-3119.

[1]	胡崇佳, 刘金洲, 方立. 基于无监督域适应的室外点云语义分割[J]. 计算机与现代化, 2024, 0(01): 74-79.
[2]	林威. 基于自监督学习和数据回放的新闻推荐模型增量学习方法[J]. 计算机与现代化, 2023, 0(12): 1-6.
[3]	梁天恺, 黄康华, 刘凯航, 兰岚, 曾碧. 基于双向同态加密的深度联邦图片分类方法[J]. 计算机与现代化, 2023, 0(12): 36-40.
[4]	邱凯星, 冯广. 基于双重特征注意力的多标签图像分类模型[J]. 计算机与现代化, 2023, 0(12): 41-47.
[5]	张伯泉, 麦海鹏, 陈嘉敏, 逄锦聚. 基于高灰度值注意力机制的脑白质高信号分割[J]. 计算机与现代化, 2023, 0(12): 67-75.
[6]	马泽宇, 叶宁, 徐康, 王甦, 王汝传, . 基于FMCW雷达和ResNeSt-GRU的行为识别方法[J]. 计算机与现代化, 2023, 0(11): 101-107.
[7]	李延满, 王必恒, 赵羚焱. 基于轻量化YOLOv5的安全帽检测[J]. 计算机与现代化, 2023, 0(10): 59-64.
[8]	黎世达, 项剑文. 一种提高图像识别模型鲁棒性的弱化强化方法[J]. 计算机与现代化, 2023, 0(10): 70-76.
[9]	沈加炜, 陆一鸣, 陈晓艺, 钱美玲, 陆卫忠, . 基于深度学习的人体行为检测方法研究综述[J]. 计算机与现代化, 2023, 0(09): 1-9.
[10]	刘禅奕, 黄丹, 薛林雁, 王涛, 朱桃, . 改进EfficientNet网络的COVID-19 X光分类[J]. 计算机与现代化, 2023, 0(09): 94-99.
[11]	马国祥, 杨凌菲, 严传波, 张志豪, 孙彬, 王晓荣. 基于深度DenseNet网络的肝包虫病超声影像诊断方法[J]. 计算机与现代化, 2023, 0(09): 100-104.
[12]	农皓程, 任德均, 任秋霖, 刘澎笠, 黄德成. 基于改进ConvNeXt的软塑包装表面异常检测算法[J]. 计算机与现代化, 2023, 0(08): 12-17.
[13]	欧阳飞, 吴旭, 向东升. 基于改进YOLOX的垃圾分类检测方法[J]. 计算机与现代化, 2023, 0(08): 68-73.
[14]	胡睿杰, 车逗. 红外小目标检测方法综述[J]. 计算机与现代化, 2023, 0(08): 79-86.
[15]	江蕾, 唐建, 杨超越, 吕婷婷. 基于CWGAN-GP与CNN的轴承故障诊断方法[J]. 计算机与现代化, 2023, 0(07): 1-6.