基于多模双线性池化方法的虚假新闻检测模型

摘要/Abstract

摘要： 社交媒体的兴起促进了新闻行业的发展，使虚假新闻的传播也变得更为便利，然而多样化的新闻表现形式带来了很多负面影响，比如新闻内容夸大事实、恶意篡改新闻文本或图像内容、构造虚假新闻事实引起社会舆论，这促使了虚假新闻检测工作成为新闻领域新的挑战。为了应对虚假新闻检测工作的研究，将新闻文本与图像信息结合起来，通过多模双线性池化方法，改变传统特征融合方法，构建出基于新特征融合方法的虚假新闻检测模型，并且采用虚假新闻检测领域标准数据集验证模型的性能，实验结果表明，文本与图像的融合特征表现在虚假新闻检测领域不可替代，且所提方法能够有效提升虚假新闻检测性能。

关键词: 虚假新闻检测, 社交多媒体, 多模态特征融合, 双线性池化, 深度学习

Abstract: The rise of social media has promoted the development of the news industry and made the spread of fake news more convenient. However, diversified news expressions have brought many negative effects, such as news content exaggerating facts, malicious tampering of news text or image content, the construction of fake news facts arousing public opinion, which makes fake news detection a new challenge in the news field. In order to deal with the research of fake news detection work, the news text and image information are combined, the traditional feature fusion method is changed through the multimodal bilinear pooling method, and a fake news detection model based on the new feature fusion method is constructed. The standard data set in the detection field verifies the performance of the model. The experimental results show that the fusion feature of text and image is irreplaceable in the field of fake news detection, and the proposed method can effectively improve the performance of fake news detection.

Key words: fake news detection, social multimedia, multimodal feature fusion, bilinear pooling, deep learning

李国栋, 彭敦陆. 基于多模双线性池化方法的虚假新闻检测模型[J]. 计算机与现代化, 2021, 0(11): 17-21.

LI Guo-dong, PENG Dun-lu. Multimodal Bilinear Pooling Method for Fake News Detection[J]. Computer and Modernization, 2021, 0(11): 17-21.

参考文献

［1］ QI P, CAO J, YANG T Y, et al. Exploiting multi-domain visual information for fake news detection［C］// 2019 IEEE International Conference on Data Mining. 2019:518-527.
［2］ ALDWAIRI M, ALWAHEDI A. Detecting fake news in social media networks［J］. Procedia Computer Science,2018,141:215-222.
［3］〖JP+1〗CASTILLO C, MENDOZA M, POBLETE B. Information credibility on Twitter［C］// Proceedings of the 20th ACM International Conference on World Wide Web. 2011:675-684.
［4］ CONROY N J, RUBIN V L, CHEN Y M. Automatic deception detection: Methods for finding fake news［C］// Proceedings of the 2015 Association for Information Science and Technology. 2015. DOI: 10.1002/pra2.2015.145052010082.
［5］ JIN Z W, CAO J, ZHANG Y D, et al.Novel visual and statistical image features for microblogs news verification［J］. IEEE Transactions on Multimedia, 2017,19(3):598-608.
［6］ MA J, GAO W, MITRA P, et al. Detecting rumors from microblogs with recurrent neural networks［C］// 2016 International Joint Conference on Artificial Intelligence. 2016:3818-3824.
［7］ RUCHANSKY N, SEO S Y, LIU Y. CSI: A hybrid deep model for fake news detection［C］// Proceedings of the 2017 ACM Conference on Information and Knowledge Management. 2017:797-806.
［8］张尚田,陈光,邱天. 基于融合特征的LSTM评分预测［J］. 计算机与现代化, 2020(3):49-53.
［9］王威,李志华,吴世宇. 基于多特征融合的车辆阴影检测与去除［J］. 计算机与现化, 2019(12):49-54.
［10］JIN Z W, CAO J, GUO H, et al. Multimodal fusion with recurrent neural networks for rumor detection on microblogs［C］// Proceedings of the 2017 ACM Multimedia Conference. 2017:795-816.
［11］周晨轶,冯宇,徐亦白,等. 基于增强多重注意力机制的深度神经网络的细粒度检测［J］. 计算机与现代化, 2019(9):83-89.
［12］WANG Y Q, MA F L, JIN Z W, et al. EANN: Event adversarial neural networks for multi-modal fake news detection［C］// Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 2018:849-857.
［13］KHATTAR D, GOUD J S, GUPTA M, et al. MVAE: Multimodal variational autoencoder for fake news detection［C］// The 2019 World Wide Web Conference. 2019: 2915-2921.
［14］GENTZKOW M, SHAPIRO J M, STONE D F. Media Bias in the Marketplace: Theory［R］. National Bureau of Economic Research, 2014:623-645.
［15］KIM Y. Convolutional neural networks for sentence classification［J］. arXiv preprint arXiv:1408.5882, 2014.
［16］SIMONYAN K, ZISSERMAN A. Very deep convolutional networks for large-scale image recognition［J］. arXiv preprint arXiv:1409.1556, 2014.
［17］ANTOL S, AGRAWAL A, LU J S, et al. VQA: Visual question answering［C］// Proceedings of the 2015 IEEE International Conference on Computer Vision. 2015:2425-2433.
［18］LIN T Y, ROYCHOWDHURY A, MAJI S. Bilinear CNN models for fine-grained visual recognition［C］// Proceedings of the 2015 IEEE International Conference on Computer Vision. 2015:1449-1457.
［19］GAO Y, BEIJBOM O, ZHANG N, et al. Compact bilinear pooling［C］// Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition. 2016:317-326.
［20］FUKUI A, PARK D H, YANG D, et al. Multimodal compact bilinear pooling for visual question answering and visual grounding［J］. arXiv preprint arXiv:1606.01847, 2016.
［21］WU K, YANG S, ZHU K Q. False rumors detection on Sina Weibo by propagation structures［C］// 2015 IEEE 31st International Conference on Data Engineering. 2015:651-662.
［22］BOIDIDOU C, MIDDLETON S E, JIN Z W, et al. Verifying information with multimedia content on Twitter［J］. Multimedia Tools and Applications, 2018,77(12):15545-15571.
［23］MIKOLOV T, SUTSKEVER I, CHEN K, et al. Distributed representations of words and phrases and their compositionality［C］// 2013 Advances in Neural Information Processing Systems. 2013:3111-3119.

[1]	祁贤, 刘大铭, 常佳鑫. 基于改进自注意力机制的多视图三维重建[J]. 计算机与现代化, 2024, 0(11): 106-112.
[2]	陈凯1, 李宜汀1, 2, 全华凤1 . 基于改进YOLOv8的河道废弃瓶检测方法[J]. 计算机与现代化, 2024, 0(11): 113-120.
[3]	杨骏1, 胡为1, 朱文福2. 基于改进MobileNetV3的视觉SLAM回环检测算法[J]. 计算机与现代化, 2024, 0(10): 21-26.
[4]	王莹莹, 郝潇. 基于Res2Net和递归门控卷积的细粒度图像分类[J]. 计算机与现代化, 2024, 0(10): 74-79.
[5]	史星宇1, 李强2, 庄莉3, 梁懿3, 王秋琳3, 陈锴3, 伍臣周3, 常胜1. 一种面向工业部署的目标检测模型蒸馏技术[J]. 计算机与现代化, 2024, 0(10): 93-99.
[6]	张泽1, 张建权2, 3, 周国鹏2, 3. 基于改进YOLOv8s的摄像头模组缺陷检测[J]. 计算机与现代化, 2024, 0(09): 107-113.
[7]	程亚子1, 雷亮1, 2, 陈瀚1, 赵毅然1. 基于转置注意力的多尺度深度融合单目深度估计[J]. 计算机与现代化, 2024, 0(09): 121-126.
[8]	程萌, 李浩. 改进YOLOv5s的落叶树鸟巢检测方法[J]. 计算机与现代化, 2024, 0(08): 24-29.
[9]	王梦溪, 李峻. 老年人跌倒检测技术研究综述[J]. 计算机与现代化, 2024, 0(08): 30-36.
[10]	时现伟1, 范鑫2. 基于轻量化的视频帧场景语义分割方法[J]. 计算机与现代化, 2024, 0(08): 49-53.
[11]	徐新爱, 李钢. 基于DCGAN的课堂表情图像生成方法[J]. 计算机与现代化, 2024, 0(08): 88-91.
[12]	高帅鹏, 王怡凡. 基于图像的群体情绪识别综述[J]. 计算机与现代化, 2024, 0(08): 98-107.
[13]	黄文栋, 王怡凡. 基于模态类别的多模态信息处理与融合综述[J]. 计算机与现代化, 2024, 0(07): 47-62.
[14]	武丽1, 张征浩2, 葛彩成2, 俞俊2. 基于改进SCNN网络的车道线检测算法[J]. 计算机与现代化, 2024, 0(07): 87-92.
[15]	张可1, 艾中良2, 刘忠麟3, 顾平莉1, 刘学林4. 基于多元组匹配损失的司法论辩理解方法[J]. 计算机与现代化, 2024, 0(06): 115-120.