分布式计算环境下的入侵检测数据分类研究

doi:10.3969/j.issn.1006-2475.2015.12.009

计算机与现代化 ›› 2015, Vol. 0 ›› Issue (12): 43-.doi: 10.3969/j.issn.1006-2475.2015.12.009

分布式计算环境下的入侵检测数据分类研究

1.常州工学院计算机信息工程学院，江苏常州213002；2.常州工学院经济管理学院，江苏常州213002

收稿日期:2015-08-05 出版日期:2015-12-23 发布日期:2015-12-30
作者简介:沈利香(1977-)，女，江苏海门人,常州工学院计算机信息工程学院讲师,硕士,研究方向：网络安全，数据挖掘；曹国(1975-)，男，安徽舒城人，常州工学院经济管理学院讲师，硕士，研究方向：数据挖掘。
基金资助:
教育部人文社会科学研究青年基金资助项目(11YJCZH005)

Intrusion Detection Data Classification by Distributed Computing

1. School of Computer & Information Engineering, Changzhou Institute of Technology, Changzhou 213002, China;

2. School of Economics and Management, Changzhou Institute of Technology, Changzhou 213002, China

Received:2015-08-05 Online:2015-12-23 Published:2015-12-30

摘要/Abstract

摘要： 为了有效处理迅速增长的海量信息数据安全问题，在Hadoop云计算平台上，应用朴素贝叶斯算法和Logistic回归算法对入侵检测大数据进行并行计算分析。实验在伪分布模式和分布模式下进行计算，结果表明2种算法分类准确率均超过90%，Logistic回归算法比朴素贝叶斯算法运行时间更长；集群环境下运行的朴素贝叶斯算法可以有效降低运行时间。综合算法运行时间和分类准确率等因素，朴素贝叶斯算法比Logistic回归算法更能有效处理入侵检测大数据；并行计算下朴素贝叶斯算法可以有效分析入侵检测大数据。

关键词: 入侵检测, 朴素贝叶斯, Logistic回归

Abstract: To handle huge amounts of network data effectively which is increasing rapidly, Naive Bayesian parallel algorithm and Logistic Regression parallel algorithm were used to analyze the intrusion detection big data based on Hadoop which is a cloud computing system. The intrusion detection data was computed in the model of pseudodistribution model and distribution model. The experimental results show that the classification accuracy of the two algorithms can exceed 90% and Logistic Regression algorithm spent more time than Naive Bayesian algorithm. Naive Bayesian algorithm can reduce run time effectively in Hadoop cluster. So Naive Bayesian algorithm is more effectively than Logistic Regression algorithm with the classification accuracy and the algorithm running time considered. Naive Bayesian algorithm can analyze the intrusion detection big data.

Key words: intrusion detection, Naive Bayesian, Logistic Regression

中图分类号:

TP393.08

沈利香1,曹国2. 分布式计算环境下的入侵检测数据分类研究[J]. 计算机与现代化, 2015, 0(12): 43-.

SHEN Lixiang1, CAO Guo2. Intrusion Detection Data Classification by Distributed Computing[J]. Computer and Modernization, 2015, 0(12): 43-.

参考文献

［1］
Chen C L P, Zhang Chunyang. Dataintensive applications, challenges, techniques and technologies: A survey on big data［J］. Information Sciences, 2014,275:314-347.
［2］Manyika J, Chui M, Brown B, et al. Big Data: The Next Frontier For Innovation, Competition, and Productivity［EB/OL］. http://www.mckinsey.com/insights/business_technology/big_data_the_next_frontier_for_innovation, 2014-10-30.
［3］Kambatla K, Kollias G, Kumar V, et al. Trends in big data analytics［J］. Journal of Parallel and Distributed Computing, 2014,74(7):2561-2573.
［4］Lee Yeonhee, Lee Youngseok. Towards scalable internet traffic measurement and analysis with Hadoop［J］. ACM SIGCOMM Computer Communication Review, 2013,43(1):5-13.
［5］Edwards M, Rambani A, Zhu Yifeng, et al. Design of Hadoopbased framework for analytics of large synchrophasor datasets［J］. Procedia Computer Science, 2012,12:254-258.
［6］Ericson K, Pallickara S. On the performance of high dimensional data clustering and classification algorithms［J］. Future Generation Computer Systems, 2013,29(4):1024-1034.
［7］Caruana G, Li Maozhen, Liu Yang. An ontology enhanced parallel SVM for scalable spam filter training［J］. Neurocomputing, 2013,108:45-57.
［8］Rio S D, Lopez V, Benitez J M, et al. On the use of MapReduce for imbalanced big data using Random Forest［J］. Information Sciences, 2014,285:112-137.
［9］Kwon O, Sim J M. Effects of data set features on the performances of classification algorithms［J］. Expert Systems with Applications, 2013,40(5):1847-1857.
［10］张新有,曾华燊,贾磊. 入侵检测数据集KDDCUP99研究［J］. 计算机工程与设计, 2010,31(22):4809-4812.
［11］Matloff N.R语言编程艺术［M］. 陈堰平,邱怡轩,潘岚锋,等译. 北京：机械工业出版社, 2013.
［12］Piccolboni A. RHadoop Home［EB/OL］. https://github.com/RevolutionAnalytics/RHadoop/wiki, 2015-02-13.
［13］The Apache Software Foundation. Naive Bayes［EB/OL］. http://mahout.apache.org/users/classification/naivebayes.html, 2014-08-10.
［14］Zumel N. The Simpler Derivation of Logistic Regression［EB/OL］. http://www.winvector.com/blog/2011/09/thesimplerderivationoflogisticregression/, 2014-08-12.
［15］Mount J. Large Data Logistic Regression(with Example Hadoop Code)［EB/OL］. http://www.winvector.com/blog/2010/12/largedatalogisticregressionwithexamplehadoopcode/, 2010-12-26.

[1]	苏凯旋. 基于改进XGBoost模型的网络入侵检测研究[J]. 计算机与现代化, 2024, 0(06): 109-114.
[2]	潘裕庆, 张苏宁, 冯仁君, 景栋盛. 结合粒子群优化和LightGBM的入侵检测方法[J]. 计算机与现代化, 2023, 0(04): 123-126.
[3]	李舒, 张伟业, 汪坤, 段照斌. 基于聚类分析的航班油耗组合估计[J]. 计算机与现代化, 2022, 0(08): 65-69.
[4]	饶海兵, 朱苏磊, 杨春夏. 基于空时特征融合和注意力机制的网络入侵检测模型[J]. 计算机与现代化, 2022, 0(06): 116-121.
[5]	吴水明, 吉志远, 王震宇, 景栋盛. 基于Dueling-DDQN的电力信息网络入侵检测算法[J]. 计算机与现代化, 2021, 0(12): 43-47.
[6]	邓斌涛, 徐胜超. 基于动态双子种群的差分进化K中心点聚类算法[J]. 计算机与现代化, 2021, 0(07): 54-59.
[7]	闫芮铵, 张立臣. 基于Focal Loss和卷积神经网络的入侵检测[J]. 计算机与现代化, 2021, 0(01): 65-69.
[8]	张羽1,2，郭春1,2，申国伟1,2，平源3. 一种基于信息熵的IDS告警预处理方法[J]. 计算机与现代化, 2020, 0(05): 111-.
[9]	李荷婷，冯仁君，陈海雁，景栋盛. 基于异卷积神经网络的入侵检测[J]. 计算机与现代化, 2019, 0(10): 117-.
[10]	张苏宁，王月娟，吴水明，景栋盛. 基于Krylov子空间方法的网络入侵数据聚类[J]. 计算机与现代化, 2019, 0(10): 121-.
[11]	籍天明1,庄岭2，俞俊1，朱广新1，王召1，缪静文1. 用于变电站终端入侵检测的熵权融合定位算法[J]. 计算机与现代化, 2019, 0(04): 114-.
[12]	郑开雨，竹翠. 基于上下文语义的朴素贝叶斯文本分类算法[J]. 计算机与现代化, 2018, 0(06): 1-.
[13]	郭晓明1,2，孙丹1,2. 基于朴素贝叶斯理论的内部威胁检测方法[J]. 计算机与现代化, 2017, 0(7): 101-106.
[14]	韩静丹,孙磊，王帅丽，王泽武. 基于BPSO-NB算法的Android恶意应用检测方法[J]. 计算机与现代化, 2017, 0(4): 109-113.
[15]	褚贵洋. 基于链接全覆盖的无线Mesh网络入侵检测算法[J]. 计算机与现代化, 2017, 0(2): 61-66.

分布式计算环境下的入侵检测数据分类研究

Intrusion Detection Data Classification by Distributed Computing

可视化

被引次数

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

本文评价