计算机与现代化

• 算法设计与分析 • 上一篇    下一篇

一种基于深度学习的云平台弹性伸缩算法

  

  1. (华北计算技术研究所基础四部,北京100083)
  • 收稿日期:2019-01-11 出版日期:2019-04-26 发布日期:2019-04-30
  • 作者简介:曹宇(1993-),男,山东聊城人,硕士研究生,研究方向:数据分析,机器学习,E-mail: yizhongqishi@163.com; 通信作者:杨军(1981-),男,安徽枞阳人,研究员级高级工程师,硕士,研究方向:中间件,云计算,E-mail: 13581707266@163.com。

A Deep Learning Based Elastic Retractable Algorithm for Cloud Platform

  1. (Dept.4 of Foundation, North China Institute of Computing Technology, Beijing 100083, China) 
  • Received:2019-01-11 Online:2019-04-26 Published:2019-04-30

摘要: 为了满足性能要求,降低资源消耗,研究人员提出了许多伸缩调度的算法和方案。但是,它们中的大多数只作用在服务器或应用程序的当前状态,无论是资源实际的调度效果还是算法方案的适用性上都受到了影响和限制。本文提出一种基于长短期记忆网络和BP神经网络的面向应用的弹性伸缩算法。该算法包括工作负载预测模型、响应时间预测模型和资源调整策略模型,能够对云计算应用的工作负载和响应时间进行预测并给出合适的资源调度策略。为了提高工作负载预测的准确度,本文将卷积运算和长短期网络结合起来,更好地提取数据特征并进行准确地预测。而为了提高模型收敛速度,并有效避免模型过拟合的问题,本文则在BP神经网络中使用批标准化运算。在验证实验中,该算法工作负载预测的平均绝对百分误差降低到3.4×10-4,响应时间预测和调度策略模型也达到了不错的效果。在实际平台运行中,该弹性伸缩算法还能够根据Docker容器云平台实际需要提供合适的计算资源调度策略。实验结果表明,相比较其他模型,该弹性伸缩算法在工作负载预测和云平台计算资源调整方面具有较好的性能。

关键词: 弹性伸缩, 工作负载预测, 容器云, 长短期记忆网络

Abstract: To meet the performance demands and reduce resource consumption, researchers have proposed many elastic retractable algorithms and schemes. However, most of them only considered current states of the servers or applications that limit the applicability of algorithm and the performance of resource adjustment. This paper presents an application-oriented elastic retractable algorithm based on long-short term memory network and back-propagation neural network. The algorithm includes a workload prediction model, a response time prediction model and a resource adjusting model. With these models, the algorithm can predict the workload and response time of cloud computing applications and provide appropriate resource scheduling strategies. In order to improve the accuracy of workload prediction, we combine convolution operation with long-short term network for better data feature extraction and prediction. To improve the convergence speed of the model and effectively avoid the problem over-fitting, we use batch normalization in BP neural network. In the validation experiment, the mean absolute percentage error of the algorithm’s workload prediction is reduced to 3.4×10-4, and models of response time prediction and resource adjusting also perform well. In the actual operating environment, the algorithm can also provide appropriate adjustment suggestion to Docker container cloud platform. The results of experiments show that our algorithm had better performance in workload prediction and server adjusting than other models.

Key words: elastic retractable, workload prediction, container cloud, long-short term memory network

中图分类号: