计算机与现代化

• 信息安全 • 上一篇    下一篇

基于Swift的副本数据自适应备份策略研究

  

  1. (1.核工业西南物理研究院,四川成都610225;
    2.成都理工大学工程技术学院电子信息与计算机工程系,四川乐山614000)
  • 收稿日期:2018-05-11 出版日期:2018-11-22 发布日期:2018-11-23
  • 作者简介:杜华(1983-),男,重庆人,核工业西南物理研究院、成都理工大学工程技术学院电子信息与计算机工程系副教授,硕士,研究方向:网络分布式计算,最优化算法分析,计算机应用技术; 郭俊(1973-),男,副教授,硕士,研究方向:分布式系统,数据挖掘; 刘华春(1966-),男,副教授,硕士,研究方向:机器学习,人工智能。
  • 基金资助:
    四川省教育厅2017年度科研计划项目(17ZB0059); 成都理工大学工程技术学院院级基金资助项目(C122017024); 成都理工大学工程技术学院教研项目(2016-YY-JG06)

Research on Replica Data Adaptive Backup Strategy Based on Swift

  1. (1. Southwestern Institute of Physics, Chengdu 610225, China;
    2. Dept. of Electronic Information and Computer Engineering, Engineering and Technical College,
    Chengdu University of Technology, Leshan 614000, China)
  • Received:2018-05-11 Online:2018-11-22 Published:2018-11-23

摘要: 冗余数据备份是保证云数据中心下数据可靠性的重要保障机制之一,OpenStack是一种开源的云计算IaaS层私有云服务搭建平台,目前已经在行业界广泛应用。OpenStack的Swift模块使用一致性哈希算法,采用Ring环选取副本备份节点的方式来完成负载均衡和数据备份。本文通过对Swift的实现机理和代码进行分析研究,指出其在副本放置节点选取上的不足,并进而提出优化选取策略ABS(Adaptive Backup Strategy)。该机制在实时监控当前存储节点的负载情况基础之上,根据预先设定的阈值上、下限,自适应选取最近可用的节点完成备份,以优化整体备份效率。通过与现有副本备份策略进行对比和实验验证表明,ABS在保持数据副本分配均衡性的基础之上,将系统存储的4种读写性能分别提高了3.4%~9.1%,达到了优化存取的目的。

关键词: 副本, 备份, Swift, ABS

Abstract: Redundant data backup is one of the important guarantee mechanisms to ensure the reliability of data under the cloud data center. OpenStack is an open source platform for cloud computing which belongs to IaaS layer private cloud services, and it has been widely used in the industry. The Swift module, which is one of the OpenStack’s modules, uses the consistent Hash algorithm in order to choose the replica backup node by a Ring to complete  the load balancing and data backup. By analyzing the implementation mechanism and code of Swift, this paper points out the shortcomings of the selection of the nodes in the replica placement node, and then puts forward the optimization selection strategy ABS (Adaptive Backup Strategy). On the basis of real-time monitoring of the current storage node load, the mechanism adaptively selects the recently available nodes to complete the backup in order to optimize the overall backup efficiency based on the predetermined threshold and lower limits. By comparing with the existing copy backup strategy and experimental verification, it shows that ABS improves the four reading and writing performance of the system by 3.4%~9.1% on the basis of maintaining the balance of data copy allocation, and achieves the purpose of optimizing access.

Key words: copy, backup, Swift, ABS

中图分类号: