计算机与现代化 ›› 2015, Vol. 0 ›› Issue (4): 10-13.

• 网络与通信 • 上一篇    下一篇

基于Rsync的远程文件同步优化模型

  

  1. 西安邮电大学计算机学院,陕西西安710061
  • 收稿日期:2014-11-24 出版日期:2015-04-27 发布日期:2015-04-29
  • 作者简介:王宾(1987-),男,陕西咸阳人,西安邮电大学计算机学院硕士研究生,研究方向:计算机系统结构; 刘钊远(1963-),男,教授,硕士生导师,研究方向:嵌入式系统。

 Optimization Model of Remote File Synchronization Based on Rsync Algorithm

  1. School of Computer Science and Technology, Xi’an University of Posts & Telecommunications, Xi’an 710061, China
  • Received:2014-11-24 Online:2015-04-27 Published:2015-04-29

摘要:

 针对云存储中无法较细粒度地控制网络数据的传输而导致网络带宽利用低的问题,本文基于Rsync文件同步算法,以Hadoop分布式文件系统(HDFS)为研究目标,提出计算分离出云,本地数
据表与云服务端分布式缓存表共享部分校验值的远程文件同步优化模型。实验结果表明,该模型可有效提高云存储文件同步系统的I/O性能,减小同步的成本。

关键词:  , 云存储, 文件同步, Rsync算法, Hadoop分布式文件系统, 校验值, 分布式缓存

Abstract:

In order to solve the relatively fine-grained control over the transmission of network data and more efficient use of network bandwidth, we design and implement
an optimized file synchronization model which moves most calculations out of the cloud and shared part of checksum by local data table and the cloud server distributed cache
table. And this method is based on Rsync file transfer algorithm and took Hadoop Distributed File System (HDFS) as the research object. Experimental results show that the model
can effectively improve the cloud storage file synchronization of I/O performance, and reduce synchronization costs.

Key words: cloud storage, file synchronization, Rsync, Hadoop distributed file system, checksum, distributed cache