Optimization Model of Remote File Synchronization Based on Rsync Algorithm

Abstract

Abstract:

In order to solve the relatively fine-grained control over the transmission of network data and more efficient use of network bandwidth, we design and implement

an optimized file synchronization model which moves most calculations out of the cloud and shared part of checksum by local data table and the cloud server distributed cache

table. And this method is based on Rsync file transfer algorithm and took Hadoop Distributed File System (HDFS) as the research object. Experimental results show that the model

can effectively improve the cloud storage file synchronization of I/O performance, and reduce synchronization costs.

Key words: cloud storage, file synchronization, Rsync, Hadoop distributed file system, checksum, distributed cache

WANG Bin, LIU Zhao-yuan. Optimization Model of Remote File Synchronization Based on Rsync Algorithm[J]. Computer and Modernization.

[1]	LIU Zheng, WU Ke-hua, YE Chun-xiao. Security-enhanced Data Access Control for Multi-authority Cloud Storage [J]. Computer and Modernization, 2021, 0(10): 119-126.
[2]	ZHANG Xi, WANG Jian. A Public Integrity Auditing Scheme Based on Blind Signature for Shared Data in Cloud [J]. Computer and Modernization, 2020, 0(04): 60-.
[3]	CAO Yong-ming. A Fuzzy Keyword Search Encryption Scheme Without Secure Channel [J]. Computer and Modernization, 2020, 0(04): 42-.
[4]	WANG Qian， YAN Xia-li， YE Jue-yu， ZHANG Hai-kuo， LI Zhen-hui . Data Consistency Mechanism for Authoritative DNS [J]. Computer and Modernization, 2020, 0(02): 36-.
[5]	SHI Ting-jun, ZHANG Ying-jie. Method of Access Control of Attribute-based Ciphertext Policy for Cloud Storage [J]. Computer and Modernization, 2017, 0(7): 111-116.
[6]	LIU Kai-le1, CONG Zheng-hai2, WANG Bo-wen2. An Encryption and Cloud Storage PDP Verification Algorithm Based on Multi Chaos Sequences [J]. Computer and Modernization, 2017, 0(11): 100-104.
[7]	YUAN Jian-wei. Design and Implementation of Enterprise Cloud Storage and Management System [J]. Computer and Modernization, 2016, 0(9): 49-53.
[8]	ZHANG Chao1,2, GUO Hui-ming2, ZHANG Hong2. Cloud Storage Research on Supervisory Video Heat Based on K-means [J]. Computer and Modernization, 2016, 0(6): 12-15.
[9]	DAI Yingling， CHEN Junjie， ZHOU Dehua， CHEN Jielang. An Improved Method of Data Integrity Auditing for Cloud Storage [J]. Computer and Modernization, 2016, 0(10): 92-95.
[10]	FENG Jun, WANG Chun, ZHU Kang-kang, WEI Tong-tong. Replication Migration Technology for Access Hotspots Based on Hadoop [J]. Computer and Modernization, 2016, 0(1): 108-113.
[11]	ZHA Xian-yue, FENG Jun, FENG Du-qing, TANG Zhi-xian. An Adaptive Distribution Strategy of Redundant Splits on Cloud Storage [J]. Computer and Modernization, 2016, 0(1): 87-93.
[12]	YU Zheng-rong, XIA Xiao-ling. A Kind of VOD System Based on Cloud Storage [J]. Computer and Modernization, 2014, 0(8): 71-74.
[13]	FENG Du-qing, FENG Jun, TANG Zhi-xian, WANG Chao. Hydraulic Hybrid Cloud Storage Platform Oriented to Share and Exchange [J]. Computer and Modernization, 2014, 0(12): 27-31.
[14]	ZHANG Ying-chun;ZHANG Wei. Storage Infrastructure Management and Optimization Scheme in Virtualized Environment [J]. Computer and Modernization, 2013, 218(10): 226-228.
[15]	XUE Yinying;WAN Xiaodong. Cloud Storage Systems Based on Technology of Optical Disk Library [J]. Computer and Modernization, 2013, 1(1): 64-66.

Optimization Model of Remote File Synchronization Based on Rsync Algorithm

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics

Comments