Computer and Modernization

Previous Articles     Next Articles

Replication Migration Technology for Access Hotspots Based on Hadoop

  

  1. College of Computer and Information, Hohai University, Nanjing 211100, China
  • Received:2015-08-25 Online:2016-01-22 Published:2016-01-26

Abstract: This paper proposes an access hotspots load balance model of cloud environment. Based on the node throughput and response time of the main reference index, this paper constructs the node load determination module. In the process of files storing to HDFS, combining the file corresponding to the data block number with storage paths, the blocks of data stored in the data node are designed to a file directory mapping table. A selection method based on the node load and the storage space of migration of source node and destination node is puts forward. Based on the frame of perception mechanism, a dynamic copy migration scheme is established. Finally using the actuator issued instructions to the appropriate data nodes, it carries on the specific migration tasks and improves the migrated copy factor to adjust parameters, such as information. This paper, by means of copy quickly spread to increase hot file copy number, enables the system to provide greater throughput and shortens the system response time.

Key words: cloud storage, big data, data migration, dynamic duplication, access hotspots

CLC Number: