HDFS Copy Storage Improvement Strategy

To improve the reliability of data storage, HDFS adopts the multicopy storage strategy of Rack-Aware. However, it does not consider the data block's access heat during the replication process, resulting in that in the case of high concurrent access, the client's request for the hot file cannot be responded quickly, and the storage cluster's I/O throughput rate is significantly reduced. Aiming at the defects of HDFS default replica replication strategy, this paper proposes a replica replication strategy based on block heat The results show that the improved strategy is better than the HDFS default strategy in load balancing performance, the average response time of read requests of the improved strategy is 28.46% lower than the default strategy, and the response speed is significantly better than the HDFS default strategy.