Load Rebalancing in Large-Scale Distributed File System

作者：Wenqiu Zeng, Ying Li, Jian Wu, Qingqing Zhong, Qi Zhang · 年份：2009 · DOI：10.1109/icise.2009.719 · 被引用次数：8 · 研究领域：Advanced Data Storage Technologies、Caching and Content Delivery、Peer-to-Peer Network Technologies

With the development of internet technology, the entire amount of data on the internet has shown the explosive growth. Some researchers have paid their attention to find an effective way to store and manage these data. In this paper, we introduce a load rebalancing algorithm to solve the load balancing problem among all chunk servers(compute nodes) in the distributed file system; it also ensures that one chunk(file block) of a file and its two copies are stored in three different chunk servers at the same time. This algorithm achieves the load balancing while ensuring the reliability of the system.