Back to Search Start Over

Scalable and Adaptive Data Replica Placement for Geo-Distributed Cloud Storages.

Authors :
Liu, Kaiyang
Peng, Jun
Wang, Jingrong
Liu, Weirong
Huang, Zhiwu
Pan, Jianping
Source :
IEEE Transactions on Parallel & Distributed Systems. Jul2020, Vol. 31 Issue 7, p1575-1587. 13p.
Publication Year :
2020

Abstract

In geo-distributed cloud storage systems, data replication has been widely used to serve the ever more users around the world for high data reliability and availability. How to optimize the data replica placement has become one of the fundamental problems to reduce the inter-node traffic and the system overhead of accessing associated data items. In the big data era, traditional solutions may face the challenges of long running time and large overheads to handle the increasing scale of data items with time-varying user requests. Therefore, novel offline community discovery and online community adjustment schemes are proposed to solve the replica placement problem in a scalable and adaptive way. The offline scheme can find a replica placement solution based on the average read/write rates for a certain period of time. The scalability can be achieved as 1) the computation complexity is linear to the amount of data items and 2) the data-node communities can evolve in parallel for a distributed replica placement. Furthermore, the online scheme is adaptive to handle the bursty data requests, without the need to completely override the existing replica placement. Driven by real-world data traces, extensive performance evaluations demonstrate the effectiveness of our design to handle large-scale datasets. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
10459219
Volume :
31
Issue :
7
Database :
Academic Search Index
Journal :
IEEE Transactions on Parallel & Distributed Systems
Publication Type :
Academic Journal
Accession number :
143316138
Full Text :
https://doi.org/10.1109/TPDS.2020.2968321