Back to Search Start Over

Erasure Coding XRootD Object Store.

Authors :
Hanushevsky, Andrew
Simon, Michal Kamil
Yang, Wei
Source :
EPJ Web of Conferences. 5/6/2024, Vol. 295, p1-8. 8p.
Publication Year :
2024

Abstract

An erasure coding (EC) algorithm was implemented in XRootD client library, and an EC-enabled XRootD storage prototype was set up at SLAC for evaluation. The architecture and configuration of the prototype is almost identical to that of a traditional non-EC XRootD storage behind a firewall: a backend XRootD storage cluster in its simplest form, and an internet facing XRootD proxy. This proxy handles EC and spreads the data stripes of a file/object across several backend nodes. It also supports all functions used on a WLCG storage system: HTTP(s) and XRootD protocols, Third Party Copy, X509/VOMS/Token, etc. The cross-node EC architecture brings significant advantages in both performance and resilience: e.g. parallel data access, tolerance of downtime and hardware failure. It also pushes the preferred network-IO mode from Posix-like to object-like. This paper will describe the prototype's architecture and its design choices, the performance in high concurrent throughputs and file/object operations, failure modes and their handling, data recovery methods, and administration. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
21016275
Volume :
295
Database :
Academic Search Index
Journal :
EPJ Web of Conferences
Publication Type :
Conference
Accession number :
177902223
Full Text :
https://doi.org/10.1051/epjconf/202429501024