Fair-share scheduling algorithm for a tertiary storage system

0439633 - ÚJF 2015 RIV GB eng C - Konferenční příspěvek (zahraniční konf.)
Jakl, Pavel - Lauret, J. - Šumbera, Michal
Fair-share scheduling algorithm for a tertiary storage system.
Journal of Physics Conference Series. Bristol: IOP Publishing Ltd, 2010 - (Gruntorad, J.; Lokajíček, M.), 052005. ISSN 1742-6588.
[17th International Conference on Computing in High Energy and Nuclear Physics (CHEP). Prague (CZ), 21.05.2009-27.05.2009]
Grant CEP: GA MŠMT LC07048; GA MŠMT LA09013
Institucionální podpora: RVO:61389005
Klíčová slova: STAR * RHIC * mass storage system
Kód oboru RIV: BG - Jaderná, atomová a mol. fyzika, urychlovače

Any experiment facing Peta bytes scale problems is in need for a highly scalable mass storage system (MSS) to keep a permanent copy of their valuable data. But beyond the permanent storage aspects, the sheer amount of datamakes complete data-set availability onto live storage (centralized or aggregated space such as the one provided by Scalla/Xrootd) cost prohibitive implying that a dynamic population from MSS to faster storage is needed. One of the most challenging aspects of dealing with MSS is the robotic tape component. If a robotic system is used as the primary storage solution, the intrinsically long access times (latencies) can dramatically affect the overall performance. To speed the retrieval of such data, one could organize the requests according to criterion with an aim to deliver maximal data throughput. However, such approaches are often orthogonal to fair resource allocation and a trade-off between quality of service, responsiveness and throughput is necessary for achieving an optimal and practical implementation of a truly faire-share oriented file restore policy. Starting from an explanation of the key criterion of such a policy, we will present evaluations and comparisons of three different MSS file restoration algorithms which meet fair-share requirements, and discuss their respective merits. We will quantify their impact on a typical file restoration cycle for the RHIC/STAR experimental setup and this, within a development, analysis and production environment relying on a shared MSS service.
Trvalý link: http://hdl.handle.net/11104/0242912