The ATLAS Eventindex using the HBase/Phoenix storage solution

Conference item

The ATLAS EventIndex provides a global event catalogue and event-level metadata for ATLAS analysis groups and users. The LHC Run 3, starting in 2022, will see increased data-taking and simulation production rates, with which the current infrastructure would still cope but may be stretched to its limits by the end of Run 3. This talk describes the implementation of a new core storage service that will provide at least the same functionality as the current one for increased data ingestion and search rates, and with increasing volumes of stored data. It is based on a set of HBase tables, coupled to Apache Phoenix for data access; in this way we will add to the advantages of a BigData based storage system the possibility of SQL as well as NoSQL data access, which allows the re-use of most of the existing code for metadata integration.

Authors: Cherepanova, E; Alexandrov, E; Alexandrov, I; Barberis, D; Canali, L

• Publication status: Published
• Peer review status: Peer reviewed
• Publisher: CEUR Workshop Proceedings
• Host title: Proceedings of the 9th International Conference "Distributed Computing and Grid Technologies in Science and Education" (GRID'2021)
• Journal: CEUR Workshop Proceedings
• Volume: 3041
• Pages: 17-25
• Article number: 3
• Publication date: 2021-12-13
• Event title: 9th International Conference "Distributed Computing and Grid Technologies in Science and Education" (GRID'2021)
• Event location: Dubna, Russia
• Event website: https://indico.jinr.ru/event/1086/
• Event start date: 2021-07-05
• Event end date: 2021-07-09
• ISSN: 1613-0073
• Language: English
• Keywords: scientific computing; HBase; Apache Phoenix; Hadoop; BigData; EventIndex