Open AccessThe design of a data management system at HEPS
Author(s) -
Hu Hao,
Qi Fazhi,
Zhang Hongmei,
Tian Haolai,
Luo Qi
Publication year - 2021
Publication title -
journal of synchrotron radiation
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.172
H-Index - 99
ISSN - 1600-5775
DOI - 10.1107/s1600577520015167
Subject(s) - data management , computer science , testbed , beamline , beijing , raw data , systems engineering , database , engineering , computer network , beam (structure) , civil engineering , china , law , political science , programming language
According to the estimated data rates, it is predicted that 24 PB raw experimental data will be produced per month from 14 beamlines at the first stage of the High‐Energy Photon Source (HEPS) in China, and the volume of experimental data will be even greater with the completion of over 90 beamlines at the second stage in the future. To make sure that the huge amount of data collected at HEPS is accurate, available and accessible, an effective data management system (DMS) is crucial for deploying the IT systems. In this article, a DMS is designed for HEPS which is responsible for automating the organization, transfer, storage, distribution and sharing of the data produced from experiments. First, the general situation of HEPS is introduced. Second, the architecture and data flow of the HEPS DMS are described from the perspective of facility users and IT, and the key techniques implemented in this system are introduced. Finally, the progress and the effect of the DMS deployed as a testbed at beamline 1W1A of the Beijing Synchrotron Radiation Facility are shown.