Open AccessDevelopment and implementation of accelerated methods of data access
Author(s) -
N. V. Ermakov,
Sergey A. Molodyakov
Publication year - 2019
Publication title -
journal of physics. conference series
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.21
H-Index - 85
eISSN - 1742-6596
pISSN - 1742-6588
DOI - 10.1088/1742-6596/1326/1/012025
Subject(s) - computer science , metadata , permission , database , cache , component (thermodynamics) , scheme (mathematics) , file system , operating system , relational database , file server , data access , mathematical analysis , physics , mathematics , political science , law , thermodynamics
In this paper we address the problem of organizing a permission-conscious access to files and their metadata. A large amount of data is required to be stored and analyzed in medicine, bioinformatics, astronomy, and banking. For effective data storage, it is necessary to apply different technologies depending on the data. We have developed a system that consists of the following components: a relational DBMS to store user permissions and file metadata; an off-the-shelf distributed search engine to store activity logs; a distributed cache with permissions; a file system; a special application that interacts with all the respective components. We describe the overall architecture of our approach and discuss each component in detail. To offload database server and to speed up the permission checking we have devised a simple data caching scheme that is performed on an application server. The idea was to manually rewrite queries that are used by our application to check permissions. As a result, queries that use several tables request only non-cached tables from the database. We conclude our paper with the experimental evaluation of our system and the proposed caching approach.