Open AccessDISTRIBUTED FAULT-TOLERANT COMPUTING WITH SBN-PYTHON ON A REAL COMPANY CASE
Author(s) -
D. Tereshchenko,
Ivan Gankevich
Publication year - 2021
Publication title -
9th international conference "distributed computing and grid technologies in science and education"
Language(s) - English
Resource type - Conference proceedings
DOI - 10.54546/mlit.2021.84.27.001
Subject(s) - python (programming language) , computer science , interpreter , fault tolerance , architecture , operating system , distributed computing , programming language , software engineering , art , visual arts
Distributed computing today is in demand in batch data processing tasks, but current solutionsthat allow to use them in Python either are too specific, or do not guarantee full fault tolerance. As apart of the final qualification work, a high-level Python interface (hereinafter SBN-Python) wasdeveloped for the new C++ framework called Subordination, in which the last problem was solved.The interface was implemented as an extension of the Python interpreter to achieve low-levelcompatibility and adaptation of all functionality. The purpose of this work was to test the possibility ofusing the new interface on a real case of LLC «Gazpromneft – Digital Solution» and to demonstratethe its core principles. To achieve this goal the current solution was analysed, a new architecture usingSBN-Python was thought out and implemented, and eventually, the resulting solution was deployed atthe company's facilities. As a result of the work, it turned out that using SBN-Python on a real casealso scales performance with the number of nodes in the cluster, gives the ability to process variousscenarios of node failure in a limited time, as well as some architectural advantages in organizingcalculations. In the future, it is planned to expand the boundaries of the new interface, implementingthe possibility of building distributed web services on its basis.