Premium
Data transformation as a means towards dynamic data storage and polyglot persistence
Author(s) -
Vanhove Thomas,
Sebrechts Merlijn,
Van Seghbroeck Gregory,
Wauters Tim,
Volckaert Bruno,
De Turck Filip
Publication year - 2017
Publication title -
international journal of network management
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.373
H-Index - 28
eISSN - 1099-1190
pISSN - 1055-7148
DOI - 10.1002/nem.1976
Subject(s) - polyglot , computer science , nosql , data migration , transformation (genetics) , dynamic data , database , computer data storage , persistent data structure , schema (genetic algorithms) , relational database , schema evolution , query language , programming language , database schema , information retrieval , operating system , scalability , database design , biochemistry , chemistry , gene
Summary Legacy applications have been built around the concept of storing their data in one relational data store. However, with the current differentiation in data store technologies as a consequence of the NoSQL paradigm, new and possibly more performant storage solutions are available to all applications. The concept of dynamic storage makes sure that application data are always stored in the most optimal data store at a given time to increase application performance. Additionally, polyglot persistence aims to push this performance even further by storing each different data type of an application in the data store technology best suited for it. To get legacy applications into dynamic storage and polyglot persistence, schema and data transformations between data store technologies are needed. This usually infers application redesigns as well to support the new data stores. This paper proposes such a transformation approach through a canonical model. It is based on the Lambda architecture to ensure no application downtime is needed during the transformation process, and after the transformation, the application can continue to query in the original query language, thus requiring no application code changes.