Open AccessAUTOMATIC GENERATION OF DATA MERGING PROGRAM CODES
Author(s) -
Hyeonsook Kim,
Samia Oussena,
Ying Zhang,
Tony Clark
Publication year - 2010
Language(s) - English
Resource type - Conference proceedings
DOI - 10.5220/0003008301790186
Subject(s) - computer science , executable , sql , data transformation , model transformation , data warehouse , transformation (genetics) , coding (social sciences) , database , programming language , consistency (knowledge bases) , data modeling , data mining , software engineering , artificial intelligence , mathematics , biochemistry , statistics , gene , chemistry
Data merging is an essential part of ETL (Extract-Transform-Load) processes to build a data warehouse system. To avoid rewheeling merging techniques, we propose a Data Merging Meta-model (DMM) and its transformation into executable program codes in the manner of model driven engineering. DMM allows defining relationships of different model entities and their merging types in conceptual level. Our formalized transformation described using ATL (ATLAS Transformation Language) enables automatic generation of PL/SQL packages to execute data merging in commercial ETL tools. With this approach data warehouse engineers can be relieved from the burden of repetitive complex script coding and the pain of maintaining consistency of design and implementation.
Accelerating Research
Robert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom
Address
John Eccles HouseRobert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom