Extending ETL framework using service oriented architecture
Author(s) -
Mohammed Awad,
Mohd Syazwan Abdullah,
Abdul Bashah Mat Ali
Publication year - 2011
Publication title -
procedia computer science
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.334
H-Index - 76
ISSN - 1877-0509
DOI - 10.1016/j.procs.2010.12.019
Subject(s) - extensibility , computer science , interoperability , restructuring , service oriented architecture , database , component (thermodynamics) , architecture , data warehouse , software engineering , fragmentation (computing) , distributed computing , web service , programming language , operating system , economics , thermodynamics , art , visual arts , physics , finance
Extraction, Transformation and Loading (ETL) represent a big portion of a data warehouse project. Complexity of components extensibility is a main problem in the ETL area, because ETL components are tightly-coupled to each others in the current ETL framework. The missing extensibility feature causes impediments to add new components to the current ETL framework; to meet special business needs. This paper shows how to restructure the current ETL framework based on Service Oriented Architecture (SOA) to be easier to extend. This restructuring solution distributes the ETL into interoperable components. The distribution of Extraction, Transformation and Loading components while keeping interoperability amongst them; can be achieved by SOA. A Classified-Fragmentation component to enhance the report generation speed is added to the new framework; as a proof of the extensibility concept. The result of this work is an extensible ETL framework including Classified-Fragmentation component as an extension
Accelerating Research
Robert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom
Address
John Eccles HouseRobert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom