AUTOMATIC GENERATION OF DATA MERGING PROGRAM CODES

Hyeonsook Kim, Samia Oussena, Ying zhang, Tony Clark

2010

Abstract

Data merging is an essential part of ETL (Extract-Transform-Load) processes to build a data warehouse system. To avoid rewheeling merging techniques, we propose a Data Merging Meta-model (DMM) and its transformation into executable program codes in the manner of model driven engineering. DMM allows defining relationships of different model entities and their merging types in conceptual level and our formalized transformation described using ATL (ATLAS Transformation Language) enables automatic generation of PL/SQL packages to execute data merging in commercial ETL tools. With this approach data warehouse engineers can be relieved from burden of repetitive complex script coding and pain of maintaining consistency of design and implementation.

Paper Citation

in Harvard Style

Kim H., Oussena S., zhang Y. and Clark T. (2010). AUTOMATIC GENERATION OF DATA MERGING PROGRAM CODES . In Proceedings of the 5th International Conference on Software and Data Technologies - Volume 2: ICSOFT, ISBN 978-989-8425-23-2, pages 179-186. DOI: 10.5220/0003008301790186

in Bibtex Style

@conference{icsoft10,
author={Hyeonsook Kim and Samia Oussena and Ying zhang and Tony Clark},
title={AUTOMATIC GENERATION OF DATA MERGING PROGRAM CODES},
booktitle={Proceedings of the 5th International Conference on Software and Data Technologies - Volume 2: ICSOFT,},
year={2010},
pages={179-186},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003008301790186},
isbn={978-989-8425-23-2},
}

in EndNote Style

TY - CONF
JO - Proceedings of the 5th International Conference on Software and Data Technologies - Volume 2: ICSOFT,
TI - AUTOMATIC GENERATION OF DATA MERGING PROGRAM CODES
SN - 978-989-8425-23-2
AU - Kim H.
AU - Oussena S.
AU - zhang Y.
AU - Clark T.
PY - 2010
SP - 179
EP - 186
DO - 10.5220/0003008301790186