Home // DBKDA 2015, The Seventh International Conference on Advances in Databases, Knowledge, and Data Applications // View article

An Industry Experience on Dynamic Handling of Multiple Database Types for Data Integration Tool

Authors:
Badrul Affandy Bin Ahmad Latfi
Anbarasan Kodandaraman
Chee Kiam Lee
Tong Khin Thong

Keywords: Data integration; SQL; multiple database type

Abstract:
This paper presents the industry experience of implementing a Structured Query Language (SQL) Query Builder component and its interface supporting multiple database types in web-based Data Integration Tool (DIT), which performs Extract-Transform-Load (ETL) and Data Cleansing. Due to the dynamic nature of database connectivity for different types of source and target tables, the usage of direct SQL statement is preferred over Object Relationship Management (ORM). The common problem while handling multiple different databases is that it requires database specific queries for SQL functions, like create table, insert data or query specific range of rows for each type of database. Hence, we developed the SQL Query Builder (QB), which generates specific SQL statements for specific syntax. By standardizing the usage of delimited identifier with American National Standards Institute (ANSI) mode, and schema hierarchy, the QB’s common interface will enable to dynamically handle multiple types of databases. With the QB, we created ETL and data cleansing applications compatible with multiple database types.

Pages: 1 to 4

Copyright: Copyright (c) IARIA, 2015

Publication date: May 24, 2015

Published in: conference

ISSN: 2308-4332

ISBN: 978-1-61208-408-4

Location: Rome, Italy

Dates: from May 24, 2015 to May 29, 2015