Home // DATA ANALYTICS 2013, The Second International Conference on Data Analytics // View article

The Data Checking Engine: Monitoring Data Quality

Authors:
Felix Heine
Carsten Kleiner
Arne Koschel
Jörg Westermayer

Keywords: Data Quality, Quality Rules, Data Analysis, Data Quality Monitoring, Data Warehouses

Abstract:
In the context of data warehousing and business intelligence, data quality is of utmost importance. However, many mid-size data warehouse (DWH) projects do not implement a proper data quality process due to huge up-front investments. However, assessing and monitoring data quality is necessary to establish confidence in the DWH data. In this paper, we describe a data quality monitoring system developed collaboratively at HS Hannover and SHS Viveon: The “Data Checking Engine” (DCE). The goal of the system is to provide DWH projects with an easy and quickly deployable solution to assess data quality while still providing highest flexibility in the definition of the assessment rules. It allows to express complex quality rules and implements a template mechanism to facilitate the deployment of large numbers of similar rules.

Pages: 7 to 10

Copyright: Copyright (c) IARIA, 2013

Publication date: September 29, 2013

Published in: conference

ISSN: 2308-4464

ISBN: 978-1-61208-295-0

Location: Porto, Portugal

Dates: from September 29, 2013 to October 3, 2013