QoX-driven ETL design: reducing the cost of ETL consulting engagements

As business intelligence becomes increasingly essential for organizations and as it evolves from strategic to operational, the complexity of Extract-Transform-Load (ETL) processes grows. In consequence, ETL engagements have become very time consuming, labor intensive, and costly. At the same time, additional requirements besides functionality and performance need to be considered in the design of ETL processes. In particular, the design quality needs to be determined by an intricate combination of different metrics like reliability, maintenance, scalability, and others. Unfortunately, there are no methodologies, modeling languages or tools to support ETL design in a systematic, formal way for achieving these quality requirements. The current practice handles them with ad-hoc approaches only based on designers' experience. This results in either poor designs that do not meet the quality objectives or costly engagements that require several iterations to meet them. A fundamental sh...

• Type: Conference
• Year: 2009
• Where: SIGMOD
• Authors: Alkis Simitsis, Kevin Wilkinson, Malú Castellanos, Umeshwar Dayal
• Keywords: Database, ETL Design, ETL Design Task, ETL Engagements, SIGMOD 2009