Integrating databases and workflow systems

10 years 8 months ago
Integrating databases and workflow systems
There has been an information explosion in fields of science such as high energy physics, astronomy, environmental sciences and biology. There is a critical need for automated systems to manage scientific applications and data. Database technology is well-suited to handle several aspects of workflow management. Contemporary workflow systems are built from multiple, separately developed components and do not exploit the full power of DBMSs in handling data of large magnitudes. We advocate a holistic view of a WFMS that includes not only workflow modeling but planning, scheduling, data management and cluster management. Thus, it is worthwhile to explore the ways in which databases can be augmented to manage workflows in addition to data. We present a language for modeling workflows that is tightly integrated with SQL. Each scientific program in a workflow is associated with an active table or view. The definition of data products is in relational format, and invocation of programs and q...
Srinath Shankar, Ameet Kini, David J. DeWitt, Jeff
Added 08 Dec 2009
Updated 08 Dec 2009
Type Conference
Year 2005
Authors Srinath Shankar, Ameet Kini, David J. DeWitt, Jeffrey F. Naughton
Comments (0)