Scientific Workflow Tools

Crawl, Daniel and Altintas, Ilkay. (2010) Scientific Workflow Tools. In: Nanoinformatics 2010, November 3 - 5, 2010, Arlington, VA. (Unpublished)

[img]
Preview
PDF
Daniel_Crawl-nanoinformatics2010-2.pdf - Presentation

Download (947kB) | Preview

Abstract

Although an increasing amount of cyberinfrastructure technologies have emerged in the last few years to achieve remote data access, distributed job execution, and data management, orchestrating these components with minimal overhead still remains a difficult task for scientists. Scientific workflow systems improve this situation by creating interfaces to a variety of technologies and automating the execution and monitoring of the workflows. A scientific workflow is the process of combining data and processes into a structured set of steps that implement semi-automated computational solutions of a scientific problem. Kepler is a cross-project collaboration, with a purpose to develop a domain-independent scientific workflow system. It provides an environment in which scientists can design and execute scientific workflows by specifying the desired sequence of computational actions and the appropriate dataflow. Currently deployed workflows range from local analytical pipelines to distributed, high-performance applications that can run in cluster, grid, or cloud computing environments. The scientific workflow approach offers a number of advantages over traditional scripting-based approaches, including simplified configuration; improved reusability, maintenance and sharing; automated provenance management to capture and browse the lineage of data products; and support for fault-tolerance. This talk presents an overview of common scientific workflow requirements and illustrates these features using the Kepler scientific workflow system. We highlight the features of Kepler in several scientific applications, as well as describe upcoming extensions and improvements.

Item Type: Conference or Workshop Item (Other)
Uncontrolled Keywords: cyberinfrastructure, Kepler, scientific workflows,
InterNano Taxonomy: Informatics and Standards
Collections: National Nanomanufacturing Network Archive > Conferences and Workshops > Nanoinformatics 2010
Depositing User: Rebecca Reznik-Zellen
Date Deposited: 18 Mar 2011 20:19
Last Modified: 18 Mar 2011 20:19
URI: http://eprints.internano.org/id/eprint/585

Actions (login required)

View Item View Item