FLEXPIPE: A FLEXIBLE SYSTEM FOR BUILDING AND MAINTAINING COMPUTATIONAL PIPELINES

点击翻译按钮获取中文摘要

This subproject is one of many research subprojects utilizing the resources provided by a Center grant funded by NIH/NCRR. The subproject and investigator (PI) may have received primary funding from another NIH source, and thus could be represented in other CRISP entries. The institution listed is for the Center, which is not necessarily the institution for the investigator. FlexPipe is a pipeline processing system that is based on the event processing model. The design goals for FlexPipe are: 1. Streamline data updates and maximize data integrity by initiating processing protocols when data arrive or change 2. Low administrative requirements and overhead, to minimize complexity 3. Straightforward incorporation of existing tools and scripts, to minimize disruption during deployment 4. Support for standard data sources (e.g., both flat files and relational databases) 5. Support for decentralized data exchange mechanisms 6. Ability for different instances of FlexPipe to exchange data automatically FlexPipe will build upon our DASH prototype by: providing a web-based interface for monitoring and creating pipelines; supporting multiple, interacting pipeilnes on the same node; and allowing pipelines to extend across system boundaries. FlexPipe will be implemented in Python, which will provide an excellent base for broad distribution and extension within the Bioinformatics community.