A Comprehensive Test Suite for SBML

描述（由申请人提供）：系统生物学标记语言（SBML）是一种流行的、机器可读的模型表示格式，允许生物化学网络的计算模型在诸如编辑程序、模拟器和数据库的软件工具之间交换。它不仅得到了系统生物学软件的开源和商业开发人员的支持，还得到了《自然》等主要期刊的支持。我们的团队继续领导和指导SBML和相关基础设施的发展，因此，我们也敏锐地感受到了一些局限性和挑战，这些局限性和挑战只有在SBML取得爆炸性成功后才变得明显。其中一个挑战是通过不断增长的工具数量来确保高度符合SBML规范。我们已经认识到，仅仅提供SBML的定义，举办研讨会和讨论等等，并不足以确保不同软件系统的一致解释和行为。需要有具体和客观的机制来验证SBML实现。在过去一年的初步工作中，我们开发了一个独立的“SBML语义测试套件”，允许软件开发人员和用户根据SBML基准模型测试模拟工具的行为，从基本到高级，涵盖了语言中定义的大部分功能。在这个提案中，我们的目标是（1）扩展和完善这个初步的努力，成为一个全面的SBML测试套件，（2）开发一个基于Web的系统，允许任何人上传测试结果，独立评估它们，并选择将它们与其他软件工具的结果进行比较。总体目标是为验证不同软件工具对SBML定义的覆盖率和一致性提供客观的工具，从而帮助确保SBML感知软件系统之间的最高水平的一致性。这对于用户对SBML作为生物医学研究中模拟和分析的标准模型表示格式的信心至关重要。

DESCRIPTION (provided by applicant): The Systems Biology Markup Language (SBML) is a popular, machine-readable, model representation format allowing computational models of biochemical networks to be exchanged between software tools such as editing programs, simulators, and databases. It is supported not only by open-source and commercial developers of systems biology software, but also by major journals such as Nature. Our group continues to lead and guide the evolution of SBML and related infrastructure, and as a result, we also keenly feel some of the limitations and challenges that have become apparent only as a result of SBML's exploding success. One such challenge is ensuring a high degree of conformance to the SBML specification by the steadily growing number of tools. We have come to realize that simply providing a definition of SBML, holding workshops and discussions, and so forth, are not enough to ensure consistent interpretation and behavior by different software systems. There need to be concrete and objective mechanisms for validating SBML implementations. In preliminary work over the past year, we developed a self-contained "SBML Semantic Test Suite" allowing software developers and users to test the behavior of simulation tools against SBML benchmark models ranging in complexity from basic to advanced, covering a majority of the features defined in the language. In this proposal, we aim to (1) extend and refine this preliminary effort into a comprehensive SBML Test Suite, and (2) develop a web-based system allowing anyone to upload test results, assess them independently, and optionally compare them to the results of other software tools. The overall goal is to provide objective facilities for validating different software tools' coverage and conformance to the definition of SBML, and thereby help ensure the highest level of consistency possible across SBML- aware software systems. This is something that is crucial for users to have confidence in SBML as a standard model representation format for simulation and analysis in biomedical research.