Continuous Automated Model EvaluatiOn (CAMEO) complementing the critical assessment of structure prediction in CASP12.
Continuous Automated Model EvaluatiOn (CAMEO) complementing the critical assessment of structure prediction in CASP12.
复制标题
DOI：
10.1002/prot.25431
复制
发表时间：
2018-03
期刊：
影响因子：
2.9
通讯作者：
Schwede T
中科院分区：
文献类型：
--
作者：
Haas J;Barbato A;Behringer D;Studer G;Roth S;Bertoni M;Mostaguir K;Gumienny R;Schwede T
每隔一年，社区实验“结构预测技术关键评估”（CASP）对结构预测方法进行独立的盲评估，为比较不同方法的性能和讨论该领域的最新发展提供一个框架。然而，自动化计算建模方法的开发人员显然受益于基于更大数据集的更频繁的评估。“连续自动化模型评估（CAMEO）”平台通过基于这些结构的每周预发布序列进行全自动盲预测评估来补充CASP实验，这些序列将在PDB蛋白质数据库的下一个版本中发布。CAMEO根据在为期四天的预测窗口期间收集的模型，每周发布基准测试结果，在五周的时间框架内平均评估约100个目标。在同一时间点为所有参与的方法一致地生成CAMEO基准测试数据，使开发人员能够对其方法的性能进行基准测试和交叉验证，并直接参考出版物中的基准测试结果。为了促进服务器开发和缩短发布周期，CAMEO每周发送电子邮件，其中包含提交统计数据和低性能警告。CASP的许多参与者在为即将到来的社区实验准备方法时成功地使用了CAMEO。CAMEO提供了各种分数，可以对结构预测方法的各个方面进行基准测试。通过引入新的评分方案，CAMEO促进了活跃研究领域的新发展，例如建模四级结构，配合物或配体结合位点。
Every second year, the community experiment “Critical Assessment of Techniques for Structure Prediction” (CASP) is conducting an independent blind assessment of structure prediction methods, providing a framework for comparing the performance of different approaches and discussing the latest developments in the field. Yet, developers of automated computational modeling methods clearly benefit from more frequent evaluations based on larger sets of data. The “Continuous Automated Model EvaluatiOn (CAMEO)” platform complements the CASP experiment by conducting fully automated blind prediction assessments based on the weekly pre-release of sequences of those structures, which are going to be published in the next release of the PDB Protein Data Bank. CAMEO publishes weekly benchmarking results based on models collected during a four-day prediction window, on average assessing ca. 100 targets during a time frame of five weeks. CAMEO benchmarking data is generated consistently for all participating methods at the same point in time, enabling developers to benchmark and cross-validate their method’s performance, and directly refer to the benchmarking results in publications. In order to facilitate server development and promote shorter release cycles, CAMEO sends weekly email with submission statistics and low performance warnings. Many participants of CASP have successfully employed CAMEO when preparing their methods for upcoming community experiments. CAMEO offers a variety of scores to allow benchmarking diverse aspects of structure prediction methods. By introducing new scoring schemes, CAMEO facilitates new development in areas of active research, e.g. modeling quaternary structure, complexes or ligand binding sites.
登录
查看更多内容
影响因子：
14.8
作者：
Kelley LA;Mezulis S;Yates CM;Wass MN;Sternberg MJ
通讯作者：
Sternberg MJ
DOI：
10.1107/s0907444913007051
发表时间：
2013-05
期刊：
Acta crystallographica. Section D, Biological crystallography
影响因子：
--
作者：
Biasini M;Schmidt T;Bienert S;Mariani V;Studer G;Haas J;Johner N;Schenk AD;Philippsen A;Schwede T
通讯作者：
Schwede T
影响因子：
14.9
作者：
Kim, DE;Chivian, D;Baker, D
通讯作者：
Baker, D
影响因子：
14.9
作者：
McGuffin LJ;Atkins JD;Salehe BR;Shuid AN;Roche DB
通讯作者：
Roche DB
影响因子：
14.9
作者：
Mabrouk M;Putz I;Werner T;Schneider M;Neeb M;Bartels P;Brock O
通讯作者：
Brock O