A Training Module for Reproducible Data Science Research

可重复数据科学研究的培训模块

• 批准号: 10199242
• 负责人: ROGER PENG
• 金额: $ 9.42万
• 依托单位: JOHNS HOPKINS UNIVERSITY
• 依托单位国家: 美国
• 财政年份: 2021
• 资助国家: 美国
• 起止时间: 2021-06-01 至 2024-05-31
• 项目状态: 已结题
• 来源: https://reporter.nih.gov/project-details/10199242
• 关键词: Address; Area; Case Study; Communication Methods; Complex; Coupled; Critiques; Data Analyses; Data Analytics; Data Collection; Data Science; Data Scientist; Development; Drops; Educational Curriculum; Educational process of instructing; Enrollment; Face; Foundations; Funding; Goals; Investigation; Knowledge; Learning; Methodology; Methods; Paper; Positioning Attribute; Procedures; Process; Property; Reproducibility; Research; Research Personnel; Science; Scientist; Series; Software Tools; Statistical Algorithm; Statistical Methods; Teaching Materials; Techniques; Technology; Textbooks; Training; Training Activity; Training Programs; Work; biomedical data science; cloud based; data management; design; improved; live stream; massive open online courses; member; novel; open source; podcast; process repeatability; programs; skills; software development; sound; tool

Abstract Scientific progress depends on the ability of scientists to communicate the details of their investigations, allowing others to learn new techniques and procedures and to critically review the process leading to any significant findings. However, this foundational aspect of the scientific process faces significant challenges. Rapid advances in computing technology have led to high-throughput data collection coupled with the application of complex statistical algorithms for data analysis. As a result, it has become nearly impossible to describe the scientific process precisely using traditional methods of communication. Compounding the problem of communicating data analytic complexity is the inability of traditional educational programs to keep up with technological and methodological changes. The shortage of data analytic skills and the corresponding lack of transparency regarding the scientific process is at the very core of the reproducibility and replication crisis in science today. In order to address the problem of scientific irreproducibility, training is needed in the fundamental aspects of good data analysis and reproducible research. Such training needs to go beyond traditional approaches which focus on developing a toolbox of statistical methods. While knowledge of tools and their properties is necessary for good data analysis, it is far from sufficient. Additional knowledge is required to combine those tools to produce a sound data analysis in a transparent manner. Furthermore, we must go beyond traditional methods of classroom learning in order to reach the entire scientific workforce. We will build training modules for improving data science research by leveraging recent work done by members of the Johns Hopkins Data Science Lab. We will focus on two primary tracks: (1) strategies for reproducible data science, which include the higher-level principles for designing good data analyses, recognizing poor data analysis, and providing a proper critique of a data analysis; and (2) technologies and workflows, which cover the software tools for doing data analysis in a reproducible, distributable, and reusable manner. The materials developed in this project will supplement traditional training programs in biomedical data science fields and will be made entirely open source for others to use and adapt.

摘要