Research-Reporting Fidelity within Dietary Weight-Loss Supplement Scientific Literature

膳食减肥补充剂科学文献中研究报告的保真度

• 批准号: 9136649
• 负责人: Cynthia M. Kroeger
• 金额: $ 5.78万
• 依托单位: UNIVERSITY OF ALABAMA AT BIRMINGHAM
• 依托单位国家: 美国
• 财政年份: 2015
• 资助国家: 美国
• 起止时间: 2015-08-24 至 2017-08-23
• 项目状态: 已结题
• 来源: https://reporter.nih.gov/project-details/9136649
• 关键词: Area; Biomedical Research; Body Weight decreased; Communities; Confidence Intervals; Control Groups; Coupling; Data; Data Collection; Decision Making; Diet; Evaluation; Fellowship; Fostering; Frequencies; Future; Health; Individual; Learning; Literature; Marketing; Medical; Meta-Analysis; Methodology; Methods; Monitor; Nobel Prize; Obesity; Paper; Participant; Peer Review; Persons; Press Releases; Prevalence; Procedures; Public Health; Quality of life; Randomized Controlled Trials; Reporting; Reproducibility; Research; Research Methodology; Research Personnel; Resources; Review Literature; Sampling; Science; Scientist; Speed; Statistical Methods; Tail; Techniques; Testing; Training; Training Activity; United States National Institutes of Health; Weight; career; case-based; clinical practice; crowdsourcing; design; dietary supplements; education research; efficacy testing; evidence base; implementation research; improved; insight; learning strategy; novel; programs; randomized trial; theories; trial design

 DESCRIPTION (provided by applicant): Research reporting fidelity refers to the integrity involved with making decisions about how to analyze and present data in scientific papers, talks, and press releases, such that our data and the methods used to generate them are described without artifice, without exaggeration, and with sufficient detail for other scientists t judge and replicate our methods. A current concern within health research is compromised research- reporting fidelity in many domains of inquiry. However, the literature on dietary weight-loss supplements may contain some of the most pervasive and egregious breaches. As a nation where the majority of individuals struggle with obesity, dietary weight-loss supplements are a popular resource used to lose weight. Any gap between evidence-based science and conclusions drawn about weight-loss supplements is of concern to biomedical research and to public health, given the number of studies conducted on these supplements and the number of persons taking such supplements. The objective of this proposal is to focus on two particular concerns: (1) a phenomenon commonly referred to as "p-hacking" defined as reanalyzing data using various tests until a p-value below the nominal alpha level is obtained, thus inflating the chances of obtaining false positive results, and (2) common errors in the calculation of effect sizes in meta-analytic research. This proposal aims to assess the magnitude of these problems, thereby laying a baseline for the evaluation of future progress in mitigating these problems, and to test an educational program to mitigate one of these problems. The first aim is to determine the prevalence of p-hacking within weight-loss supplement literature with unprecedented magnitude, speed, and efficiency by combining sophisticated statistical methods, such as multiple imputation and double sampling, as well as by employing the use of crowdsourcing. The second aim is to determine the frequency of effect size estimation errors that occur within peer-reviewed meta-analyses conducted on dietary weight-loss supplements, by systematically reviewing meta-analyses conducted on weight-loss supplements. The third aim is to develop and test the efficacy of three brief training modules for early career investigators designed to enhance effect-size estimation data reproducibility using weight-loss supplement meta-analyses, by conducting a simple randomized controlled trial. The methodological advances this proposal aims to foster will enhance the technical capabilities of future researchers who wish to employ the use of multiple imputation, double sampling, and crowdsourcing to investigate questions requiring the extraction of large amounts of detailed information from existing scientific literature. Additionally, the results obtained from this project will help improve the accuracy and reproducibility of dietary weight-loss supplement research, making accurate scientific information more accessible to the novice, the broader scientific community, regulatory agencies, medical decision makers, and for public health to help improve the health and life quality of persons taking, or considering taking, dietary supplements for weight loss.

 描述（由申请人提供）：研究报告的保真度是指在科学论文、演讲和新闻稿中分析和呈现数据的决策所涉及的完整性，这样我们的数据和用于生成数据的方法的描述就不会矫揉造作、不夸张，并且有足够的细节，以便其他科学家判断和复制我们的方法。当前健康研究中的一个问题是许多调查领域的研究报告保真度受到损害。然而，有关膳食减肥补充剂的文献可能包含一些最普遍和最严重的违规行为。作为一个大多数人都在与肥胖作斗争的国家，膳食减肥补充剂是一种流行的减肥资源。考虑到对这些补充剂进行的研究数量以及服用此类补充剂的人数，基于证据的科学与减肥补充剂得出的结论之间的任何差距都会引起生物医学研究和公共卫生的关注。该提案的目的是关注两个特定问题：(1) 通常被称为“p-hacking”的现象，定义为使用各种测试重新分析数据，直到获得低于标称 alpha 水平的 p 值，从而增加获得假阳性结果的机会；(2) 荟萃分析研究中计算效应量时的常见错误。该提案旨在评估这些问题的严重程度，从而为评估未来缓解这些问题的进展奠定基础，并测试缓解其中一个问题的教育计划。第一个目标是通过结合复杂的统计方法（例如多重插补和双采样）以及使用众包，以前所未有的规模、速度和效率确定减肥补充剂文献中 p-hacking 的流行程度。第二个目标是通过系统地审查对减肥补充剂进行的荟萃分析，确定对膳食减肥补充剂进行的同行评审荟萃分析中发生效应大小估计错误的频率。第三个目标是为早期职业研究人员开发和测试三个简短培训模块的有效性，这些模块旨在通过进行简单的随机对照试验，使用减肥补充剂荟萃分析来增强效果大小估计数据的可重复性。该提案旨在促进的方法论进步将提高未来研究人员的技术能力，他们希望利用多重插补、双重抽样和众包来调查需要从现有科学文献中提取大量详细信息的问题。此外，该项目获得的结果将有助于提高膳食减肥补充剂研究的准确性和可重复性，使新手、更广泛的科学界、监管机构、医疗决策者和公共卫生更容易获得准确的科学信息，以帮助改善服用或考虑服用减肥膳食补充剂的人的健康和生活质量。