Improving Reproducibility by Incorporating Uncertainty

通过纳入不确定性来提高再现性

基本信息

  • 批准号:
    10322751
  • 负责人:
  • 金额:
    $ 27.05万
  • 依托单位:
  • 依托单位国家:
    美国
  • 项目类别:
  • 财政年份:
    2019
  • 资助国家:
    美国
  • 起止时间:
    2019-02-06 至 2024-01-31
  • 项目状态:
    已结题

项目摘要

In recent years, stakeholders in the scientific and lay communities have raised alarms about a lack of reproducibility of scientific results. These stakeholders view the reproducibility crisis as a product of the behavior of researchers and editors. While these behaviors likely have an impact on reproducibility, there are credible reasons why studies of complex data should be expected to arrive at different estimates. First, each study is differentially susceptible to systematic biases, including confounding, selection bias and measurement error. These biases may be large drivers of the appearance of poor reproducibility. Second, many studies that have been criticized for lack of replication are small, and therefore subject to substantial random variability. In combination with selection forces emanating from significance testing, these small studies are likely to overestimate effects, further contributing to the appearance of poor reproducibility. To date, proposed solutions to the perceived reproducibility crisis have largely ignored these contributing factors. We propose to (a) use simulation-based quantitative bias analysis techniques to adjust for the influence of systematic errors on estimates of association and on summaries of an evidence base, and (b) use Bayesian statistical methods to synthesize prior information with estimates of association and summaries of an evidence base to reduce random variability. The premise of the proposed project is that the use of these informatics approaches will reduce the potential for systematic and random error to misleadingly portray research as poorly reproducible and will identify the most important limitations in an evidence base, which will optimize decisions regarding new data collection. The proposed informatics will be extended and applied in the context of two high profile, controversial topic areas with complex data, which will provide examples applicable to other topic areas. For both topic areas, many sources of potential bias have been identified in the surrounding discourse—as have powerful sources of prior information to temper uncertainty—but their influences on individual estimates of association and summaries of the evidence base have not been fully quantified. Quantitative adjustments for these errors using quantitative bias analysis and Bayesian methods—and for publication bias on meta-analytic summaries—would improve reproducibility. We will then extend and apply web-enabled informatics tools to implement the methods for any topic with a set of heterogeneous study results, allowing stakeholders without advanced analytic skills to tailor the underlying assumptions and see for themselves the impact on the summary results. By achieving our aims, this project will advance the use of research informatics to diminish the reproducibility crisis, help to speed consensus-building for any research topic, and productively channel research resources towards resolving the most influential sources of uncertainty in any topic area.
近年来,科学界和非专业界的利益相关者对缺乏科学知识提出了警告。 科学成果的可重复性。这些利益相关者将再现性危机视为 研究人员和编辑的行为。虽然这些行为可能会影响可重复性,但 为什么对复杂数据的研究会得出不同的估计数。一是各 研究对系统偏倚的敏感性不同,包括混杂、选择偏倚和测量 错误.这些偏差可能是再现性差的主要驱动因素。第二,许多研究表明, 已经被批评为缺乏复制是小的,因此受到很大的随机变化。在 结合显著性检验产生的选择力,这些小型研究可能会 过高估计效果,进一步导致再现性差的外观。迄今为止, 在很大程度上忽略了这些影响因素。我们建议(a)使用 基于模拟的定量偏差分析技术,以调整系统误差对 关联估计和证据基础的总结,以及(B)使用贝叶斯统计方法, 将先验信息与关联估计和证据库摘要进行综合, 随机变异性拟议项目的前提是,使用这些信息学方法将 减少系统性和随机性错误的可能性,从而误导性地将研究描述为可重复性差 并将确定证据库中最重要的限制,这将优化有关新的 数据收集。拟议的信息学将在两个高姿态的背景下得到扩展和应用, 具有复杂数据的有争议的主题领域,将提供适用于其他主题领域的示例。为 这两个主题领域,许多潜在的偏见来源已被确定在周围的话语, 强大的先验信息来源,以缓和不确定性,但它们对个人估计的影响, 证据库的关联和摘要尚未完全量化。数量调整 这些错误使用定量偏倚分析和贝叶斯方法-以及荟萃分析的发表偏倚 总结-将提高再现性。然后,我们将扩展和应用网络信息学工具, 实施方法的任何主题与一组异构的研究结果,让利益相关者没有 先进的分析技能,以调整基本假设,并看到自己的影响 总结结果。通过实现我们的目标,该项目将促进研究信息学的使用, 再现性危机,有助于加速对任何研究课题建立共识,并有效地引导 研究资源,以解决任何主题领域中最具影响力的不确定性来源。

项目成果

期刊论文数量(10)
专著数量(0)
科研奖励数量(0)
会议论文数量(0)
专利数量(0)
Yland et al. Respond to "Heuristics and Wish Bias".
伊兰等人。
  • DOI:
    10.1093/aje/kwac092
  • 发表时间:
    2022
  • 期刊:
  • 影响因子:
    5
  • 作者:
    Yland,JenniferJ;Wesselink,AmeliaK;Lash,TimothyL;Fox,MatthewP
  • 通讯作者:
    Fox,MatthewP
SAS and R code for probabilistic quantitative bias analysis for misclassified binary variables and binary unmeasured confounders.
用于错误分类二元变量和二元未测量混杂因素的概率定量偏差分析的 SAS 和 R 代码。
  • DOI:
    10.1093/ije/dyad053
  • 发表时间:
    2023
  • 期刊:
  • 影响因子:
    7.7
  • 作者:
    Fox,MatthewP;MacLehose,RichardF;Lash,TimothyL
  • 通讯作者:
    Lash,TimothyL
Application of the Adaptive Validation Substudy Design to Colorectal Cancer Recurrence.
适应性验证子研究设计在结直肠癌复发中的应用。
  • DOI:
    10.2147/clep.s230314
  • 发表时间:
    2020
  • 期刊:
  • 影响因子:
    3.9
  • 作者:
    Collin,LindsayJ;Riis,AndersH;MacLehose,RichardF;Ahern,ThomasP;Erichsen,Rune;Thorlacius-Ussing,Ole;Lash,TimothyL
  • 通讯作者:
    Lash,TimothyL
Practical data considerations for the modern epidemiology student.
现代流行病学学生的实用数据注意事项。
  • DOI:
    10.1016/j.gloepi.2021.100066
  • 发表时间:
    2021
  • 期刊:
  • 影响因子:
    0
  • 作者:
    Tran,NguyenK;Lash,TimothyL;Goldstein,NealD
  • 通讯作者:
    Goldstein,NealD
Opioid-related Mortality in United States Death Certificate Data: A Quantitative Bias Analysis With Expert Elicitation of Bias Parameters.
美国死亡证明数据中与阿片类药物相关的死亡率:专家提取偏差参数的定量偏差分析。
  • DOI:
    10.1097/ede.0000000000001600
  • 发表时间:
    2023
  • 期刊:
  • 影响因子:
    0
  • 作者:
    Goldsmith,ElizabethS;Krebs,ErinE;Ramirez,MarizenR;MacLehose,RichardF
  • 通讯作者:
    MacLehose,RichardF
{{ item.title }}
{{ item.translation_title }}
  • DOI:
    {{ item.doi }}
  • 发表时间:
    {{ item.publish_year }}
  • 期刊:
  • 影响因子:
    {{ item.factor }}
  • 作者:
    {{ item.authors }}
  • 通讯作者:
    {{ item.author }}

数据更新时间:{{ journalArticles.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ monograph.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ sciAawards.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ conferencePapers.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ patent.updateTime }}

Timothy L. Lash其他文献

Genetic variants in tamoxifen metabolism and early treatment discontinuation among premenopausal breast cancer patients
  • DOI:
    10.1007/s10549-025-07719-1
  • 发表时间:
    2025-05-14
  • 期刊:
  • 影响因子:
    3.000
  • 作者:
    Kirsten M. Woolpert;Thomas P. Ahern;James W. Baurley;Maret L. Maliniak;Per Damkier;Anders Kjærsgaard;Lindsay J. Collin;Stephen Hamilton-Dutoit;Trine Tramm;Bent Ejlertsen;Henrik T. Sørensen;Timothy L. Lash;Deirdre P. Cronin-Fenton
  • 通讯作者:
    Deirdre P. Cronin-Fenton
Real-World Risk of Severe Cytopenias in Multiple Myeloma Patients Sequentially Treated with Immunomodulatory Drugs
  • DOI:
    10.1182/blood-2022-159713
  • 发表时间:
    2022-11-15
  • 期刊:
  • 影响因子:
  • 作者:
    Julie Barberio;Timothy L. Lash;Ajay K. Nooka;Ashley I. Naimi;Rachel E. Patzer;Christopher Kim
  • 通讯作者:
    Christopher Kim
PRESERVATION OF LEFT VENTRICULAR EJECTION FRACTION WITH STATINS DURING RECEIPT OF ANTHRACYCLINE BASED CHEMOTHERAPY
  • DOI:
    10.1016/s0735-1097(12)60987-5
  • 发表时间:
    2012-03-27
  • 期刊:
  • 影响因子:
  • 作者:
    Runyawan Chotenimitkhun;Ralph B. D'Agostino Jr;Julia A. Lawrence;Craig A. Hamilton;Jennifer Jordan;Sujethra Vasu;Timothy L. Lash;W. Hundley
  • 通讯作者:
    W. Hundley
Anthropometric Measures Among Children and Teens With Classic 46,XX Congenital Adrenal Hyperplasia in Relation to Improvements in Diagnosis and Care
  • DOI:
    10.1016/j.eprac.2024.09.005
  • 发表时间:
    2024-12-01
  • 期刊:
  • 影响因子:
  • 作者:
    Courtney McCracken;Oumaima Kaabi;Mackenzie Crawford;Melissa D. Gardner;Darios Getahun;Michael Goodman;Behzad Sorouri Khorashad;Timothy L. Lash;Douglas Roblin;Suma Vupputuri;Rami Yacoub;Phyllis W. Speiser;Peter A. Lee;David E. Sandberg
  • 通讯作者:
    David E. Sandberg
Su052 DEVELOPMENT AND TEMPORAL VALIDATION OF A PREDICTION MODEL FOR RISK-STRATIFIED FIT COLORECTAL CANCER SCREENING
  • DOI:
    10.1016/s0016-5085(21)02128-4
  • 发表时间:
    2021-05-01
  • 期刊:
  • 影响因子:
  • 作者:
    Mette K. Thomsen;Lars Pedersen;Rune Erichsen;Timothy L. Lash;Henrik Toft S⊘rensen;Ellen M. Mikkelsen
  • 通讯作者:
    Ellen M. Mikkelsen

Timothy L. Lash的其他文献

{{ item.title }}
{{ item.translation_title }}
  • DOI:
    {{ item.doi }}
  • 发表时间:
    {{ item.publish_year }}
  • 期刊:
  • 影响因子:
    {{ item.factor }}
  • 作者:
    {{ item.authors }}
  • 通讯作者:
    {{ item.author }}

{{ truncateString('Timothy L. Lash', 18)}}的其他基金

Registering Cancer Recurrences in the Georgia Cancer Registry
在佐治亚州癌症登记处登记癌症复发
  • 批准号:
    10556403
  • 财政年份:
    2019
  • 资助金额:
    $ 27.05万
  • 项目类别:
Registering Cancer Recurrences in the Georgia Cancer Registry
在佐治亚州癌症登记处登记癌症复发
  • 批准号:
    10330476
  • 财政年份:
    2019
  • 资助金额:
    $ 27.05万
  • 项目类别:
Doctoral Student Workshop Co-Sponsored by the Society for Epidemiologic Research
流行病学研究学会联合主办的博士生研讨会
  • 批准号:
    8838485
  • 财政年份:
    2015
  • 资助金额:
    $ 27.05万
  • 项目类别:
Does stanniocalcin predict late breast cancer recurrence, or is it a fish story?
斯钙素是否能预测晚期乳腺癌复发,还是纯属虚构?
  • 批准号:
    8935765
  • 财政年份:
    2014
  • 资助金额:
    $ 27.05万
  • 项目类别:
Does stanniocalcin predict late breast cancer recurrence, or is it a fish story?
斯钙素是否能预测晚期乳腺癌复发,还是纯属虚构?
  • 批准号:
    8692147
  • 财政年份:
    2014
  • 资助金额:
    $ 27.05万
  • 项目类别:
New and integrated perspectives on modification of tamoxifen effectiveness
关于他莫昔芬有效性修改的新的综合视角
  • 批准号:
    8825461
  • 财政年份:
    2013
  • 资助金额:
    $ 27.05万
  • 项目类别:
New and integrated perspectives on modification of tamoxifen effectiveness
关于他莫昔芬有效性修改的新的综合视角
  • 批准号:
    8439898
  • 财政年份:
    2013
  • 资助金额:
    $ 27.05万
  • 项目类别:
New and integrated perspectives on modification of tamoxifen effectiveness
关于他莫昔芬有效性修改的新的综合视角
  • 批准号:
    8642152
  • 财政年份:
    2013
  • 资助金额:
    $ 27.05万
  • 项目类别:
New and integrated perspectives on modification of tamoxifen effectiveness
关于他莫昔芬有效性修改的新的综合视角
  • 批准号:
    8973797
  • 财政年份:
    2013
  • 资助金额:
    $ 27.05万
  • 项目类别:
Cancer Prevention and Control
癌症预防与控制
  • 批准号:
    10595769
  • 财政年份:
    2009
  • 资助金额:
    $ 27.05万
  • 项目类别:

相似海外基金

AMFaces: Advanced Additive Manufacturing of User-Focused Facial Prostheses with Real-Life Colour Appearance
AMFaces:以用户为中心的面部假体的先进增材制造,具有真实的色彩外观
  • 批准号:
    EP/W033968/1
  • 财政年份:
    2023
  • 资助金额:
    $ 27.05万
  • 项目类别:
    Research Grant
Understanding the appearance mechanism of ferroelectric liquid crystals showing spontaneous polarization in the director and developing their applications.
了解铁电液晶在指向矢中表现出自发极化的出现机制并开发其应用。
  • 批准号:
    23H00303
  • 财政年份:
    2023
  • 资助金额:
    $ 27.05万
  • 项目类别:
    Grant-in-Aid for Scientific Research (A)
Body, appearance, and health surveillance in female youth friendship contexts
女性青少年友谊背景下的身体、外表和健康监测
  • 批准号:
    2690554
  • 财政年份:
    2022
  • 资助金额:
    $ 27.05万
  • 项目类别:
    Studentship
Elucidating the mechanism in the color appearance of small-field stimulus on chromatic surroundings
阐明彩色环境中小场刺激的颜色外观机制
  • 批准号:
    22K20317
  • 财政年份:
    2022
  • 资助金额:
    $ 27.05万
  • 项目类别:
    Grant-in-Aid for Research Activity Start-up
Learning to Recognize Faces Despite Within-Person Variability in Appearance: A Developmental Approach
尽管人与人之间的外表存在差异,但仍要学习识别面孔:一种发展方法
  • 批准号:
    RGPIN-2022-04386
  • 财政年份:
    2022
  • 资助金额:
    $ 27.05万
  • 项目类别:
    Discovery Grants Program - Individual
Path-space Exploration for Light Transport and Appearance Modelling
光传输和外观建模的路径空间探索
  • 批准号:
    RGPIN-2018-05669
  • 财政年份:
    2022
  • 资助金额:
    $ 27.05万
  • 项目类别:
    Discovery Grants Program - Individual
A sociological study on appearance discrimination during employment selection
就业选择中外表歧视的社会学研究
  • 批准号:
    21K13447
  • 财政年份:
    2021
  • 资助金额:
    $ 27.05万
  • 项目类别:
    Grant-in-Aid for Early-Career Scientists
Appearance of negative influences of global warming on crop production and measures against it
全球变暖对农作物生产的负面影响的显现及应对措施
  • 批准号:
    21H02330
  • 财政年份:
    2021
  • 资助金额:
    $ 27.05万
  • 项目类别:
    Grant-in-Aid for Scientific Research (B)
The influence of river environment on urban appearance of wildlife
河流环境对野生动物城市面貌的影响
  • 批准号:
    21K12322
  • 财政年份:
    2021
  • 资助金额:
    $ 27.05万
  • 项目类别:
    Grant-in-Aid for Scientific Research (C)
Method for assessing women's perceptions of their appearance in the context of breast cancer care
评估乳腺癌护理背景下女性对其外表的看法的方法
  • 批准号:
    10196213
  • 财政年份:
    2021
  • 资助金额:
    $ 27.05万
  • 项目类别:
{{ showInfoDetail.title }}

作者:{{ showInfoDetail.author }}

知道了