课题基金 / 基金详情

项目摘要

项目成果

Christiane M Hakim的其他基金

相似基金

相关文献

中文摘要
翻译
描述(申请人提供):回顾性观察者性能研究已经成为用于生成关于临床实践中的预期性能的推断的最常用的方法,因为其中观察者成为诊断系统的组成部分的前瞻性评估是昂贵的、难以执行的、耗时的,并且通常在新技术和/或实践已经被大量用户批准并实践了一段时间之后执行。一般认为,回顾性研究的结果可以用来推断,至少在相对规模上, 发生在实际的临床实践中。不幸的是,以前的研究表明,观察员的行为显着不同,在回顾性研究,而不是在解释实际的临床检查,影响病人的护理。与这些推论有关的重要问题之一是观察员的培训。虽然有迹象表明,在实验室中,疾病流行率对表现的影响很小,如果有的话,但培训的影响,以及同样重要的是,疾病流行率在培训集中可能产生的影响尚未得到研究。这可能是最重要的,因为当实施新技术或实践时,不仅整体性能而且“操作点”对于临床应用非常重要。如果一个新的系统或做法确实更好(即,沿着沿着“较高”曲线执行),实际上增加的灵敏度和/或特异性(或两者的组合)之间的折衷可能很大程度上取决于观察者在研究之前如何被专门训练(即,在训练期间特别强调敏感性或特异性)。本研究中要检验的主要假设是,训练集中的疾病患病率可能会影响观察者的实际操作点,但观察者将主要沿着成像系统或实践(固有)而不是特定训练集确定的性能曲线(ROC或FROC类型)操作。因此,临床实践也可能受到培训期间特定重点的显着影响。我们建议通过进行一项独特的观察者研究来调查这一问题,在该研究中,当阅读相同的病例集时,在不同的训练集中将呈现出实质上不同的疾病患病率水平。如果我们的主要假设被证明,那么,通过提供具有特定强调的训练,特定训练可以用于通过强调期望的参数(即,灵敏度、特异性或两者的组合)。因此,拟议的调查对于在新技术和做法的评估和批准过程中接受观察员研究极为重要。一个实际的例子,导致批准一项新技术的延迟超过两年,因为一个“临床上不希望的”工作点的变化直接证明了这项研究的重要性。
英文摘要
DESCRIPTION (provided by applicant): Retrospective observer performance studies have become the most commonly used approach for generating inferences as to the expected performance in the clinical practice, since prospective assessments in which the observer becomes an integral part of the diagnostic system are expensive, difficult to perform, time consuming, and are generally performed after a new technology and / or a practice has been approved and been in practice for a while by a large number of users. The general belief is that findings from retrospective studies can be used to infer, at least on a relative scale, what should occur in actual clinical practice. Unfortunately, previous studies have shown that observers behave significantly different in retrospective studies than during interpretations of actual clinial examinations that affect patient care. One of the important issues related to these inferences is the training of observers. While there are indications that, in the laboratory, disease prevalence has little, if any, effect on performance, the effect of training and, as important, the possible effect of disease prevalence in the training set has not been investigated. This may be of utmost importance, as not only the overall performance but also the "operating point", when implementing new technologies or practices is very important for clinical applications. If a new system or practice is indeed better (i.e., performs along a "higher" curve), the tradeoff between actually increasing sensitivity and / or specificity (or a combination of both) may largely depend on how observers are specifically trained prior to a study (i.e., a particular emphasis on sensitivity or specificity during training). The primary hypothesis to be tested in this study is tat disease prevalence in training sets could, and likely would, affect actual operating points of observers, but observers will largely operate along a performance curve (ROC or FROC type) that is determined by (inherent to) the imaging system or practice rather than the specific training set. Therefore, a clinical practice could also be significantly affected by a specific emphasis during training. We propose to investigate this issue by performing a unique observer study in which substantially different disease prevalence levels will be presented in different training sets while being tested when reading the same case set. If our primary hypothesis is proved, then, by providing training with a specific emphasis, specific training could be used to optimize the intended the clinical practice by emphasizing the desired parameter (i.e., sensitivity, specificity or a combination of both). Thus, the proposed investigation will be extremely important for acceptance of observer studies in the assessment and approval process of new technologies and practices. An actual example that resulted in the delay of approving a new technology by more than two years because of a "clinically undesirable" shift in operating points demonstrates directly the importance of this study.
期刊论文(0)
专著(0)
科研奖励(0)
会议论文
Training Effects on Observer Operating Points in Technology Assessment Studies
DBT use in repeat breast screening examinations_a performance assessment study
DBT use in repeat breast screening examinations_a performance assessment study
DBT use in repeat breast screening examinations_a performance assessment study
海外基金