A Computerized Adaptive Testing Version of the ASI

ASI 的计算机化自适应测试版本

• 批准号: 7903746
• 负责人: Stephen F Butler
• 金额: $ 75.29万
• 依托单位: INFLEXXION, INC.
• 依托单位国家: 美国
• 财政年份: 2007
• 资助国家: 美国
• 起止时间: 2007-04-01 至 2013-04-30
• 项目状态: 已结题
• 来源: https://reporter.nih.gov/project-details/7903746
• 关键词: Achievement; Address; Adherence; Administrator; Adult; Alcohol or Other Drugs use; Alcohols; Area; Arts; Client; Clinical; Clinical Research; Communities; Computers; Country; Data; Data Collection; Databases; Development; Employment; Evolution; Family; Foxes; Gold; Individual; Internet; Interview; Legal; Length; Light; Logic; Measurement; Measures; Mediating; Medical; Multimedia; Nature; Outcome; Performance; Pharmaceutical Preparations; Phase; Positioning Attribute; Psychometrics; Public Health; Qualitative Evaluations; Research Activity; Research Personnel; Sampling; Screening procedure; Severities; Simulate; Site; Substance Use Disorder; Substance abuse problem; System; Technology Assessment; Testing; Thinking; Time; Treatment outcome; Trees; Update; Work; addiction; base; computerized; cost; experience; flexibility; follow up assessment; indexing; meetings; patient population; population based; prototype; public health relevance; response; social; substance abuse treatment; success; theories; tool

DESCRIPTION (provided by applicant): This Phase II application proposes to continue development of the ASI-MV-CAT, a Computer Adaptive Testing edition of Inflexxion's popular Addiction Severity Index-Multimedia Version (ASI-MV). Built on the ASI, probably the most widely used adult assessment for substance use problems in the US, the ASI-MV provides a reliable, valid and cost-effective version for all clinical and research purposes. The Internet connectivity of ASI-MV Connect allows automated collection of data in a manner that is compatible with clinical and administrative systems. The ASI-MV is currently used at more than 500 sites throughout the country and is administered nearly a hundred thousand individuals annually. Despite its substantial commercial success, the current version of the ASI-MV suffers from some of the psychometric problems inherent in the ASI itself. Developed more than quarter century ago, concerns have mounted about the psychometric performance of the ASI, particularly as evaluated in light of modern thinking. Furthermore, profound changes in the nature of the substances abused, patient populations, and treatments have occurred during the past 25 years. Thus, the ASI and, by extension, the ASI-MV do not meet all critical assessment and treatment needs of administrators, researchers, and clinicians. The ASI-MV-CAT is intended to update the ASI and to provide the option for brief, but state-of-the-art, assessment. The ASI-MV has amply demonstrated the feasibility of using computer- mediated administration of the ASI. Based on principles of Item Response Theory (IRT), a computer adaptive testing (CAT) version of the ASI-MV will permit improvement in several, related measurement concepts: (1) scaling and dimensionality of derived scores, (2) interval measurement of clients' problem severity, (3) overall adherence to scientific measurement principles and hence, (4) applicability of measurement data to statistical analyses. CAT also permits a quick ASI screening or follow-up assessment that could potentially reduce administration time 50% to 80%. In Phase I, the Specific Aims were accomplished utilizing a large database of ASI-MV Connect assessments (N = 23,400). A comprehensive examination of the psychometric (classical test theory-CTT and IRT) status of the existing ASI items for all ASI domains was conducted. While some domain items performed better than others, each domain was found to require updating and improvement. Two pools of potential new items were generated for the employment and psychiatric domains. Phase II will see the completion of four Specific Aims: (1) development and qualitative evaluation of new pools of items for the remaining ASI domains (medical, alcohol, drug, legal, and family/social), (2) comprehensive psychometric analyses of the entire item bank on a large number of clients in treatment for substance use disorders and a community, non-clinical sample, (3) creation of a fully functioning prototype of an ASI-MV-CAT, and (4) empirical tests of validity and sensitivity to change of the ASI-MV-CAT. These steps will result in a new and more powerful version of the ASI that will represent a significant advance in the evolution of this important tool. PUBLIC HEALTH RELEVANCE: The ASI is the gold standard assessment for individuals in substance abuse treatment. Since its creation, changes in the substances abused, patient populations, treatments, and psychometric standards suggest the need for an updated version. The proposed ASI-MV-CAT would address this need and permit flexible and efficient administration options, updated content, and could be rapidly disseminated. The ASI-MV-CAT will have major public health importance and significant commercial potential.

描述（由申请人提供）：该II期申请建议继续开发ASI-MV- cat，这是inflexion流行的成瘾严重程度指数多媒体版本（ASI-MV）的计算机自适应测试版本。ASI可能是美国最广泛使用的成人物质使用问题评估，ASI- mv为所有临床和研究目的提供了可靠、有效和经济的版本。ASI-MV Connect的互联网连接允许以与临床和管理系统兼容的方式自动收集数据。ASI-MV目前在全国500多个地点使用，每年有近10万人接受管理。尽管在商业上取得了巨大的成功，但ASI- mv的当前版本仍然存在一些ASI本身固有的心理测量问题。早在25年前，人们就开始关注ASI的心理测量表现，尤其是根据现代思维进行评估时。此外，在过去25年中，滥用药物的性质、患者人数和治疗方法都发生了深刻的变化。因此，ASI和ASI- mv不能满足管理人员、研究人员和临床医生的所有关键评估和治疗需求。ASI- mv - cat旨在更新ASI，并提供简要但最先进的评估选项。ASI- mv充分证明了使用计算机介导的ASI管理的可行性。基于项目反应理论（IRT）的原则，ASI-MV的计算机自适应测试（CAT）版本将允许改进几个相关的测量概念：(1)衍生分数的缩放和维度，(2)客户问题严重程度的间隔测量，(3)对科学测量原则的总体遵守，因此，(4)测量数据对统计分析的适用性。CAT还允许快速ASI筛查或随访评估，可能会将给药时间缩短50%至80%。在第一阶段，具体目标是利用ASI-MV连接评估的大型数据库完成的（N = 23,400）。对所有ASI领域现有ASI项目的心理测量（经典测试理论- ctt和IRT）状态进行了全面检查。虽然一些领域项目比其他领域项目表现得更好，但发现每个领域都需要更新和改进。就业和精神病学领域产生了两个潜在的新项目池。第二阶段将完成四个具体目标：(1)为剩余的ASI领域（医学、酒精、毒品、法律和家庭/社会）开发和定性评估新的项目库，(2)对大量接受药物使用障碍治疗的客户和社区、非临床样本的整个项目库进行全面的心理测量分析，(3)创建一个功能完整的ASI- mv - cat原型，(4)对ASI- mv - cat变化的有效性和敏感性的实证测试。这些步骤将产生一个新的、更强大的ASI版本，它将代表这个重要工具的重大进步。