Automatic Coding of Therapist and Client Language in Motivational Interviewing to Predict Reductions in Alcohol Use and Problems Using Machine-based Dyadic Multimodal Representation Learning

使用基于机器的二元多模态表示学习在动机访谈中自动编码治疗师和客户语言以预测酒精使用的减少和问题

• 批准号: 10237313
• 负责人: Stefan Scherer
• 金额: $ 55.42万
• 依托单位: UNIVERSITY OF SOUTHERN CALIFORNIA
• 依托单位国家: 美国
• 财政年份: 2019
• 资助国家: 美国
• 起止时间: 2019-09-01 至 2023-08-31
• 项目状态: 已结题
• 来源: https://reporter.nih.gov/project-details/10237313
• 关键词: Acoustics; Address; Alcohol abuse; Alcohol consumption; Algorithms; Assertiveness; Behavior; Behavior Disorders; Client; Code; Collection; Complement; Complex; Consumption; Data; Data Set; Databases; Elements; Empathy; Facial Expression; Fostering; Funding; Gestures; Individual; Investigation; Joints; Language; Learning; Link; Machine Learning; Manuals; Mediator of activation protein; Modality; Modeling; National Institute on Alcohol Abuse and Alcoholism; Pattern; Population; Population Intervention; Process; Protocols documentation; Randomized Clinical Trials; Research; Signal Transduction; Speech; System; Target Populations; Testing; Time; Training; Uncertainty; Visual; Vocabulary; Voice; Work; base; behavior change; computer framework; drinking; drinking behavior; experimental study; improved; learning strategy; motivational enhancement therapy; multi-task learning; multimodality; multitask; novel; outcome prediction; predictive modeling; skills; success; theories; therapeutically effective; tool

Despite the widespread use of Motivational Interviewing (MI), the underlying mechanisms of its success are still poorly understood [14], especially the link between client change talk and subsequent behavior change [14,69]. Previous research has identified two possible active components underlying MI efficacy: a relational component involving elements of the therapist-client dyad including the expression of empathy, and a technical component focused on the differential evocation of client behaviors such as change talk or what a client says about their commitment to change [57]. Current analyses of these components are limited to investigations pertaining to language only and restricted by expensive and arduous manual coding which, despite the time and efforts expended to achieve reliability, may still not be sufficiently sensitive or specific to adequately test the complex theoretical propositions espoused by MI theorists. Our project will address shortcomings of current MI coding systems by introducing a novel computational framework that leverages our recent advances in automatic verbal and nonverbal behavior analyses as well as multimodal machine learning. Our framework aims to jointly analyze verbal (i.e., what is being said), nonverbal (i.e., how something is said), and dyadic (i.e., in what interpersonal context something is said) behavior to better identify in-session change talk and sustain talk that is predictive of post-session alcohol use. We will leverage already collected and annotated audio data from two NIAAA- funded single-session MI randomized clinical trials to improve drinking behavior (N=91; N=158). We will disseminate our findings through an extensive collection of client and dyadic behaviors through our proposed Client and Dyadic Behavior Databases. In addition, we will validate the generalizability of our computational framework using seven additional NIAAA- and federally funded RCTs that used different MI protocols for different target populations.

尽管动机性访谈（MI）被广泛使用，但其成功的潜在机制