Administrative Supplement - Rapid Actionable Data for Opioid Response in Kentucky (RADOR-KY)

摘要 机器学习(ML)建模和基础定义中的系统和算法偏差 为了捕获阿片类药物过量，可能会导致不同群体的负担测量不准确， 潜在地导致减少和预防危害的无效和不平等分配 资源。识别和评估数据和模型偏差以及健康差距对于 有效的公共卫生实践和研究。该项目是RADOR-KY(快速)的补充 肯塔基州阿片类药物反应的可操作数据；1-R01 DA057605-01)。RADOR-KY项目 将建立一个强大的全州范围的阿片使用障碍(OUD)监测系统，包括阿片类药物 过量，集成多个数据源以监控和预测药物过量死亡率和 发病率。利益攸关方将使用该系统为数据驱动的行动提供信息，支持 协调和确定预防和治疗工作的目标。如家长拨款中所建议的 在本补充资料中，RADOR-KY系统将整合几个数据来源，包括 紧急医疗服务(EMS)数据，以开发机器学习预测模型和 预测阿片类药物过量，为公共卫生和公共安全机构的行动和 计划。RADR-KY拟议的行政补充将提高我们的理解 这些机器学习/人工智能方法的伦理方面。EMS运行数据 阿片类药物过量监测是一种很有前途的新系统，它克服了传统监测系统的局限性 数据来源，如非临床用药过量事件的长期延迟和遗漏。而当 最新国家标准完善了EMS遭遇数据的结构组成部分， 此类数据的质量和完整性仍然需要依赖于病例的患者护理描述 断言。已经提出了一系列阿片类药物过量的定义，通常侧重于 关键字匹配或其他基于规则的标准，几乎不强调定义验证， 比较评估，或人口平等。关键是，没有以前的型号，无论是机器 无论是学习还是基于规则，都在他们的方法中考虑了人口公平。利用 根据RADOR-KY的数据，我们可以访问超过350万个EMS详细遭遇记录 使用协议，以及专家标记和提取的数据，我们的目标是评估这些建议 针对我们自己的机器学习自然语言处理分类器模型，特别是 考虑到不同的人群。具体目的是：1)评估阿片类药物的潜在偏倚 过量数据和定义，并为每个特定的亚群确定适当的定义； 以及2)识别、寻址和生成偏向感知ML就绪数据集。

Abstract Systematic and algorithmic biases in machine learning (ML) modeling and underlying definitions for capturing opioid overdose may result in inaccuracies in burden measures for disparate groups, potentially leading to an ineffective and unequal distribution of harm reduction and prevention resources. Identifying and evaluating data and model biases and health disparities is critical to effective public health practice and research. This project is a supplement to RADOR-KY (Rapid Actionable Data for Opioid Response in Kentucky; 1-R01 DA057605-01). The RADOR-KY project will build a robust state-wide surveillance system for opioid use disorder (OUD) including opioid overdose, integrating multiple data sources to monitor and predict drug overdose mortality and morbidity. The system will be used by stakeholders to inform data-driven action, supporting the coordination and targeting of prevention and treatment efforts. As proposed in the parent grant for this supplement, the RADOR-KY system will integrate several data sources, including Emergency Medical Services (EMS) data, to develop machine learning predictive models and forecasting for opioid overdoses to inform public health and public safety agencies’ actions and planning. The proposed administrative supplement of RADR-KY will improve our understanding of the ethical aspects of these machine learning/artificial intelligence methods. EMS run data for opioid overdose surveillance is a promising new system that overcomes limitations of traditional data sources, such as prolonged delays and omission of non-clinical overdose events. While recent national standards have improved the structural components of EMS encounter data, the quality and completeness of such data still necessitate reliance on patient care narratives for case assertion. There have been a host of opioid overdose definitions proposed, typically focused on keyword matches or other rule-based criteria, with little emphasis on definition validation, comparative evaluations, or demographic parity. Critically, no previous models, whether machine learning or rule-based, have considered demographic fairness in their approaches. Leveraging our access to over 3.5 million EMS detailed encounter records access under RADOR-KY’s data use agreement, along with expert-labeled and extracted data, we aim to assess these proposed models against our own machine learning natural language processing classifier, particularly considering disparate populations. The specific aims are to 1) Evaluate potential bias in the opioid overdose data and definitions and identify suitable definitions for each specific sub-population; and 2) Identify, address, and generate bias-aware ML-ready datasets.