I-Corps: Medication Adherence System

这个i-Corps项目的更广泛的影响/商业潜力是提高护士和护理人员以及任何需要管理/验证药物(注射和药丸)的人的能力，并防止潜在的人为错误。这是非常必要的，因为众所周知，用药错误会损害患者的安全，损害患者对医疗保健系统的信心，增加患者的医疗成本，并对患者的生活质量产生不利影响。这将通过促进患者、家庭和医疗保健提供者之间的信任来帮助社会。此外，该项目的更广泛影响超出了医疗保健提供者、护士、护理员、疗养院护士以及与普通公众类似的人群，因为任何人都可能发生服用错误药物的情况。此外，该工具将提供防止出错次数的新数据，用于培训医务人员和所有公众关于发生此类错误的可能性。该i-Corps项目基于为增强现实设备(包括智能手机和增强现实眼镜)开发的人工智能增强的药物管理软件，以实现在护理点移动、准确和自动验证药物。通过这种增强现实应用，患者身份识别和药物信息检索是第一步，其中通过人脸或条形码识别验证患者身份，并从电子健康记录系统检索药物信息。该系统通过条形码扫描或神经网络验证药物名称和时间，并通过定制的深度学习框架识别注射剂量/体积。该系统还提供注射路线的提醒指示和提醒，并自动将图像和核实的信息保存到记录系统中，以供记录。为了提高系统对不利环境的稳健性，如不完美的视点、环境光/背景和物体的低分辨率，还采用了多阶段图像处理程序，从简单的人类直觉中获得灵感。该奖项反映了NSF的法定使命，并通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。

The broader impact/commercial potential of this I-Corps project is to enhance the capabilities of nurses and caregivers as well as anyone who needs to administer/verify the medications (injection and pill) and prevent potential human errors. It is very essential as medication administration errors are known to be detrimental to patient safety, compromise patients’ confidence in the healthcare system, increase patient’s healthcare costs, and adversely affect the patient’s quality of life. This will help society by promoting trust between patients, families, and healthcare providers. Moreover, the broader impact of this project goes beyond the healthcare providers, nurses, caregivers, nursing home nurses, and similar ones to the general public as taking wrong medication could occur to anyone. Furthermore, the tool would provide new data on the number of times mistakes were prevented for training of the medical staff as well as all general public on the possibility of such errors.This I-Corps project is based on the development of an artificial intelligence-enhanced medication administration software for Augmented Reality devices (including smartphone and Augmented Reality glasses) to enable mobile, accurate and automatic verification of medication at the point of care. Via this Augmented Reality application, patient identification and medication information retrieval are the first steps, where patient identification is verified through face or barcode recognition, and medication information is retrieved from the electronic health record system. The system verifies medication name and time through barcode scanning or neural network, and a custom-designed deep learning framework recognizes injection dose/volume. This system also provides heads-up instructions and reminders for injection routes, and automatically saves images and verified information into the records system for documentation purposes. To improve the system’s robustness to the adverse environment, such as imperfect viewpoint, ambient light/background, and low resolution of the object, a multi-stage image processing procedure is also incorporated by drawing inspiration from simple human intuitions.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.