A Framework for Evaluating Diagnostic Imaging Artificial Intelligence Medical Tools

点击翻译按钮获取中文摘要

The project intended aims and Objectives1) A working methodology for the design, evaluation & introduction of AI into existing Radiology workflow2) Design & clinical evaluation toolkit for clinical staff3) Good practice to be used during design that promotes trust in the product4) Pre-procurement/deployment evaluation toolkit5) Good practice guide to purchasing AI systems6) Post procurement/deployment toolkit7) Good practice guide to deploying an AI system into an existing workflow - engagement frameworkFor the Academy:1) Research papers involving NIAW based authors2) Enhanced toolkit for evaluation, service implementation and educationPractically:Minimum of two sites for workshop & co-design, C&V and CTM UHBs, centred on a couple of Radiologists but this can expand depending upon the engagement as we discussed.Other sites may wish to be involved and that would be a joint engagement exercise as we discussed (other Health Boards and Trusts). Other Groups of Radiology Reporter involvement could be considered and will enhance the project (Reporting Radiographers, Radiology Trainees) NHS X involvement - this would be beneficial, and involvement and/ or collaboration could be discussed.The PhD timelineIn years 1 and 2, the student will need to work with the various stakeholders to organise co-design workshops and other forms of elicitation studies to inform planning for what needsto be considered in such frameworks. This will require focusing on specific case-studies, and then working in a generative fashion to identify commonalities in which a common framework can be built upon. The specific methodologies employed will be decided by the student in partnership with the supervision team and PhD partner, responding to the student's understanding and the specific information needs they identify. A number have been proposed as part of this project (e.g., ethnographies, interviews, workshops, design fictions) and it is likely a mixture of these will be appropriate. During the second year, the student should be able to present multiple iterations of draft frameworks, while continuing to employ human-centred approaches to evoking reflections and guidance from stakeholders to further develop their framework, as well as developing guidance for how it can be used. This work may take the form of interactive co-design sessions where the draft framework is put into practice (e.g. with existing technologies or prototypes developed by the student). Through this the developed framework will evolve. PhD contributions In addition to producing the framework and guidance for its practical use-something that is lacking in the UK currently-the student will produce academic publications documenting their research practice for publication. The deliverables of the project will be of significant value for the stakeholder, and the academic and practical outcomes of the project hold the potential to shape procurement practice in many healthcare contexts in and outside of Wales.