Use of automated lip reading to communicate with Tracheostomised Covid-19 patients

COVID大流行将导致大量患者需要在几周内脱离呼吸机。为了做到这一点，患者需要进行气管切开术。从现有患者的经验可以知道，这些患者将不会被镇静，将处于一个陌生的环境中，困惑、恐惧、虚弱和无法发声。通过利用人工智能技术，SRAVI应用程序可以唇读，然后在手持设备上将其翻译成书面或口头语言--使这些患者能够有效地与护理人员和亲属沟通。当这款应用程序指向患者时，它会捕捉患者口述短语的视频，从嘴唇的动作中破译“语音”，并发出结果。这既可以在患者床边进行，也可以在远程进行，如果他们继续具有传染性的话。这将有助于心理健康、疼痛缓解和早期康复。该项目将提供--*一个功能齐全的、能够在ICU/普通病房商业使用的SRAVI的生产性版本。*在两个(或更多)ICU使用SRAVI应用程序的可行性研究--应用程序中将内置可用性措施，以收集反馈，并允许进行应用程序的开发和评估。将从患者、家属和工作人员那里收集一系列结果衡量标准，以告知SRAVI的医疗影响和市场潜力。在后续阶段，将在现场可行性研究结束时完成的SRAVI生产性版本将准备商业化发布--然后在Android和苹果应用商店商业化推出。这个商业版本随后将在皇家普雷斯顿医院的临床环境中进行评估。此外，Liopa团队将为SRAVI服务的未来开发和运营实施内部系统和流程，以符合获得一级医疗器械认证所需的法规。

The COVID pandemic will result in large numbers of patients who need to be weaned off ventilators over several weeks. In order to do this, patients will need a tracheostomy. From experience with existing patients it is known that these patients will not be sedated, will be in an unfamiliar environment, confused, frightened, weak and unable to vocalise. By utilising AI technology the SRAVI app can lip read and then translate to written or verbalised language on a handheld device - allowing these patients to communicate effectively with carers and relatives. The App, when pointed towards the patient, will capture video of the patient mouthing phrases, decipher 'speech' from the lip movements and vocalise the result. This can be done both at the patient bedside or remotely if they continue to be infectious. This will help mental health, pain relief and early rehabilitation.The project will deliver -* A fully-featured, productised version of SRAVI capable of commercial use in ICUs/General Wards.* A Feasibility study using the SRAVI App in two (or more) ICUs - Usability measures will be built into the app to capture feedback and allow ongoing development and evaluation of the app. A range of outcome measures will be collected from patients, families and staff to inform the healthcare impact and market potential of SRAVI.In a follow-on phase the productised version of SRAVI that will be completed at the end of the on-site Feasibility Study will be prepared for commercially release - and then commercially launched on the Android and Apple App stores. This commercial version will then be evaluated in a clinical setting at Royal Preston Hospital. In addition the Liopa team will implement internal systems and processes for the future development and operation of the SRAVI service that conform to the regulations required to obtain Class 1 Medical Device certification.