Use of automated lip reading to communicate with Tracheostomised Covid-19 patients

新冠肺炎大流行将导致大量患者需要在几周内停用呼吸机。为了做到这一点，病人需要气管切开术。从现有患者的经验来看，这些患者不会被镇静，会在一个陌生的环境中，困惑，害怕，虚弱和无法发声。通过利用人工智能技术，SRAVI应用程序可以唇读，然后在手持设备上翻译成书面或口头语言，使这些患者能够与护理人员和亲属有效沟通。当这款应用程序对着病人时，它会捕捉到病人口型的视频，从嘴唇的运动中破译“语言”，并将结果发出声音。这既可以在病人床边完成，也可以在他们仍然具有传染性的情况下远程完成。这将有助于心理健康、缓解疼痛和早期康复。该项目将提供-*功能齐全的SRAVI产品化版本，能够在icu /普通病房中进行商业使用。*在两个（或更多）icu中使用SRAVI应用程序进行可行性研究-将在应用程序中内置可用性措施，以获取反馈，并允许对应用程序进行持续开发和评估。将从患者，家属和员工中收集一系列结果措施，以告知SRAVI的医疗保健影响和市场潜力。在后续阶段，SRAVI的产品化版本将在现场可行性研究结束时完成，并准备进行商业发布，然后在Android和Apple应用商店上进行商业发布。这个商业版本随后将在皇家普雷斯顿医院的临床环境中进行评估。此外，Liopa团队将为SRAVI服务的未来发展和运营实施符合获得1类医疗器械认证所需法规的内部系统和流程。

The COVID pandemic will result in large numbers of patients who need to be weaned off ventilators over several weeks. In order to do this, patients will need a tracheostomy. From experience with existing patients it is known that these patients will not be sedated, will be in an unfamiliar environment, confused, frightened, weak and unable to vocalise. By utilising AI technology the SRAVI app can lip read and then translate to written or verbalised language on a handheld device - allowing these patients to communicate effectively with carers and relatives. The App, when pointed towards the patient, will capture video of the patient mouthing phrases, decipher 'speech' from the lip movements and vocalise the result. This can be done both at the patient bedside or remotely if they continue to be infectious. This will help mental health, pain relief and early rehabilitation.The project will deliver -* A fully-featured, productised version of SRAVI capable of commercial use in ICUs/General Wards.* A Feasibility study using the SRAVI App in two (or more) ICUs - Usability measures will be built into the app to capture feedback and allow ongoing development and evaluation of the app. A range of outcome measures will be collected from patients, families and staff to inform the healthcare impact and market potential of SRAVI.In a follow-on phase the productised version of SRAVI that will be completed at the end of the on-site Feasibility Study will be prepared for commercially release - and then commercially launched on the Android and Apple App stores. This commercial version will then be evaluated in a clinical setting at Royal Preston Hospital. In addition the Liopa team will implement internal systems and processes for the future development and operation of the SRAVI service that conform to the regulations required to obtain Class 1 Medical Device certification.