Gesture Recognition in Aphasia Therapy

失语症治疗中的手势识别

• 批准号: EP/I001824/1
• 负责人: Stephanie Wilson
• 金额: $ 37.88万
• 依托单位: City, University of London
• 依托单位国家: 英国
• 项目类别: Research Grant
• 财政年份: 2010
• 资助国家: 英国
• 起止时间: 2010 至 无数据
• 项目状态: 已结题
• 来源: https://gtr.ukri.org/projects?ref=EP%2FI001824%2F1
• 关键词: Gesture; Recognition; Aphasia; Therapy

Aphasia is a language disorder, usually caused by stroke. It affects a substantial number of people; there are about 250,000 people living with aphasia in the UK and approximately 45,000 new cases each year. People with aphasia have difficulty with all aspects of communication: speaking, reading and writing. The negative effects of aphasia can be immense and are not confined to the affected person but are also felt by the immediate family and social circle.One approach advocated by therapists is for the aphasic person to communicate using gestures, but this also poses challenges as the ability to produce and understand gestures may be impaired. In recent research we have investigated whether gesture production can be enhanced by therapy and the initial evidence from face-to-face therapy is encouraging. However gesture therapy is resource-intensive and this has motivated our proposal.Our goal is to develop and pilot an innovative gesture training tool to be used in aphasia therapy at home. This will build on our existing work on non-computer based therapy and there is no previous published research in this area. Our approach to achieving this goal will be to refine and adapt existing gesture recognition technology, incorporating it within a training package that we will develop. In so doing, we will refine and exploit existing research into gesture recognition and gesture-based interaction, utilising mainstream interaction devices such as the Nintendo Wii remote and open source software. We will investigate appropriate forms of gesture recognition and feedback for this user community.The development of the tool will address several fundamental issues: it needs to recognise a substantial set of gestures that are relevant to the aphasic user and can be trained by the therapist; it must not be over-sensitive as gesture production is likely to be variable and inaccurate; we need to understand and incorporate appropriate forms of training and feedback in the tool.Research in the wild is integral to this proposal. Close engagement with the user community will be facilitated by our project partner, the Stroke Association. Aphasic people will be employed as consultants in exploring and evaluating gesture recognition technologies as the design and development of the therapy tool progresses. In the later stages of the project, a pilot study will be conducted with 10 people who have severe aphasia to investigate the therapeutic efficacy of the tool as well as its broader acceptability.The potential transformational impact of using gesture-recognition technology in therapy is significant. Given the numbers of people affected by aphasia, the provision of a therapeutically effective, low-cost, gesture training tool would be of substantial benefit.

失语症是一种语言障碍，通常由中风引起。它影响了相当多的人;在英国大约有250，000人患有失语症，每年大约有45，000例新发病例。失语症患者在沟通的各个方面都有困难：说，阅读和写。失语症的负面影响可能是巨大的，不仅限于受影响的人，而且直系亲属和社交圈也能感受到。治疗师提倡的一种方法是让失语症患者使用手势进行交流，但这也带来了挑战，因为产生和理解手势的能力可能会受损。在最近的研究中，我们调查了手势的产生是否可以通过治疗来增强，面对面治疗的初步证据令人鼓舞。然而，手势治疗是资源密集型的，这促使我们的建议。我们的目标是开发和试点一个创新的手势训练工具，用于失语症治疗在家里。这将建立在我们现有的非计算机治疗工作的基础上，在这一领域没有以前发表的研究。我们实现这一目标的方法将是改进和调整现有的手势识别技术，将其纳入我们将开发的培训包。在这样做的过程中，我们将完善和利用现有的研究手势识别和基于手势的交互，利用主流的交互设备，如任天堂Wii遥控器和开源软件。我们将调查适当形式的手势识别和反馈，为这个用户社区。该工具的发展将解决几个基本问题：它需要识别一个实质性的一套手势，是相关的失语症用户，可以由治疗师训练;它不能过于敏感，因为手势的生产可能是可变的和不准确的;我们需要理解并在工具中纳入适当形式的培训和反馈。2野外研究是这个提议的组成部分。我们的项目合作伙伴中风协会将促进与用户社区的密切接触。随着治疗工具的设计和开发的进展，失语症患者将被聘为探索和评估手势识别技术的顾问。在该项目的后期阶段，将对10名患有严重失语症的人进行试点研究，以调查该工具的治疗效果及其更广泛的可接受性。在治疗中使用手势识别技术的潜在变革影响是显着的。考虑到失语症患者的数量，提供一种治疗有效、低成本的手势训练工具将有很大的好处。

项目成果

Accessibility of 3D game environments for people with Aphasia

失语症患者可以使用 3D 游戏环境

• DOI: 10.1145/2049536.2049562
• 发表时间: 2011
• 作者: Galliers J

Aphasia therapy and computer interaction design shake hands: testing a novel computer tool for gesture therapy in aphasia

失语症治疗与计算机交互设计握手：测试一种用于失语症手势治疗的新型计算机工具

• 发表时间: 2012
• 作者: Roper A

Codesign for people with aphasia through tangible design languages

通过有形的设计语言为失语症患者进行协同设计

• DOI: 10.1080/15710882.2014.997744
• 发表时间: 2015
• 期刊: CoDesign
• 影响因子: 1.8
• 作者: Wilson S

An exploratory study into the accessibility of a multi-user virtual world for young people with aphasia

关于失语症年轻人的多用户虚拟世界可访问性的探索性研究

• 发表时间: 2013
• 作者: Galliers J