Socially Informed AI for Healthcare: Understanding and Generating Multimodal Nonverbal Cues
Socially Informed AI for Healthcare: Understanding and Generating Multimodal Nonverbal Cues
复制标题
用于医疗保健的社交人工智能：理解和生成多模式非语言提示
DOI：
10.1145/3462244.3480984
复制
发表时间：
2021
期刊：
影响因子：
--
通讯作者：
Celiktutan O
中科院分区：
文献类型：
--
作者：
Celiktutan O
在过去十年中，人脸和手势分析、计算副语言学、多通道交互和人机交互领域的进展都对辅助技术的研究起到了重要作用。这导致了从诊断和治疗工具到社会伴侣技术的广泛实际应用。从分析的角度来看，非语言线索提供了对精神健康和幸福的评估(即检测抑郁和疼痛)以及对发育和神经疾病(如自闭症、痴呆症和精神分裂症)的检测的理解。从综合和生成的角度来看，无论是非实体的还是实体的，辅助技术都必须能够产生吸引人的、互动的行为和干预措施，这些行为和干预是个性化的，并适应用户的需求、概况和偏好。虽然非语言提示起到了至关重要的作用，但仍有许多关键问题需要克服，这些问题既影响到多模式技术在现实世界中的发展和部署。这个多学科研讨会的主要目的是通过将计算机科学家和社会心理学家聚集在一起，讨论在医疗保健应用范围内理解和产生多模式非语言线索的创新想法、挑战和机会，从而促进交叉授粉1。
Advances in the areas of face and gesture analysis, computational paralinguistics, multimodal interaction, and human-computer interaction have all played a major role in shaping research into assistive technologies over the last decade. This has resulted in a breadth of practical applications ranging from diagnosis and treatment tools to social companion technologies. From an analytical perspective, nonverbal cues provide understanding into the assessment of mental health and wellbeing (i.e., detecting depression and pain) and the detection of developmental and neurological conditions such as autism, dementia, and schizophrenia. From both a synthesis and generative perspective, it is necessary that assistive technologies, either disembodied or embodied, are capable of generating engaging, interactive behaviours and interventions that are personalised and adapted to user’s needs, profiles, and preferences. While nonverbal cues play an essential role, there are still many key issues to overcome, which affect both the development and the deployment of multimodal technologies in real-world settings. The key aim of this multidisciplinary workshop is to foster cross-pollination by bringing together computer scientists and social psychologists to discuss innovative ideas, challenges and opportunities for understanding and generating multimodal nonverbal cues within the scope of healthcare applications1.
与虚拟患者打交道的医疗保健专业人员的非语言行为分析
DOI：
10.1145/3461615.3485442
发表时间：
2021
期刊：
Companion Publication of the 2021 International Conference on Multimodal Interaction
影响因子：
--
作者：
Jean Zagdoun;L. Chaby;Amine Benamara;Marìa;M. Chetouani
通讯作者：
M. Chetouani