Study of Multi-Modal Diary Service Using Spoken Dialogue Agent for Self-Care in Elderly People
Study of Multi-Modal Diary Service Using Spoken Dialogue Agent for Self-Care in Elderly People
复制标题
DOI：
10.1109/icoseit55604.2022.10029995
复制
发表时间：
2022-11
期刊：
影响因子：
--
通讯作者：
Sinan Chen;Masahide Nakamura
中科院分区：
文献类型：
--
作者：
Sinan Chen;Masahide Nakamura
随着日本人口老龄化和低出生率，老年人在家中的自我护理需求日益增加。尽管人工智能医疗保健的快速进步正在发展，但要记录和分析的家庭日常生活数据的多样性和可复用性仍然是难点。在我们之前的研究中，我们开发了一个利用口语对话智能体来倾听老年人想法的系统。本研究的目的是提出一种多模态日记服务，从多样化的视角记录和分析对话数据。我们的关键思路是检索文本日志、音频和图像，并进行多模态可视化。所提出的方法描述了主要步骤，包括异构数据提取、网络应用程序接口（Web API）开发、多模态日记生成以及异构数据分析。此外，我们还讨论了扩展异构数据的方法。使用所提出的方法，老年人可以更好地回忆过去。通过这种方式，为所有人正确改善家庭护理和健康管理是有希望的。
With Japan's aging population and low birth rate, the self-care of older adults at home has become increasingly in demand. Although the rapid progress of AI-enabled healthcare is developing, diversity and reusability of in-home daily living data to be recorded and analyzed are still challenging points. In our previous study, we have developed a system utilizing spoken dialogue agents for listening to the minds of older adults. The purpose of this study is to propose a multi-modal diary service that records and analyzes dialogue data with a diversified viewpoint. Our key idea is to retrieve the text logs, audio, and images and execute multi-modal visualization. The proposed method describes the main steps, including heterogeneous data extraction, Web API development, multi-modal diary generation, and heterogeneous data analysis. Also, we have discussed the approach to extending heterogeneous data. Using the proposed method, older adults can recollect the past for their own better. In this way, the correct improvement of in-home care and health management for all individuals is promising.