Development of a Multimodal Lifelogging Platform to Support Self-Reflection & Monitor Inflammation Associated With the Experience of Negative Emotions

开发多模式生活记录平台以支持自我反思

• 批准号: EP/M029484/1
• 负责人: Chelsea Dobbins
• 金额: $ 12.61万
• 依托单位: Liverpool John Moores University
• 依托单位国家: 英国
• 项目类别: Research Grant
• 财政年份: 2015
• 资助国家: 英国
• 起止时间: 2015 至 无数据
• 项目状态: 已结题
• 来源: https://gtr.ukri.org/projects?ref=EP%2FM029484%2F1
• 关键词: Development; Multimodal; Lifelogging; Platform; Support

The project will develop a mobile lifelogging platform that will deliver measures of cardiovascular disease in an everyday situation, such as driving a car. Driving represents a common daily activity, where experiences and expressions of anger have implications for health and safety. As such, this activity can be associated with high levels of negative emotions that have a cumulative impact on long-term health.Lifelogging is the continuous act of recording and documenting our lives, from the things we do, to the places we visit and even our feelings. Wearable cameras and body sensors allow us to capture rich information from multiple data sources about ourselves. As sensors become more prevalent, within our environment, the range of available data is increasing. This has enabled lifelogs to become richer with information and their use in various application domains, such as digital health, is increasing. The project will explore how multiple streams of physiological and contextual data can be processed and integrated in real-time to detect the user's state. Measures such as heart rate, pulse wave velocity (PWV), speed of the vehicle, location, and first-person photographs of the environment will be brought together to identify instances of anger and inflammation. A range of signal processing approaches will be applied to these data items (e.g. inter-beat interval from the heart rate will be subjected to Fast Fourier Transform) and artefacts will be identified and either removed or incorporated in real-time. Currently, it is straightforward to log overt aspects of behaviour, such as photographs, location and movement. However, this project will combine those markers with covert changes in cardiovascular physiology, which aren't perceived directly by the user. Hence, the project is extending a person's awareness of their bodies, how their behaviour and reactions to situations are directly impacting their bodies and the triggers for such behaviour, e.g. traffic congestion at a junction may raise our heart rate, without the user being consciously aware of this physiological change. Repeating this stressful behaviour daily, over a sustained period, could contribute to the development of cardiovascular disease. Reviewing moments when arterial inflammation occurs and understanding the context of this behaviour leads to an enhanced perception of how daily events affect health. This can lead to positive changes to the person's lifestyle, such as avoiding the junction in question to help prevent triggers leading to the onset of cardiovascular disease.The system will provide a new method to monitor and influence behaviour, which enables us to enhance and bring the field of lifelogging into alignment with advances in digital health. This is achieved using markers that are clinically relevant in the context of lifelogging technologies and developing techniques to process multi-modal signals in real-time. To the best of the author's knowledge, the integration of such biomedical markers that measures physiological changes in context to prevent the onset of disease has not been addressed in any other developments. Overall, the project attempts to reduce a significant real-world problem with an advanced mobile lifelogging platform. The platform will be evaluated in a real-world scenario to assess its capabilities outside of an artificial environment. This will enable us to gauge its robustness as a real and practical solution to log and quantify behaviour. In this way, the data collected will be used to identify moments of arterial inflammation and the context of those times to promote self-reflection and the implementation of behavioural changes.

该项目将开发一个移动的生活记录平台，在日常情况下（如驾驶汽车）提供心血管疾病的测量。驾驶是一种常见的日常活动，其中愤怒的经历和表达对健康和安全有影响。因此，这种活动可能与高水平的负面情绪有关，对长期健康产生累积影响。生活日志是记录和记录我们生活的持续行为，从我们做的事情，到我们访问的地方，甚至我们的感受。可穿戴摄像头和身体传感器使我们能够从多个数据源中捕获关于自己的丰富信息。随着传感器变得越来越普遍，在我们的环境中，可用数据的范围正在增加。这使得生活日志能够变得更加丰富，并且它们在各种应用领域（例如数字健康）中的使用正在增加。该项目将探索如何实时处理和整合多个生理和上下文数据流，以检测用户的状态。心率、脉搏波速度（PWV）、车辆速度、位置和环境的第一人称照片等指标将被结合在一起，以识别愤怒和炎症的情况。将对这些数据项应用一系列信号处理方法（例如，将对来自心率的心跳间间隔进行快速傅立叶变换），并且将识别伪影并实时去除或合并伪影。目前，记录行为的公开方面，如照片，位置和运动是直截了当的。然而，该项目将联合收割机结合这些标记与心血管生理学的隐蔽变化，这是用户无法直接感知的。因此，该项目正在扩展一个人对自己身体的认识，他们的行为和对情况的反应如何直接影响他们的身体以及这种行为的触发因素，例如，交叉路口的交通拥堵可能会提高我们的心率，而用户没有意识到这种生理变化。每天重复这种压力行为，持续一段时间，可能会导致心血管疾病的发展。回顾动脉炎症发生的时刻，并了解这种行为的背景，可以增强对日常事件如何影响健康的认识。这可以给人的生活方式带来积极的改变，例如避免出现相关路口，以帮助预防导致心血管疾病发作的触发因素。该系统将提供一种监测和影响行为的新方法，使我们能够增强并使生活记录领域与数字健康的进步保持一致。这是通过使用在生命记录技术和开发实时处理多模态信号的技术的背景下与临床相关的标记来实现的。据作者所知，这种生物医学标记物的整合，测量环境中的生理变化，以防止疾病的发作还没有解决在任何其他的发展。总的来说，该项目试图通过先进的移动的生活记录平台来减少一个重大的现实问题。该平台将在真实世界的场景中进行评估，以评估其在人工环境之外的能力。这将使我们能够衡量其作为记录和量化行为的真实的实用解决方案的鲁棒性。通过这种方式，收集的数据将用于识别动脉炎症的时刻以及这些时间的背景，以促进自我反思和实施行为改变。

项目成果

Signal Processing of Multimodal Mobile Lifelogging Data Towards Detecting Stress in Real-World Driving

• DOI: 10.1109/tmc.2018.2840153
• 发表时间: 2019-03-01
• 期刊: IEEE TRANSACTIONS ON MOBILE COMPUTING
• 影响因子: 7.9
• 作者: Dobbins, Chelsea;Fairclough, Stephen
• 通讯作者: Fairclough, Stephen

Personal informatics and negative emotions during commuter driving: Effects of data visualization on cardiovascular reactivity & mood

• DOI: 10.1016/j.ijhcs.2020.102499
• 发表时间: 2020-12-01
• 期刊: INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES
• 影响因子: 5.4
• 作者: Fairclough, Stephen H.;Dobbins, Chelsea
• 通讯作者: Dobbins, Chelsea

A mobile lifelogging platform to measure anxiety and anger during real-life driving

• DOI: 10.1109/percomw.2017.7917583
• 发表时间: 2017-03
• 期刊: 2017 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops)
• 作者: Chelsea Dobbins;S. Fairclough

Applied Computing in Medicine and Health

医学与健康中的应用计算

• DOI: 10.1016/b978-0-12-803468-2.00002-3
• 发表时间: 2016
• 作者: Dobbins C

Wearable Sensors, Driving and the Visualization of Cardiovascular Stress During Everyday Life

可穿戴传感器、驾驶和日常生活中心血管压力的可视化

• 发表时间: 2017
• 作者: Dobbins C