Episodic Image Recording System for Memory Aid by Understanding Behavior and Situation

在本项目中，我们提出了一种利用图像处理和数据检索技术的辅助记忆方法，在实验系统中，通过计算机分析CCD相机从用户角度拍摄的图像，从图像序列中选择令人印象深刻的场景。本研究总结如下几点。我们用头戴式摄像机记录了情景图像，并评估了这些图像在改善对过去事件的心理回溯方面的能力。在实验中，我们发现了以下事实。观看事件的静止图像可以提高记忆能力。虽然记忆能力存在差异，但情景图像在记忆实验中表现出提高的趋势。如果场景很复杂，与当时情境不太相关的事件往往会被遗忘。在这种情况下，清晰区分情境和背景的图像提高了记忆力。如果场景很复杂，结构化的静态图像会让人想起事件。我们将CCD相机拍摄的图像组织成一个场景层次。结构化的图像显著地改善了心理回溯。(b)提出了与事件密切相关的图像提取算法。提出了一种从长期录像中提取人脸的算法。提出了一种监控用户运动的算法。提出了对长期场景进行分层分割的算法。提出了一种从图像中识别人体动作的算法。我们专注于算法来提取用户挑选/放置物体的场景。

In the project, we proposed a method for memory aid which utilizes image processing and data retrieval technologies, In the experimental system, image from user's view point taken by a CCD camera is analyzed by a computer to select impressive scenes from the image sequence.The research is summarized in the following points.(a) With the head-mount camera we recorded episodic images and evaluated the ability of these imagesto improve mental retrace of past events, In the experiments, we found the following facts.A still image which views episode improves mental recall. Though the ability of mental recall depends on subjects, episodic image showed improvement on the recall experoment.If the scene is complicated, events less related to the context of the situation often unrecalled. In such a case, an image which clearly discriminates the situation from the context made improvement in recall.Structured still images of episodic scene recall the events if the scene was complicated. We organized the images taken by a CCD camera into a hierarchy of scene. The structured images dramatically improved the mental retrace.(b) Algrothms to extract images closely related to episodes are proposed.An algorithm which extract human-face from long-term video recordings is proposed.An algorithm to monitor the motion of the user is proposed.Algorithms to segment the long-term scene into hierarchy are proposed.An algorithm to recognize human action from image is proposed. We concentrated on the algorithm to extract scenes in which the user to pick/place objects.