Classification of gaze pattern using face direction for mother-infant interactions during shared book reading
Classification of gaze pattern using face direction for mother-infant interactions during shared book reading
复制标题
共享书籍阅读期间母婴互动中使用面部方向的注视模式分类
DOI：
10.11184/his.23.1_65
复制
发表时间：
2021
期刊：
影响因子：
--
通讯作者：
小林誠悟・佐藤鮎美・縄手雅彦・伊藤史人
中科院分区：
文献类型：
--
作者：
水野賀史;島田浩二;滝口慎一郎;友田明美;小林誠悟・佐藤鮎美・縄手雅彦・伊藤史人
共同注意对幼儿的语言发展具有重要意义，在共同阅读过程中经常观察到共同注意。在对共同注意的观察中，凝视虽然是一个重要的因素，但到目前为止，对凝视的分析都是由实验者从视频图像中手工编码进行的，需要大量的人工。为了使编码自动化，我们开发了一个系统，该系统基于从网络摄像头捕获的图像中使用机器学习检测到的面部方向来识别母亲和婴儿的共同注意力。本文从实验人员编码的结果出发，讨论了正在开发的注视模式系统。研究了注视方向和面部方向偏差对注视模式分类的影响。
Joint attention is important for the language development of infant and often observed in interactions during shared book reading. In the observation of the joint attention, though the gaze is an important element, the analysis of the gaze has been carried out by the manual coding from the video image by experimenter until now, and it requires large labor. In order to automate this coding, we have developed a system to identify joint attention of mother and infant based on the face direction detected using machine learning from the images captured by a webcam. In this paper, we discuss gaze patterns using the system under development from the results of coding by the experimenter. And, the effect of deviation of gaze direction and face direction on the classification of gaze pattern was examined.