Non-Invasive Screen Exposure Time Assessment Using Wearable Sensor and Object Detection.
Non-Invasive Screen Exposure Time Assessment Using Wearable Sensor and Object Detection.
复制标题
DOI：
10.1109/embc48229.2022.9871903
复制
发表时间：
2022-07-01
期刊：
影响因子：
--
通讯作者：
Gan, Yu
中科院分区：
文献类型：
--
作者：
Li, Xueshen;Holiday, Steven;Gan, Yu
由于过去十年中数字技术所有权的爆炸式增长，所有人的累积屏幕暴露量都有所增加，包括面临肥胖，眼部问题和睡眠中断等暴露相关风险的儿童。屏幕暴露与儿童和成人的身心健康风险有关。目前的屏幕暴露评估方法有其局限性，主要是在客观性，鲁棒性和侵入性的前景。本文提出了一种利用可穿戴传感器和计算机视觉技术测量屏幕曝光时间的新方法。我们使用定制的，轻量级的，可穿戴的传感器来捕获以自我为中心的图像，并使用基于深度学习的对象检测模块来识别电子屏幕的存在。使用后处理技术进一步估计屏幕曝光的持续时间，以过滤关于屏幕使用的连续帧。我们的方法是非侵入性的和强大的，提供了一个客观和准确的手段，屏幕曝光测量。我们在各种环境下进行实验，以确定三种类型的屏幕和屏幕曝光的持续时间的存在。实验结果表明，自动评估屏幕时间暴露的可行性和巨大的潜力，应用于大规模的实验行为研究。
Cumulative screen exposure has been increased due to the explosion of digital technology ownership in the past decade for all people, including children who face exposure related risks such as obesity, eye problems, and disrupted sleep. Screen exposure is linked to physical and mental health risks among both children and adults. Current methods of screen exposure assessment have their limitations, mostly in the prospective of objectiveness, robustness, and invasiveness. In this paper, we propose a novel method to measure screen exposure time using a wearable sensor and computer vision technology. We use a customized, lightweight, wearable senor to capture egocentric images and use deep learning-based object detection module to identify the existence of electronic screens. The duration of screen exposure is further estimated using post-processing technology to filter consecutive frames regarding to the screen usage. Our method is non-invasive and robust, providing an objective and accurate means to screen exposure measurement. We conduct experiments on various environments to identify the existence of three types of screens and duration of screen exposure. The experimental results demonstrate the feasibility of automatically assessing screen time exposure and great potential to be applied in large scale experiments for behavioral study.