Latency-Aware 360-Degree Video Analytics Framework for First Responders Situational Awareness
Latency-Aware 360-Degree Video Analytics Framework for First Responders Situational Awareness
复制标题
用于急救人员态势感知的延迟感知 360 度视频分析框架
DOI：
10.1145/3592473.3592568
复制
发表时间：
2023
期刊：
影响因子：
--
通讯作者：
Nahrstedt, Klara
中科院分区：
文献类型：
--
作者：
Li, Jiaxi;Liao, Jingwei;Chen, Bo;Nguyen, Anh;Tiwari, Aditi;Zhou, Qian;Yan, Zhisheng;Nahrstedt, Klara
急救人员在危险的工作环境中工作，面临着不可预测的风险。为了更好地为工作要求做好准备，第一反应受训者进行训练演习，并由教官记录和审查，教官检查录像中显示危险的物体（例如，带着未固定的防毒面具的消防员）。然而，由于未经分析的视频记录和有限的态势感知，传统的审查过程效率低下。为了获得更好的审查体验，应该提供延迟感知的查看和查询服务（VQS）。VQS应该支持目标搜索，这可以通过视频目标检测算法来实现。同时，360度摄像机的应用为训练环境提供了无限视野。然而，这种介质代表了一个重大挑战，因为由于更高的分辨率和几何失真，低延迟高精度360度物体检测很困难。在本文中，我们提出了用于360度目标检测的响应者-360系统架构。我们提出了一个动态选择算法，优化计算资源，同时产生准确的360度对象推理。使用从消防培训机构收集的独特数据集的结果表明，与最先进的方法相比，Responders-360框架实现了4倍的加速和25%的内存使用减少。
First responders operate in hazardous working conditions with unpredictable risks. To better prepare for demands of the job, first responder trainees conduct training exercises that are being recorded and reviewed by the instructors, who check for objects indicating risks within the video recordings (e.g., firefighter with an unfastened gas mask). However, the traditional reviewing process is inefficient due to unanalyzed video recordings and limited situational awareness. For better reviewing experience, a latency-aware Viewing and Query Service (VQS) should be provided. The VQS should support object searching, which can be achieved using the video object detection algorithms. Meanwhile, the application of 360-degree cameras facilitates an unlimited field of view of the training environment. Yet, this medium represents a major challenge because low-latency high-accuracy 360-degree object detection is difficult due to higher resolution and geometric distortion. In this paper, we present the Responders-360 system architecture designed for 360-degree object detection. We propose a Dynamic Selection algorithm that optimizes computation resources while yielding accurate 360-degree object inference. The results, using a unique dataset collected from a firefighting training institute, show that the Responders-360 framework achieves 4x speedup and 25% memory usage reduction compared with the state-of-the-art methods.
DOI：
10.3390/s22166001
发表时间：
2022-08-11
期刊：
Sensors (Basel, Switzerland)
影响因子：
--
作者：
通讯作者：
--
DOI：
10.1117/12.2586403
发表时间：
2021-04
期刊：
The European Journal of Development Research
影响因子：
--
作者：
Jounsup Park
通讯作者：
Jounsup Park