Distributed Multi-agent Video Fast-forwarding
Distributed Multi-agent Video Fast-forwarding
复制标题
DOI：
10.1145/3394171.3413767
复制
发表时间：
2020-08
期刊：
影响因子：
--
通讯作者：
Shuyue Lan;Zhilu Wang;A. Roy-Chowdhury;Ermin Wei;Qi Zhu
中科院分区：
文献类型：
--
作者：
Shuyue Lan;Zhilu Wang;A. Roy-Chowdhury;Ermin Wei;Qi Zhu
在许多智能系统中，代理网络协作感知环境，以实现更好、更高效的态势感知。由于这些代理通常资源有限，因此识别来自不同代理的摄像机视图之间重叠的内容并利用它来减少冗余/不重要视频帧的处理、传输和存储可能非常有益。本文提出了一种基于共识的分布式多智能体视频快进框架，称为 DMVF，能够协作、自适应地快进多视图视频流。在我们的框架中，每个摄像机视图都由基于强化学习的快进代理来处理，该代理定期从多种策略中进行选择，以有选择地处理视频帧并以可调节的速度传输选定的帧。在每个适应期间，每个智能体与多个相邻智能体进行通信，评估自身及其邻居所选择的帧的重要性，通过系统范围的共识算法与其他智能体一起完善这种评估，并使用这种评估来决定下一个时期的策略。与现实世界监控视频数据集 VideoWeb 的文献中的方法相比，我们的方法显着提高了重要帧的覆盖率，并且还减少了系统中处理的帧数。
In many intelligent systems, a network of agents collaboratively perceives the environment for better and more efficient situation awareness. As these agents often have limited resources, it could be greatly beneficial to identify the content overlapping among camera views from different agents and leverage it for reducing the processing, transmission and storage of redundant/unimportant video frames. This paper presents a consensus-based distributed multi-agent video fast-forwarding framework, named DMVF, that fast-forwards multi-view video streams collaboratively and adaptively. In our framework, each camera view is addressed by a reinforcement learning based fast-forwarding agent, which periodically chooses from multiple strategies to selectively process video frames and transmits the selected frames at adjustable paces. During every adaptation period, each agent communicates with a number of neighboring agents, evaluates the importance of the selected frames from itself and those from its neighbors, refines such evaluation together with other agents via a system-wide consensus algorithm, and uses such evaluation to decide their strategy for the next period. Compared with approaches in the literature on a real-world surveillance video dataset VideoWeb, our method significantly improves the coverage of important frames and also reduces the number of frames processed in the system.