Banner: An Image Sensor Reconfiguration Framework for Seamless Resolution-based Tradeoffs
Banner: An Image Sensor Reconfiguration Framework for Seamless Resolution-based Tradeoffs
复制标题
横幅：基于分辨率的无缝权衡的图像传感器重新配置框架
DOI：
10.1145/3307334.3326092
复制
发表时间：
2019
期刊：
影响因子：
--
通讯作者：
LiKamWa, Robert
中科院分区：
文献类型：
--
作者：
Hu, Jinhan;Shearer, Alexander;Rajagopalan, Saranya;LiKamWa, Robert
移动视觉系统将受益于在不需要成像细节的情况下牺牲图像分辨率以节省系统能量的能力。不幸的是，传感器分辨率的任何变化都会导致帧传输的大量暂停-多达280毫秒。帧传输在以新的分辨率恢复之前，会受到当前操作系统中一系列重新配置过程和内存管理的瓶颈。这种重新配置的延迟阻碍了采用其他有益的分辨率-能量权衡机制。我们提出Banner作为一种媒体框架，提供快速传感器分辨率重构服务，作为对常见媒体框架（例如V4L2）的修改。Banner完全消除了帧到帧重构延迟（226 ms到33 ms），即消除了传感器分辨率重构期间的帧丢失。Banner还将端到端分辨率重新配置延迟减半（226毫秒到105毫秒）。通过在Jetson TX2板上运行的基于云的卸载工作负载测量，这使得连续视觉应用可以将传感器分辨率重新配置为480p，而不是将采样从1080p降至480p，从而使系统功耗降低49%以上。因此，Banner为移动视觉应用程序解锁了前所未有的功能，可以动态重新配置传感器分辨率，以平衡能源效率和任务精度。
Mobile vision systems would benefit from the ability to situationally sacrifice image resolution to save system energy when imaging detail is unnecessary. Unfortunately, any change in sensor resolution leads to a substantial pause in frame delivery -- as much as 280 ms. Frame delivery is bottlenecked by a sequence of reconfiguration procedures and memory management in current operating systems before it resumes at the new resolution. This latency from reconfiguration impedes the adoption of otherwise beneficial resolution-energy tradeoff mechanisms. We propose Banner as a media framework that provides a rapid sensor resolution reconfiguration service as a modification to common media frameworks, e.g., V4L2. Banner completely eliminates the frame-to-frame reconfiguration latency (226 ms to 33 ms), i.e., removing the frame drop during sensor resolution reconfiguration. Banner also halves the end-to-end resolution reconfiguration latency (226 ms to 105 ms). This enables a more than 49% reduction of system power consumption by allowing continuous vision applications to reconfigure the sensor resolution to 480p compared with downsampling from 1080p to 480p, as measured in a cloud-based offloading workload running on a Jetson TX2 board. As a result, Banner unlocks unprecedented capabilities for mobile vision applications to dynamically reconfigure sensor resolutions to balance the energy efficiency and task accuracy tradeoff.
登录
查看更多内容
DOI：
10.1145/3297001.3297020
发表时间：
2018-09
期刊：
Proceedings of the ACM India Joint International Conference on Data Science and Management of Data
影响因子：
--
作者：
Athindran Ramesh Kumar;Balaraman Ravindran;A. Raghunathan
通讯作者：
Athindran Ramesh Kumar;Balaraman Ravindran;A. Raghunathan
DOI：
10.1145/2897824.2925892
发表时间：
2016-07
期刊：
ACM Transactions on Graphics (TOG)
影响因子：
--
作者：
James Hegarty;Ross G. Daly;Zach DeVito;M. Horowitz;P. Hanrahan;Jonathan Ragan-Kelley
通讯作者：
James Hegarty;Ross G. Daly;Zach DeVito;M. Horowitz;P. Hanrahan;Jonathan Ragan-Kelley
影响因子：
6.2
作者：
Hegarty, James;Brunhaver, John;Hanrahan, Pat
通讯作者：
Hanrahan, Pat
表征 Android 设备上图像传感器分辨率的重新配置延迟
DOI：
10.1145/3177102.3177109
发表时间：
2018
期刊：
Proceedings of the 19th International Workshop on Mobile Computing Systems & Applications - HotMobile '18
影响因子：
--
作者：
Hu, Jinhan;Yang, Jianan;Delhivala, Vraj;LiKamWa, Robert
通讯作者：
LiKamWa, Robert