A Lightweight Event-Driven Network of Biomimetic Image Sensors

该建议的重点是使用仿生图像传感器的图像传感器网络。定制图像传感器将提供简化的视觉表示，并使传感器网络能够解释室内环境中的行为和活动。研究重点是1）将传感器观察解析成一组可被机器理解的可区分的动作，2）通过从场景中提取数据而不获取图像并使犯罪者难以重建图像来保护隐私，3）提供超低功耗组件和轻量级图像传感器网络，该网络通过低带宽无线链路使用符号信息进行操作。该研究使传感器网络上的图像解析和解释成为可能。将开发新一代概率检测算法，这些算法对优先数据进行操作，以有限的信息进行快速检测。这些算法将能够在传感器节点上使用的低端微控制器上执行。使用模块化和仿生方法，PI将设计低功耗图像传感器，在传感器级别执行有效的数据提取。他们的设计方法将减少图像传感器所需的计算和通信，并为传统的机器视觉提供正交方法。拟议的研究是需要推进技术的移动的摄像机监测室内辅助生活环境。更广泛的影响：图像传感器网络是建筑安全，广域安全，国家安全，监测桥梁和公路等土木结构的健康，观察自然环境和栖息地，检测严重的自然事件的基石。 拟议的图像传感器网络将用于辅助生活环境中，以监测老年患者在日常活动。该项目的应用性质是一种有吸引力的方式，可以培训学生，特别是妇女和代表性不足的群体，并激励他们从事研究和学术事业。

This proposal focuses on the use of biomimetic image sensors for an image sensor network. Custom image sensors will provide a reduced visual representation and enable the sensor network to interpret behavior and activity in an indoor setting. The research emphasis is to 1) parse out sensor observations into a set of distinguishable actions that can be understood by machines, 2) preserve privacy by extracting data from a scene without acquiring images and by making image reconstruction difficult for perpetrators, 3) provide ultra-low power components and a lightweight sensor network of images that operates using symbolic information over low bandwidth wireless links.Intellectual Merit: The research enables image parsing and interpretation on sensor networks. A new generation of probabilistic detection algorithms that operate on prioritized data to produce fast detections with limited information will be developed. The algorithms will be able to execute on the low-end microcontrollers used on sensor nodes. Using modular and biomimetic approaches, the PIs will design low-power image sensors that will perform efficient data extraction at the sensor level. Their design approach will reduce the computation and communications required by image sensors and provide an orthogonal methodology to conventional machine vision. The proposed research is required to advance the technology of mobile cameras for monitoring indoor assisted-living environments.Broader Impacts: The image sensor network is the building block of building security, wide-area security, national security, monitoring health of civil structures as bridges and highways, observing natural environments and habitats, detecting severe natural events. The proposed image sensor network will be used in an assisted-living environment to monitor aging patients during everyday activity. The applied nature of the project is an attractive way to train students, particularly women and under-represented groups, and to motivate them to pursue careers in research and academia.