CPS: Synergy: Smart Flexible Camera Sheet: Ultra-Thin Semantic-Guided Cooperative Micro-Camera Array

这项高度跨学科的研究解决了图像传感和图像理解方面的两个基本挑战：1)小尺寸的多功能相机系统，以及2)从二维照片中识别三维场景和物体。这些基本挑战是通过开发一种称为智能柔性相机片的网络物理成像系统来解决的，该系统将许多微型相机（每个相机的尺寸为毫米）集成到薄基板上。基板具有灵活的几何形状，每个摄像头的方向通过智能算法进行实时调整和控制。整个成像系统超薄且节省空间，可以很容易地安装或嵌入到任何平面或曲面上。因此，它开辟了大量新的民用和军事应用，需要监视和视觉监测，从而具有巨大的商业化潜力。示例应用包括：智能车辆、智能交通、高速公路安全、智能民用基础设施、生产线、战场监视和侦察、传感器网络、移动机器人、医疗设施和患者护理。更广泛的影响：该项目为各个层次的学生提供了新的教育机会，导致电气工程，应用物理，材料科学与工程以及计算机科学的课程发展。该项目的一个重要组成部分是向其他大学、K-12学生、教师、家长和公众提供强有力的传播和推广计划。

This highly interdisciplinary research addresses two fundamental challenges in image sensing and image understanding: 1) versatile camera systems in a small form factor, and 2) 3-dimensional scene and object recognition from 2-dimensional photos. These fundamental challenges are tackled together by developing a cyber-physical imaging system, called smart flexible camera sheet, which integrates an array of many micro-cameras (millimeters in size each) onto a thin substrate. The substrate has flexible geometric shape and the orientation of each camera is individually adjusted and controlled in real time via intelligent algorithms. The overall imaging system is ultra-thin and space-efficient, and can be easily mounted onto or embedded into any planar or curved surface. Hence it opens up a plethora of new civilian and military applications where surveillance and visual monitoring are required, thus bearing great commercialization potential. Example applications are: smart vehicles, smart transportation, highway safety, smart civil infrastructure, manufacturing lines, battlefield surveillance and reconnaissance, sensor networks, mobile robotics, medical facilities, and patient care. Broader Impact: This project generates new educational opportunities for students at all levels, leading to curricular development in electrical engineering, applied physics, materials science and engineering, and computer science. An important component of the project is a strong dissemination and outreach program to reach other universities, K-12 students, teachers, parents and the general public.