Collaborative Research: CCRI:NEW: Research Infrastructure for Real-Time Computer Vision and Decision Making via Mobile Robots

该项目将为计算机视觉和自动移动的机器人（空中和地面）的实时控制创建一个研究基础设施。基础设施包括四个组成部分：（1）一个装饰成微型城市的普渡大学实验室。(2)反映物理实验室的模拟器。(3)可编程的空中机器人与模拟器具有相同的接口。(4)用于评估和比较的人工智能、计算机视觉和机器人控制研究的示例解决方案。该基础设施将以多种方式提供给研究社区：（1）用户可以在安全的虚拟环境中使用模拟器评估他们的解决方案。(2)用户可以上传他们的控制程序，这个团队将在普渡大学的实验室内发射机器人。用户可以使用已经部署在实验室中的高速摄像机远程观察机器人。(3)用户可以将自己的机器人带到实验室进行实验。(4)该项目将为研究人员创造竞赛，在模拟紧急情况和救援场景中使用自主移动的机器人展示他们的解决方案。比赛将使用微型建筑物和人，让机器人识别和计数物体（如人数，车辆和房屋），评估情况（如倒塌的桥梁数量），同时避开障碍物。这种基础设施将可用于研究广泛的研究课题，包括（1）实时计算机视觉和控制。装饰的实验室将允许研究人员在三维环境中使用主动计算机视觉，导航和语义分割来评估他们的实时视觉和控制方法的解决方案。(2)模拟机器人舰队。用户可以在部署之前在安全的虚拟环境中评估和改进他们的方法。(3)该基础设施将集成虚拟和物理环境，以便在模拟器中运行的解决方案可以直接移植到物理机器人上进行实验。(4)碰撞避免、多机器人协调、应急响应、计算机安全以及嵌入式系统上的高效机器学习。(5)农业、城市规划、应急响应和土木结构检查。该项目将培养STEM人才，因为自主机器人和视觉数据自然会吸引公众。有了模拟器，各级学生都可以参与，而无需购买物理机器人。这种研究基础设施将减少创新的障碍。这一基础设施还将鼓励机器学习方面的创新，这些创新具有能源效率，并且可以移植到资源受限的嵌入式系统中，如空中机器人。该项目将吸引更广泛的受众，包括K-12学生，以及由于上述许多应用程序。该奖项反映了NSF的法定使命，并已被认为是值得通过使用基金会的智力价值和更广泛的影响审查标准进行评估的支持。

This project will create a research infrastructure for computer vision and real-time control of autonomous mobile robots (both aerial and ground). The infrastructure includes four integrated components: (1) A Purdue laboratory decorated as miniature cities. (2) Simulators that reflect the physical laboratory. (3) Programmable aerial robots with the same interface as the simulators. (4) Sample solutions for research on artificial intelligence, computer vision, and robot control for evaluation and comparison. This infrastructure will be available to the research community in multiple ways: (1) Users can evaluate their solutions with the simulators in a safe virtual environment. (2) Users can upload their control programs and this team will launch the robots inside Purdue's laboratory. Users can observe the robots remotely using the high-speed cameras already deployed in the laboratory. (3) Users can bring their own robots to the laboratory and conduct experiments. (4) This project will create competitions for researchers to demonstrate their solutions using autonomous mobile robots in simulated emergency and rescue scenarios. The competitions will use miniature buildings and people for the robots to recognize and count objects (such as number of people, vehicles, and houses), assess situations (such as the number of collapsed bridges), while avoiding obstacles.This infrastructure will be available for investigating a wide range of research topics, including (1) real-time computer vision and control. The decorated laboratory will allow researchers to evaluate their solutions for real-time vision and control methods using active computer vision, navigation, and semantic segmentation in a three-dimensional environment. (2) simulation of robot fleets. Users can evaluate and improve their methods in a safe virtual environment before deployment. (3) This infrastructure will integrate virtual and physical environments so that solutions running in the simulators can be ported directly to the physical robots for experiments. (4) collision avoidance, multi-robot coordination, emergency response, computer security, and efficient machine learning on embedded systems. (5) agriculture, city planning, emergency response, and inspection of civil structures. This project will build STEM talents because autonomous robots and visual data are naturally appealing to the general public. With the simulators, students at all levels can participate without the cost of purchasing physical robots. This research infrastructure will reduce the barriers to innovations. This infrastructure will also encourage innovations in machine learning that are efficient in energy and can be ported to resource constrained embedded systems such as aerial robots. The project will engage a broader audience including K-12 students as well because of the many applications described above.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.