权益分类	功能权益	普通用户	{{item.name}}会员
{{category.name}}	{{benefitItem.name}}

RI: Medium: To Sense or Not to Sense: Energy Efficient Adaptive Sensing for Autonomous Systems

RI：中：感知或不感知：自主系统的节能自适应传感

基本信息

批准号：
1900821
负责人：
Srinivasa Narasimhan
金额：
$ 120万
依托单位：
Carnegie-Mellon University
依托单位国家：
美国
项目类别：
Standard Grant
财政年份：
2019
资助国家：
美国
起止时间：
2019-10-01 至 2022-09-30
项目状态：
已结题

来源：
https://www.nsf.gov/awardsearch/showAward?AWD_ID=1900821&HistoricalAwards=false
关键词：
RI Medium Sense Energy Efficient

项目摘要

Sensing and computation have been crucial to the significant progress in semi- and fully-autonomous vehicles and robots. Proliferation of many types of sensors (LIDARs, cameras, RADARs, etc.) and the advent of compute-heavy and data-hungry deep-learning approaches have increased the performance of autonomous systems by leaps and bounds. But the wide variety of sensors differ in terms of their performance, cost, and operational difficulty. Thus, specific sets of sensors are chosen for a particular task on a particular robot. This horses-for-courses approach often results in one-off systems that are incapable of adapting to many tasks or robots. Thus, to ensure safety and reliability, multi-tasking systems like autonomous vehicles have resorted to over-engineering, with upwards of 15 sensors and multiple GPUs/CPUs in any car. And, to make matters worse, many of the sensed data is eventually discarded as unwanted background. Thus, while the energy footprint of sensing and computations is increasing at an alarming rate, the flexibility or adaptability of these systems is still lacking. Much of this state of affairs can be attributed to the fact that sensors and algorithms face vastly different hardware and software challenges and are hence designed, developed, and manufactured in separate academic units or industries. This project takes a different approach: adaptively sense mostly (if not only) quantities which help solve the task accurately and within the allotted time. In other words, this project advocates folding adaptive and flexible sensing within a learning framework for autonomous systems. This is achieved by co-design and co-execution of sensing and algorithms to maximize accuracy and flexibility while minimizing expended energy and cost. The approach is motivated by how humans decide what, where, when, and how to sense and apply that to a robot learning framework. Research and education are closely integrated in a diverse and inclusive environment.The project consists of three fundamental research thrusts. Thrust 1: Development of highly novel and fully adaptive design and physical realization of 3D optical sensors. This thrust includes a fundamental mathematical framework that determines the optimal set of emitted and measured rays to achieve a particular task at hand. This is the mathematical foundation for developing a new class of sensors that detect and characterize obstacles---a time critical task of any autonomous system---with maximum energy efficiency, minimal latency (i.e., near-instantly) and with virtually no separate computation. Thrust 2: Novel decision-making framework that efficiently controls the adaptive sensors for the task at hand. This includes determining where and when to sense and adapting behavior policies accordingly. Thrust 3: Support the robot learning framework by learning and interacting with humans. The project will demonstrate the generality of adaptive sensing using three disparate autonomous systems that have broad societal impact: a) autonomous vehicles, b) assistive robots, and c) robots in manufacturing.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

传感和计算对于半自动和全自动车辆和机器人的重大进展至关重要。许多类型的传感器（激光雷达、照相机、雷达等）的激增计算量大、数据量大的深度学习方法的出现，使自治系统的性能得到了突飞猛进的提高。但是各种各样的传感器在性能、成本和操作难度方面各不相同。因此，为特定机器人上的特定任务选择特定的传感器组。这种以马换道的方法通常会导致一次性系统无法适应许多任务或机器人。因此，为了确保安全性和可靠性，像自动驾驶汽车这样的多任务系统已经采取了过度设计，在任何汽车中都有超过15个传感器和多个GPU/CPU。而且，更糟糕的是，许多感测到的数据最终作为不需要的背景而被丢弃。因此，虽然传感和计算的能量足迹正在以惊人的速度增加，但这些系统仍然缺乏灵活性或适应性。这种状况在很大程度上可以归因于传感器和算法面临着截然不同的硬件和软件挑战，因此在不同的学术单位或行业中设计，开发和制造。这个项目采取了一种不同的方法：自适应地感知大多数（如果不是唯一的话）有助于在分配的时间内准确解决任务的量。换句话说，该项目倡导在自主系统的学习框架内折叠自适应和灵活的传感。这是通过传感和算法的共同设计和共同执行来实现的，以最大限度地提高准确性和灵活性，同时最大限度地减少消耗的能源和成本。这种方法的动机是人类如何决定什么、在哪里、何时以及如何感知并将其应用于机器人学习框架。研究和教育在一个多元化和包容性的环境中紧密结合。该项目包括三个基本研究方向。目标1：开发高度新颖和完全自适应的3D光学传感器设计和物理实现。这一目标包括一个基本的数学框架，该框架确定发射和测量的最佳射线集，以实现手头的特定任务。这是开发一类新的传感器的数学基础，这些传感器检测和表征障碍物-任何自主系统的时间关键任务-具有最大的能量效率，最小的延迟（即，几乎立即）并且实际上没有单独的计算。目标2：新型决策框架，可有效控制手头任务的自适应传感器。这包括确定在何处以及何时感测并相应地调整行为策略。目标3：通过学习和与人类互动来支持机器人学习框架。该项目将使用具有广泛社会影响的三种不同自主系统来展示自适应传感的通用性：a）自主车辆，B）辅助机器人，以及c）制造业机器人。该奖项反映了NSF的法定使命，并通过使用基金会的智力价值和更广泛的影响审查标准进行评估，被认为值得支持。