权益分类	功能权益	普通用户	{{item.name}}会员
{{category.name}}	{{benefitItem.name}}

RI: Small: Local and Forward-Oriented Deep Learning for Decentralized and Dynamic Environments

RI：小型：用于分散和动态环境的本地和前向深度学习

基本信息

批准号：
2212097
负责人：
David Inouye
金额：
$ 59.88万
依托单位：
Purdue University
依托单位国家：
美国
项目类别：
Standard Grant
财政年份：
2022
资助国家：
美国
起止时间：
2022-10-01 至 2025-09-30
项目状态：
未结题

来源：
https://www.nsf.gov/awardsearch/showAward?AWD_ID=2212097&HistoricalAwards=false
关键词：
RI Small Local Forward Oriented

项目摘要

The field of deep learning enables computers to create complex models to perform challenging tasks previously limited to humans. It has been the key to modern successes in artificial intelligence (AI) including automatic object identification in images, machine translation, and autonomous cars. However, current deep learning models require data to be collected in one centralized location and globally optimized by powerful computers. This significantly limits deep learning in the decentralized and dynamic environments common to future AI applications critical for national defense and economic pre-eminence. These future AI applications will be deployed over multiple heterogeneous wireless devices that have limited computational and communication capabilities (e.g., a surveillance camera, a weather sensor, or an aerial drone). This work will develop novel deep learning methods that execute in these decentralized environments, adapt to changing conditions, and recover from communication failures. To broaden STEM participation, this project will also develop virtual machine learning labs to engage high school students. Ultimately, this work will take a key step towards the next generation of decentralized and dynamic AI systems.This project will develop approaches to optimize a sequence of invertible functions that iteratively deconstruct data patterns, an approach called destructive learning. Specifically, this work will advance knowledge on both the foundational and practical aspects of local and forward-oriented destructive learning. The first objective will generalize the iterative algorithms from the investigator’s prior work and provide the foundation for forward-only algorithms. These forward-only algorithms do not require a centralized computational environment and can locally optimize AI components even under imperfect communication between devices. The second objective will develop more practical destructive learning algorithms that combine the strengths of forward-only and global centralized learning. The final objective will implement and evaluate forward-oriented algorithms on simulated and real device networks to demonstrate the feasibility of this new deep learning approach. These objectives work together in creating a foundation for a novel alternative to end-to-end learning across devices that does not require global synchronization.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

深度学习领域使计算机能够创建复杂的模型来执行以前仅限于人类的挑战性任务。它一直是人工智能（AI）现代成功的关键，包括图像中的自动对象识别，机器翻译和自动汽车。然而，目前的深度学习模型需要在一个集中的位置收集数据，并通过强大的计算机进行全局优化。这大大限制了未来人工智能应用中常见的分散和动态环境中的深度学习，这些应用对国防和经济优势至关重要。这些未来的人工智能应用将部署在计算和通信能力有限的多个异构无线设备上（例如，监视摄像机、天气传感器或空中无人机）。这项工作将开发新的深度学习方法，在这些分散的环境中执行，适应不断变化的条件，并从通信故障中恢复。为了扩大STEM的参与，该项目还将开发虚拟机器学习实验室，以吸引高中生。最终，这项工作将朝着下一代去中心化和动态AI系统迈出关键一步。该项目将开发优化可逆函数序列的方法，这些函数迭代地解构数据模式，这种方法称为破坏性学习。具体来说，这项工作将推进本地和前瞻性破坏性学习的基础和实践方面的知识。第一个目标是从研究者先前的工作中推广迭代算法，并为仅向前算法提供基础。这些只向前的算法不需要集中式计算环境，即使在设备之间的通信不完善的情况下，也可以本地优化AI组件。第二个目标将开发更实用的破坏性学习算法，结合联合收割机的优势，只向前和全球集中式学习。最终目标将在模拟和真实的设备网络上实现和评估前向算法，以证明这种新的深度学习方法的可行性。这些目标共同为不需要全球同步的跨设备端到端学习的新替代方案奠定了基础。该奖项反映了NSF的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估而被认为值得支持。