CAREER: Robust Online Decision Procedures for Societal Scale CPS

职业:社会规模 CPS 的稳健在线决策程序

基本信息

  • 批准号:
    2238815
  • 负责人:
  • 金额:
    $ 49.93万
  • 依托单位:
  • 依托单位国家:
    美国
  • 项目类别:
    Continuing Grant
  • 财政年份:
    2023
  • 资助国家:
    美国
  • 起止时间:
    2023-02-01 至 2028-01-31
  • 项目状态:
    未结题

项目摘要

This research project will study novel methods for designing sequential, non-myopic, online decision procedures for societal-scale cyber-physical systems such as public transit, emergency response systems, and power grid, forming the critical infrastructure of our communities. Online Optimization of these systems entails taking actions that consider the tightly integrated spatial, temporal, and human dimensions while accounting for uncertainty caused due to changes in the system and the environment. For example, emergency response management systems (ERM) operators must optimally dispatch ambulances and help trucks to respond to incidents while accounting for traffic pattern changes and road closures. Similarly, public transportation agencies operating electric vehicles must manage and schedule the vehicles considering the expected travel demand while deciding on charging schedules considering the overall grid load. The project's proposed approach focuses on designing a modular and reusable online decision-making pipeline that combines the advantages of online planning methods, such as Monte-Carlo Tree Search, with offline policy learning methods, such as reinforcement learning, promising to provide faster convergence and robustness to changes in the environment. The research activities of the proposed project are complemented by educational activities focusing on designing cloud-based teaching environments that can help students and operators with prerequisite domain and statistical knowledge to design, manage, and experiment with decision procedures.The societal-scale CPS that we study have spatial-temporal properties. The spatial aspect refers to the location-specific state variables such as traffic congestion, transportation demand, and the frequency with which incidents occur at a location. The temporal aspect refers to the dynamic nature of these systems---traffic congestion evolves over time. Non-myopic decisions entail selecting actions over time under uncertainty while accounting for future impact and demand for resources. The combined research and education efforts proposed in the project focus on answering the following critical questions for these systems - first, how do we solve the challenge of sampling future state/ environmental actions across a high-dimensional space while also tackling the challenge of non-stationarity? Second, how do we address the need for robust, fast non-myopic planning that also tackles potential non-stationarity? And third, how do we make it possible to engage non-computer science students and community partners with the solutions built using approaches pioneered in the project? The proposed approach involves investigating novel machine learning methods, such as normalizing flows for designing generative models and an innovative approach to design planning algorithms using a policy-augmented hybrid Monte-Carlo Tree Search approach. A significant effort of the project will focus on complementing fundamental research with the design of a cloud-based visual domain-specific modeling environment that can help explain the design, operation, and introspection of methods by using a block-based compositional approach. The work will be augmented with course modules and online tutorials accompanying the cloud-based environment.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
该研究项目将研究为公共交通,应急响应系统和电网等社会规模的网络物理系统设计顺序,非近视,在线决策程序的新方法,形成我们社区的关键基础设施。这些系统的在线优化需要采取行动,考虑紧密集成的空间,时间和人的维度,同时考虑由于系统和环境的变化而引起的不确定性。例如,应急响应管理系统(ERM)运营商必须最佳地调度救护车,并帮助卡车应对事故,同时考虑交通模式的变化和道路封闭。同样,运营电动汽车的公共交通机构必须考虑预期的出行需求来管理和调度车辆,同时考虑到整体电网负载来决定充电时间表。该项目提出的方法侧重于设计一个模块化和可重复使用的在线决策管道,该管道结合了在线规划方法(如蒙特-卡罗树搜索)与离线策略学习方法(如强化学习)的优势,有望提供更快的收敛速度和对环境变化的鲁棒性。建议的项目的研究活动的补充教育活动,专注于设计基于云的教学环境,可以帮助学生和运营商的先决条件域和统计知识的设计,管理和实验的决策程序。社会规模的CPS,我们研究的时空属性。空间方面指的是特定于位置的状态变量,如交通拥堵,交通需求,以及事件发生的频率在一个位置。时间方面指的是这些系统的动态性质-交通拥堵随着时间的推移而演变。非短视决策需要在不确定性下选择长期行动,同时考虑未来的影响和资源需求。该项目中提出的研究和教育工作的重点是回答这些系统的以下关键问题-首先,我们如何解决在高维空间中对未来状态/环境行为进行采样的挑战,同时也解决非平稳性的挑战?其次,我们如何解决对稳健、快速、非短视规划的需求,同时解决潜在的非平稳性?第三,我们如何让非计算机科学专业的学生和社区合作伙伴参与到使用项目中开创的方法构建的解决方案中来?所提出的方法涉及研究新的机器学习方法,如规范化流程设计生成模型和创新的方法来设计规划算法,使用策略增强的混合蒙特-卡罗树搜索方法。该项目的一个重要工作将集中在补充基础研究,设计一个基于云的可视化领域特定建模环境,可以帮助解释设计,操作和内省的方法,通过使用基于块的组合方法。该奖项反映了NSF的法定使命,并通过使用基金会的知识价值和更广泛的影响审查标准进行评估,被认为值得支持。

项目成果

期刊论文数量(6)
专著数量(0)
科研奖励数量(0)
会议论文数量(0)
专利数量(0)
HPRoP: Hierarchical Privacy-preserving Route Planning for Smart Cities
  • DOI:
    10.1145/3616874
  • 发表时间:
    2023-08
  • 期刊:
  • 影响因子:
    2.3
  • 作者:
    F. Tiausas;K. Yasumoto;J. P. Talusan;H. Yamana;Hirozumi Yamaguchi;Shameek Bhattacharjee;Abhishek Dubey;Sajal K. Das
  • 通讯作者:
    F. Tiausas;K. Yasumoto;J. P. Talusan;H. Yamana;Hirozumi Yamaguchi;Shameek Bhattacharjee;Abhishek Dubey;Sajal K. Das
Act as You Learn: Adaptive Decision-Making in Non-Stationary Markov Decision Processes
  • DOI:
    10.48550/arxiv.2401.01841
  • 发表时间:
    2024-01
  • 期刊:
  • 影响因子:
    0
  • 作者:
    Baiting Luo;Yunuo Zhang;Abhishek Dubey;Ayan Mukhopadhyay
  • 通讯作者:
    Baiting Luo;Yunuo Zhang;Abhishek Dubey;Ayan Mukhopadhyay
Traffic Anomaly Detection Via Conditional Normalizing Flow
Synchrophasor Data Event Detection using Unsupervised Wavelet Convolutional Autoencoders
  • DOI:
    10.1109/smartcomp58114.2023.00080
  • 发表时间:
    2023-06
  • 期刊:
  • 影响因子:
    0
  • 作者:
    Jacob Buckelew;S. Basumallik;Vasavi Sivaramakrishnan;Ayan Mukhopadhyay;Amal Srivastava;Abhishek Dubey
  • 通讯作者:
    Jacob Buckelew;S. Basumallik;Vasavi Sivaramakrishnan;Ayan Mukhopadhyay;Amal Srivastava;Abhishek Dubey
Decision Making in Non-Stationary Environments with Policy-Augmented Search
通过策略增强搜索在非平稳环境中做出决策
{{ item.title }}
{{ item.translation_title }}
  • DOI:
    {{ item.doi }}
  • 发表时间:
    {{ item.publish_year }}
  • 期刊:
  • 影响因子:
    {{ item.factor }}
  • 作者:
    {{ item.authors }}
  • 通讯作者:
    {{ item.author }}

数据更新时间:{{ journalArticles.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ monograph.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ sciAawards.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ conferencePapers.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ patent.updateTime }}

Abhishek Dubey其他文献

Emergency Response Management Pipelines for Smart Cities
智慧城市应急响应管理管道
  • DOI:
  • 发表时间:
    2020
  • 期刊:
  • 影响因子:
    0
  • 作者:
    Geoffrey Pettet;Ayan Mukhopadhyay;S. Vazirizade;Matthew Berger;Mykel J. Kochenderfer;Abhishek Dubey;Mohsen Vazirizade
  • 通讯作者:
    Mohsen Vazirizade
Deliberative, search-based mitigation strategies for model-based software health management
  • DOI:
    10.1007/s11334-013-0215-x
  • 发表时间:
    2013-07-28
  • 期刊:
  • 影响因子:
    1.100
  • 作者:
    Nagabhushan Mahadevan;Abhishek Dubey;Daniel Balasubramanian;Gabor Karsai
  • 通讯作者:
    Gabor Karsai
Towards a Product Line of Heterogeneous Distributed Applications
走向异构分布式应用程序的产品线
  • DOI:
  • 发表时间:
    2015
  • 期刊:
  • 影响因子:
    0
  • 作者:
    Subhav Pradhan;Abhishek Dubey;W. Otte;G. Karsai;A. Gokhale
  • 通讯作者:
    A. Gokhale
Towards a verifiable real-time, autonomic, fault mitigation framework for large scale real-time systems
  • DOI:
    10.1007/s11334-006-0015-7
  • 发表时间:
    2007-01-24
  • 期刊:
  • 影响因子:
    1.100
  • 作者:
    Abhishek Dubey;Steve Nordstrom;Turker Keskinpala;Sandeep Neema;Ted Bapty;Gabor Karsai
  • 通讯作者:
    Gabor Karsai
Development of Predictive Quantitative Structure-Activity Relationship Models of Epipodophyllotoxin Derivatives
表鬼臼毒素衍生物的预测定量构效关系模型的建立

Abhishek Dubey的其他文献

{{ item.title }}
{{ item.translation_title }}
  • DOI:
    {{ item.doi }}
  • 发表时间:
    {{ item.publish_year }}
  • 期刊:
  • 影响因子:
    {{ item.factor }}
  • 作者:
    {{ item.authors }}
  • 通讯作者:
    {{ item.author }}

{{ truncateString('Abhishek Dubey', 18)}}的其他基金

Travel: NSF Student Travel Grant for 2023 IEEE International Conference on Smart Computing
旅行:2023 年 IEEE 国际智能计算会议 NSF 学生旅行补助金
  • 批准号:
    2321961
  • 财政年份:
    2023
  • 资助金额:
    $ 49.93万
  • 项目类别:
    Standard Grant
SCC-IRG Track 1: Mobility for all - Harnessing Emerging Transit Solutions for Underserved Communities
SCC-IRG 第 1 轨道:全民出行 - 为服务不足的社区利用新兴交通解决方案
  • 批准号:
    1952011
  • 财政年份:
    2020
  • 资助金额:
    $ 49.93万
  • 项目类别:
    Standard Grant
Collaborative Research: RAPID: Addressing Transit Accessibility and Public Health Challenges due to COVID-19
合作研究:RAPID:应对 COVID-19 带来的交通便利性和公共卫生挑战
  • 批准号:
    2029950
  • 财政年份:
    2020
  • 资助金额:
    $ 49.93万
  • 项目类别:
    Standard Grant
NeTS: JUNO2: Collaborative Research: STEAM: Secure and Trustworthy Framework for Integrated Energy and Mobility in Smart Connected Communities
NetS:JUNO2:协作研究:STEAM:智能互联社区中集成能源和移动性的安全可信框架
  • 批准号:
    1818901
  • 财政年份:
    2018
  • 资助金额:
    $ 49.93万
  • 项目类别:
    Continuing Grant
III: Small: Collaborative Research: Summarizing Heterogeneous Crowdsourced & Web Streams Using Uncertain Concept Graphs
III:小:协作研究:异构众包总结
  • 批准号:
    1814958
  • 财政年份:
    2018
  • 资助金额:
    $ 49.93万
  • 项目类别:
    Standard Grant
US Ignite: Collaborative Research: Focus Area 1: Social Computing Platform for Multi-Modal Transit
US Ignite:合作研究:重点领域 1:多式联运社交计算平台
  • 批准号:
    1647015
  • 财政年份:
    2016
  • 资助金额:
    $ 49.93万
  • 项目类别:
    Standard Grant
CPS-EAGER- Experiments with Smart City Hubs: Integration Platform for Human Cyber-Physical Systems In Smart Cities
CPS-EAGER- 智能城市中心实验:智能城市中人类网络物理系统的集成平台
  • 批准号:
    1528799
  • 财政年份:
    2015
  • 资助金额:
    $ 49.93万
  • 项目类别:
    Standard Grant

相似国自然基金

供应链管理中的稳健型(Robust)策略分析和稳健型优化(Robust Optimization )方法研究
  • 批准号:
    70601028
  • 批准年份:
    2006
  • 资助金额:
    7.0 万元
  • 项目类别:
    青年科学基金项目
心理紧张和应力影响下Robust语音识别方法研究
  • 批准号:
    60085001
  • 批准年份:
    2000
  • 资助金额:
    14.0 万元
  • 项目类别:
    专项基金项目
ROBUST语音识别方法的研究
  • 批准号:
    69075008
  • 批准年份:
    1990
  • 资助金额:
    3.5 万元
  • 项目类别:
    面上项目
改进型ROBUST序贯检测技术
  • 批准号:
    68671030
  • 批准年份:
    1986
  • 资助金额:
    2.0 万元
  • 项目类别:
    面上项目

相似海外基金

Developing robust methods for the measurement of online social media populations
开发稳健的方法来衡量在线社交媒体人群
  • 批准号:
    RGPIN-2017-05165
  • 财政年份:
    2021
  • 资助金额:
    $ 49.93万
  • 项目类别:
    Discovery Grants Program - Individual
Developing a robust, online, remote assessment solution for international students to increase opportunities to access Higher Education institutions in the UK
为国际学生开发强大的在线远程评估解决方案,以增加进入英国高等教育机构的机会
  • 批准号:
    56618
  • 财政年份:
    2020
  • 资助金额:
    $ 49.93万
  • 项目类别:
    Feasibility Studies
Developing robust methods for the measurement of online social media populations
开发稳健的方法来衡量在线社交媒体人群
  • 批准号:
    RGPIN-2017-05165
  • 财政年份:
    2020
  • 资助金额:
    $ 49.93万
  • 项目类别:
    Discovery Grants Program - Individual
Developing robust methods for the measurement of online social media populations
开发稳健的方法来衡量在线社交媒体人群
  • 批准号:
    507927-2017
  • 财政年份:
    2019
  • 资助金额:
    $ 49.93万
  • 项目类别:
    Discovery Grants Program - Accelerator Supplements
Developing robust methods for the measurement of online social media populations
开发稳健的方法来衡量在线社交媒体人群
  • 批准号:
    RGPIN-2017-05165
  • 财政年份:
    2019
  • 资助金额:
    $ 49.93万
  • 项目类别:
    Discovery Grants Program - Individual
CNS Core: Small: Online learning of cross-layer systems for robust and high-performance Internet video transmission
CNS 核心:小型:在线学习跨层系统,实现稳健、高性能的互联网视频传输
  • 批准号:
    1909212
  • 财政年份:
    2019
  • 资助金额:
    $ 49.93万
  • 项目类别:
    Standard Grant
Robust online optimization for large-scale constrained engineering systems
大规模约束工程系统的鲁棒在线优化
  • 批准号:
    DGECR-2019-00068
  • 财政年份:
    2019
  • 资助金额:
    $ 49.93万
  • 项目类别:
    Discovery Launch Supplement
Developing robust methods for the measurement of online social media populations
开发稳健的方法来衡量在线社交媒体人群
  • 批准号:
    RGPIN-2017-05165
  • 财政年份:
    2018
  • 资助金额:
    $ 49.93万
  • 项目类别:
    Discovery Grants Program - Individual
Developing robust methods for the measurement of online social media populations
开发稳健的方法来衡量在线社交媒体人群
  • 批准号:
    507927-2017
  • 财政年份:
    2018
  • 资助金额:
    $ 49.93万
  • 项目类别:
    Discovery Grants Program - Accelerator Supplements
Tactile Feet and Online Learning for Robust Control of a Quadruped Robot in Challenging Terrain
触觉足和在线学习在具有挑战性的地形中实现四足机器人的鲁棒控制
  • 批准号:
    1951503
  • 财政年份:
    2017
  • 资助金额:
    $ 49.93万
  • 项目类别:
    Studentship
{{ showInfoDetail.title }}

作者:{{ showInfoDetail.author }}

知道了