EAGER-DynamicData: Judicious Censoring, Random Sketching, and Efficient Validate for Learning Patterns from Dynamically-Changing and Large-Scale Data Sets

EAGER-DynamicData:明智的审查、随机草图和高效验证,用于从动态变化的大规模数据集中学习模式

基本信息

  • 批准号:
    1500713
  • 负责人:
  • 金额:
    $ 30万
  • 依托单位:
  • 依托单位国家:
    美国
  • 项目类别:
    Standard Grant
  • 财政年份:
    2015
  • 资助国家:
    美国
  • 起止时间:
    2015-09-15 至 2018-08-31
  • 项目状态:
    已结题

项目摘要

Abstract. With pervasive sensors continuously collecting and recording massive amounts of information, there is no doubt this is an era of data deluge. Learning from these dynamic and large volumes of data is expected to bring significant science and engineering advances along with consequent improvements in quality of life. The present early-concept grant for exploratory research aims to develop potentially transformative pattern recognition techniques that will be specifically tested on dynamically deforming (due to e.g., patient motion) cardiac magnetic resonance images, as well as on information extraction from large-scale healthcare datasets. Big challenges that this project addresses, include the sheer volume of online and growing datasets, which makes it impossible to run analytics especially in batch form; and also the facts that large-scale datasets are inevitably noisy, dynamic, incomplete, prone to outliers and (un)intentional misses, as well as vulnerable to cyber-attacks. The project's large-scale analytics will also permeate interdisciplinary benefits to environmental data mining, neuroscience, and the future power grid. At a broader scale, the developed technologies will provide valuable tools for foundational science and engineering research, and promote societal embracing of the emergent big data technologies, along with training the next-generation of data science professionals.This early-concept grant for exploratory research aspires to tackle big data challenges by putting forth large-scale learning tools and their performance analyses that leverage two untested, but potentially transformative, ideas for extracting computationally affordable yet informative subsets of massive and dynamic datasets, namely i) adaptive censoring, and ii) random data sketching-and-validation. Data in this project can be stationary or nonstationary; they become available in batch or sequential (a.k.a. online) modes; they can be collected in vectors, matrices or general multi-way arrays (called tensors); noise, possibly outliers and (un)intentional misses are present; and data processing can be linear or nonlinear in adaptive or non-adaptive modes. The proposed high risk-high payoff research lies at the intersection of essential big data tools including compressive sampling, matrix and tensor completion, anomaly and outlier identification, online and parallel optimization techniques. In accordance with the major inference tasks, three intertwined research thrusts will be pursued: T1) Adaptive censoring for large-scale regressions; T2) Subspace tracking and imputation for dynamic large-scale tensors; and T3) Sketch-and-validate for large-scale clustering and classification. The resultant innovative tools will be tested in healthcare data, and multi-dimensional magnetic resonance imaging, having as ultimate goal high-resolution biomedical movies to be acquired, processed, and displayed in real time.
摘要。随着无处不在的传感器不断收集和记录大量信息,毫无疑问,这是一个数据泛滥的时代。从这些动态和大量的数据中学习,有望带来重大的科学和工程进步,并由此提高生活质量。目前,探索性研究的早期概念拨款旨在开发潜在的变革性模式识别技术,这些技术将在动态变形(例如,由于患者运动)的心脏磁共振图像上进行专门测试,以及从大规模医疗保健数据集中提取信息。这个项目所面临的巨大挑战包括:庞大的在线数据量和不断增长的数据集,这使得运行分析变得不可能,尤其是以批处理的形式;此外,大规模数据集不可避免地存在噪声、动态、不完整、容易出现异常值和(非)故意遗漏,以及容易受到网络攻击的事实。该项目的大规模分析还将为环境数据挖掘、神经科学和未来电网带来跨学科的好处。在更广泛的范围内,开发的技术将为基础科学和工程研究提供有价值的工具,并促进社会对新兴大数据技术的接受,同时培养下一代数据科学专业人员。这项探索性研究的早期概念资助旨在通过提出大规模学习工具及其性能分析来解决大数据挑战,这些工具和性能分析利用了两个未经测试但具有潜在变革性的想法,用于提取大量动态数据集的计算负担得起但信息丰富的子集,即i)自适应审查和ii)随机数据草图和验证。这个项目中的数据可以是平稳的,也可以是非平稳的;它们可以批处理或顺序(也称为在线)模式;它们可以以向量、矩阵或一般的多向数组(称为张量)的形式收集;存在噪声、可能的异常值和(非)故意遗漏;数据处理可以是线性或非线性的自适应或非自适应模式。所提出的高风险高收益研究涉及压缩采样、矩阵和张量完井、异常和离群值识别、在线和并行优化技术等基本大数据工具的交叉。根据主要的推理任务,将进行三个相互交织的研究重点:T1)大规模回归的自适应审查;T2)动态大尺度张量的子空间跟踪与输入;T3)大规模聚类和分类的草图和验证。由此产生的创新工具将在医疗保健数据和多维磁共振成像中进行测试,最终目标是实时获取、处理和显示高分辨率生物医学电影。

项目成果

期刊论文数量(34)
专著数量(0)
科研奖励数量(0)
会议论文数量(0)
专利数量(0)
Topology Identification and Learning Over Graphs: Accounting for Nonlinearities and Dynamics
  • DOI:
    10.1109/jproc.2018.2804318
  • 发表时间:
    2018-05-01
  • 期刊:
  • 影响因子:
    20.6
  • 作者:
    Giannakis, Georgios B.;Shen, Yanning;Karanikolas, Georgios Vasileios
  • 通讯作者:
    Karanikolas, Georgios Vasileios
Kernel-based learning of processes over multi-layer graphs
基于内核的多层图过程学习
  • DOI:
  • 发表时间:
    2018
  • 期刊:
  • 影响因子:
    0
  • 作者:
    Ioannidis, V. N.;Shen, Y.;Traganitis, P. A.;Giannakis, G. B.
  • 通讯作者:
    Giannakis, G. B.
Blind Multi-Class Ensemble Learning with Unequally Reliable Classifiers
具有不同可靠分类器的盲目多类集成学习
Decentralized RLS With Data-Adaptive Censoring for Regressions Over Large-Scale Networks
  • DOI:
    10.1109/tsp.2018.2795594
  • 发表时间:
    2016-12
  • 期刊:
  • 影响因子:
    5.4
  • 作者:
    Zifeng Wang;Zheng Yu;Qing Ling;Dimitris Berberidis;G. Giannakis
  • 通讯作者:
    Zifeng Wang;Zheng Yu;Qing Ling;Dimitris Berberidis;G. Giannakis
Canonical Correlation Analysis of Datasets With a Common Source Graph
  • DOI:
    10.1109/tsp.2018.2853130
  • 发表时间:
    2018-08-15
  • 期刊:
  • 影响因子:
    5.4
  • 作者:
    Chen, Jia;Wang, Gang;Giannakis, Georgios B.
  • 通讯作者:
    Giannakis, Georgios B.
{{ item.title }}
{{ item.translation_title }}
  • DOI:
    {{ item.doi }}
  • 发表时间:
    {{ item.publish_year }}
  • 期刊:
  • 影响因子:
    {{ item.factor }}
  • 作者:
    {{ item.authors }}
  • 通讯作者:
    {{ item.author }}

数据更新时间:{{ journalArticles.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ monograph.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ sciAawards.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ conferencePapers.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ patent.updateTime }}

Georgios Giannakis其他文献

Georgios Giannakis的其他文献

{{ item.title }}
{{ item.translation_title }}
  • DOI:
    {{ item.doi }}
  • 发表时间:
    {{ item.publish_year }}
  • 期刊:
  • 影响因子:
    {{ item.factor }}
  • 作者:
    {{ item.authors }}
  • 通讯作者:
    {{ item.author }}

{{ truncateString('Georgios Giannakis', 18)}}的其他基金

Collaborative Research: ECCS-CCSS Core: Resonant-Beam based Optical-Wireless Communication
合作研究:ECCS-CCSS核心:基于谐振光束的光无线通信
  • 批准号:
    2332173
  • 财政年份:
    2024
  • 资助金额:
    $ 30万
  • 项目类别:
    Standard Grant
Collaborative Research: CIF: Medium: Robust Learning over Graphs
协作研究:CIF:媒介:图上的鲁棒学习
  • 批准号:
    2312547
  • 财政年份:
    2023
  • 资助金额:
    $ 30万
  • 项目类别:
    Continuing Grant
IMR: MM-1C: Learning-driven Models for 5G Internet Measurements
IMR:MM-1C:5G 互联网测量的学习驱动模型
  • 批准号:
    2220292
  • 财政年份:
    2022
  • 资助金额:
    $ 30万
  • 项目类别:
    Standard Grant
Collaborative Research: SWIFT: Cognitive-IoV with Simultaneous Sensing and Communications via Dynamic RF Front End
合作研究:SWIFT:通过动态射频前端实现同步传感和通信的认知车联网
  • 批准号:
    2128593
  • 财政年份:
    2021
  • 资助金额:
    $ 30万
  • 项目类别:
    Standard Grant
CCSS: Online Learning for IoT Monitoring and Management
CCSS:物联网监控和管理在线学习
  • 批准号:
    2126052
  • 财政年份:
    2021
  • 资助金额:
    $ 30万
  • 项目类别:
    Standard Grant
Hybrid mmWave mMIMO Transceiver Design for Doubly-Selective Channels
适用于双选通道的混合毫米波 mMIMO 收发器设计
  • 批准号:
    2102312
  • 财政年份:
    2020
  • 资助金额:
    $ 30万
  • 项目类别:
    Standard Grant
CPS: Medium: Collaborative Research: Collective Intelligence for Proactive Autonomous Driving (CI-PAD)
CPS:中:协作研究:主动自动驾驶集体智慧 (CI-PAD)
  • 批准号:
    2103256
  • 财政年份:
    2020
  • 资助金额:
    $ 30万
  • 项目类别:
    Standard Grant
CIF: Medium: Adaptive Diffusions for Scalable and Robust Learning over Graphs
CIF:中:用于图上可扩展和鲁棒学习的自适应扩散
  • 批准号:
    1901134
  • 财政年份:
    2019
  • 资助金额:
    $ 30万
  • 项目类别:
    Standard Grant
CCSS: Collaborative Research: Learn-and-Adapt to Manage Dynamic Cyber-Physical Networks
CCSS:协作研究:学习和适应管理动态信息物理网络
  • 批准号:
    1711471
  • 财政年份:
    2017
  • 资助金额:
    $ 30万
  • 项目类别:
    Standard Grant
CCSS: Collaborative Research: Smart-Grid Powered Green Communications in Heterogeneous Networks
CCSS:协作研究:异构网络中智能电网驱动的绿色通信
  • 批准号:
    1508993
  • 财政年份:
    2015
  • 资助金额:
    $ 30万
  • 项目类别:
    Standard Grant

相似海外基金

EAGER-DynamicData: Subspace Learning From Binary Sensing
EAGER-DynamicData:从二进制感知中学习子空间
  • 批准号:
    1833553
  • 财政年份:
    2018
  • 资助金额:
    $ 30万
  • 项目类别:
    Standard Grant
EAGER-DynamicData: Generative Statistical Modeling for Dynamic and Distributed Data
EAGER-DynamicData:动态和分布式数据的生成统计建模
  • 批准号:
    1462230
  • 财政年份:
    2015
  • 资助金额:
    $ 30万
  • 项目类别:
    Standard Grant
EAGER-DynamicData: Collaborative Research: Data-driven morphing of parsimonious models for the description of transient dynamics in complex systems
EAGER-DynamicData:协作研究:数据驱动的简约模型变形,用于描述复杂系统中的瞬态动力学
  • 批准号:
    1462254
  • 财政年份:
    2015
  • 资助金额:
    $ 30万
  • 项目类别:
    Standard Grant
EAGER-DynamicData: A Scalable Framework for Data-Driven Real-Time Event Detection in Power Systems
EAGER-DynamicData:电力系统中数据驱动的实时事件检测的可扩展框架
  • 批准号:
    1462311
  • 财政年份:
    2015
  • 资助金额:
    $ 30万
  • 项目类别:
    Standard Grant
EAGER-DynamicData: Reducing Orbital Position Uncertainty with Ensembles of Upper Atmospheric Models
EAGER-DynamicData:利用高层大气模型集合降低轨道位置不确定性
  • 批准号:
    1462363
  • 财政年份:
    2015
  • 资助金额:
    $ 30万
  • 项目类别:
    Standard Grant
Collaborative Research: EAGER-DynamicData: Machine Intelligence for Dynamic Data-Driven Morphing of Nodal Demand in Smart Energy Systems
合作研究:EAGER-DynamicData:智能能源系统中节点需求动态数据驱动变形的机器智能
  • 批准号:
    1462393
  • 财政年份:
    2015
  • 资助金额:
    $ 30万
  • 项目类别:
    Standard Grant
EAGER- DynamicData: Novel Approaches for Optimization, Control, and Learning in Distributed Networks
EAGER-DynamicData:分布式网络中优化、控制和学习的新方法
  • 批准号:
    1462397
  • 财政年份:
    2015
  • 资助金额:
    $ 30万
  • 项目类别:
    Standard Grant
EAGER-DynamicData: Collaborative: Exploiting the Dynamically Architectural Configurability for Compressed Sensing
EAGER-DynamicData:协作:利用压缩感知的动态架构可配置性
  • 批准号:
    1462473
  • 财政年份:
    2015
  • 资助金额:
    $ 30万
  • 项目类别:
    Standard Grant
EAGER-DynamicData: Collaborative Research: Data-driven morphing of parsimonious models for the description of transient dynamics in complex systems
EAGER-DynamicData:协作研究:数据驱动的简约模型变形,用于描述复杂系统中的瞬态动力学
  • 批准号:
    1462241
  • 财政年份:
    2015
  • 资助金额:
    $ 30万
  • 项目类别:
    Standard Grant
Collaborative Research: EAGER-DynamicData: Machine Intelligence for Dynamic Data-Driven Morphing of Nodal Demand in Smart Energy Systems
合作研究:EAGER-DynamicData:智能能源系统中节点需求动态数据驱动变形的机器智能
  • 批准号:
    1462404
  • 财政年份:
    2015
  • 资助金额:
    $ 30万
  • 项目类别:
    Standard Grant
{{ showInfoDetail.title }}

作者:{{ showInfoDetail.author }}

知道了