CIF: AF: Small: Foundations of Multimodal Information Integration
CIF: AF: Small: Foundations of Multimodal Information Integration
批准号:
1712867
负责人:
Guillermo Sapiro
金额:
$43.17万
依托单位:
依托单位国家:
美国
项目类别:
Standard Grant
财政年份:
2017
资助国家:
美国
项目状态:
已结题
起止时间:
2017-09-01 至 2023-09-30
中文摘要
数据以各种形式出现,包括视觉、文本、医疗记录和社交媒体上的评论。当数据稀缺、噪声和不确定时,这种多样化(多模式)数据至关重要。不同的模式可以改进联合推理和决策,并允许(以极低的成本)产生以前只有高端设备和技术才能实现的结果。此外,从意想不到的数据来源推断疾病在从营销到医疗保健和国防等领域都是至关重要的。这个项目用新的数学和计算工具解决了这些根本挑战。通过新的合作,该项目获得了独特的数据和对人类福祉有重大影响的问题。一个相关的在线课程也在继续增长和发展,到目前为止已经有超过12万名学生。一个独特的暑期沉浸项目还将让本科生参与多模式数据科学研究。多模式数据的开发是该项目的统一主题之一。另一个统一的主题是基本的数学基础:子空间建模和嵌入。这里开发了从子空间建模的工具,这些工具包括学习多模低阶表示、建模多模稀疏网络以及求解大数据矩阵分解。这项工作的第三个统一主题是对计算效率的普遍考虑。所有这些都由三个主要部分组成:分类和识别、数据增强和网络分析。该项目解决了多模式人脸识别、动态多模式图形推理、凝视分析、多模式网络分析和非负矩阵分解等关键问题。总体目标是有效地利用和集成多模式数据,以帮助联合推理和决策。
英文摘要
Data comes in all forms, including visual, text, medical records, and comments on social medial. This diverse (multimodal) data is critical when data is scarce, noisy, and uncertain. Different modalities can improve joint inference and decision making and allow producing (at extremely low-cost) results that were possible only with high-end devices and techniques before. In addition, inferring a condition from unexpected data sources is of paramount importance in disciplines ranging from marketing to health-care and defense. This project addresses these fundamental challenges with new mathematical and computational tools. Through new collaborations, the project has access to unique data and problems of significant impact in human well-being. A related online class also continues to grow and develop, with over 120,000 students so far. A unique summer immersion program will also involve undergraduate students in multimodal data science research. The exploitation of multimodal data is one of the unifying themes of this project. A further unifying theme is the underlying mathematical foundation: subspace modeling and embedding. Tools from subspace modeling in the form of learning multimodal low-rank representations, modeling multimodal sparse networks, and solving for big data matrix decompositions are here developed. A third unifying motif of this work is the ubiquitous consideration of computational efficiency. All the above is developed in three major components: classification and recognition, data augmentation, and network analysis. The project addresses critical problems such as multimodal face recognition, dynamic multimodal graph inference, gaze analysis, multimodal network analysis, and non-negative matrix factorization. The overall goal is to efficiently exploit and integrate multimodal data to help in joint inference and decision making.
期刊论文(40)
专著(0)
科研奖励(0)
会议论文
登录
查看更多内容
Measuring robustness of brain networks in autism spectrum disorder with Ricci curvature
用里奇曲率测量自闭症谱系障碍大脑网络的鲁棒性
DOI:
10.1101/722025
发表时间:
2020
期刊:
Scientific report
影响因子:
--
作者:
[A. Simhal, K. Carpenter]
通讯作者:
A. Simhal, K. Carpenter
DOI:
10.1109/taffc.2018.2890610
发表时间:
2021-07
期刊:
IEEE TRANSACTIONS ON AFFECTIVE COMPUTING
影响因子:
11.2
作者:
[Bovery, Matthieu, Dawson, Geraldine, Hashemi, Jordan, Sapiro, Guillermo]
通讯作者:
Sapiro, Guillermo
Using text to teach image retrieval
使用文本教授图像检索
DOI:
10.1109/cvprw53098.2021.00180
发表时间:
2021
期刊:
CVPR 2021 Workshop
影响因子:
--
作者:
[H. Dong, Z. Wang]
通讯作者:
H. Dong, Z. Wang
DOI:
10.1038/s41598-018-35215-8
发表时间:
2018-11-19
期刊:
Scientific reports
影响因子:
4.6
作者:
[Dawson G, Campbell K, Hashemi J, Lippmann SJ, Smith V, Carpenter K, Egger H, Espinosa S, Vermeer S, Baker J, Sapiro G]
通讯作者:
Sapiro G
Fairness With minimal harm: A Pareto-optimal approach for healthcare
公平且伤害最小:帕累托最优的医疗保健方法
DOI:
--
发表时间:
2019
期刊:
NeurIPS ML4H: Machine Learning for Health
影响因子:
--
作者:
[N. Martinez, M. Bertran]
通讯作者:
N. Martinez, M. Bertran
共 23 条
CIF: Small: Foundations and Applications of Blind Subgroup Robustness
-
批准号:2120018
-
项目类别:Standard Grant
-
资助金额:$45.11万
-
财政年份:2021
-
负责人:Guillermo Sapiro
-
依托单位:
Collaborative Research: Transferable, Hierarchical, Expressive, Optimal, Robust, Interpretable Networks
-
批准号:2031849
-
项目类别:Continuing Grant
-
资助金额:$100.0万
-
财政年份:2020
-
负责人:Guillermo Sapiro
-
依托单位:
ATD: The Foundations of Dynamic Drone-Based Threat Detection
-
批准号:1737744
-
项目类别:Continuing Grant
-
资助金额:$19.99万
-
财政年份:2017
-
负责人:Guillermo Sapiro
-
依托单位:
AF: SMALL: Learning to Parsimoniously Model and Compute with Big Data
-
批准号:1318168
-
项目类别:Standard Grant
-
资助金额:$36.7万
-
财政年份:2013
-
负责人:Guillermo Sapiro
-
依托单位:
Learning sparse representations for restoration and classification: Theory, Computations, and Applications in Image, Video, and Multimodal Analysis
-
批准号:1249263
-
项目类别:Standard Grant
-
资助金额:$11.04万
-
财政年份:2012
-
负责人:Guillermo Sapiro
-
依托单位:
Learning sparse representations for restoration and classification: Theory, Computations, and Applications in Image, Video, and Multimodal Analysis
-
批准号:0829700
-
项目类别:Standard Grant
-
资助金额:$30.56万
-
财政年份:2008
-
负责人:Guillermo Sapiro
-
依托单位:
Image and Video Inpainting
-
批准号:0429037
-
项目类别:Standard Grant
-
资助金额:$0.0万
-
财政年份:2004
-
负责人:Guillermo Sapiro
-
依托单位:
US-France Cooperative Research: Computational Tools for Brain Research
-
批准号:0404617
-
项目类别:Standard Grant
-
资助金额:$0.0万
-
财政年份:2004
-
负责人:Guillermo Sapiro
-
依托单位:
Collaborative Research-ITR-High Order Partial Differential Equations: Theory, Computational Tools, and Applications in Image Processing, Computer Graphics, Biology, and Fluids
-
批准号:0324779
-
项目类别:Continuing Grant
-
资助金额:$40.0万
-
财政年份:2003
-
负责人:Guillermo Sapiro
-
依托单位:
ITR: Distances and Generalized Geodesics for High-Dimensional Implicit and Point Cloud Surfaces:Theory, Computational Framework, and Applications in Information Sciences and Eng.
-
批准号:0309575
-
项目类别:Standard Grant
-
资助金额:$24.0万
-
财政年份:2003
-
负责人:Guillermo Sapiro
-
依托单位:
CAREER - Intelligent PDE's: Introducing Knowledge into Geometry Driven Image Deformations
-
批准号:9873670
-
项目类别:Standard Grant
-
资助金额:$21.0万
-
财政年份:1999
-
负责人:Guillermo Sapiro
-
依托单位:
国内基金
海外基金
登录
查看更多内容
基于前瞻性队列的双酚AF联合果糖加重代谢损伤的靶向代谢组学研究
-
批准号:2025JJ30049
-
项目类别:省市级项目
-
资助金额:--
-
批准年份:2025
-
负责人:王穆
-
依托单位:
U2AF2-circMMP1信号轴促进结直肠癌进展的分子机制研究
-
批准号:2025JJ80723
-
项目类别:省市级项目
-
资助金额:--
-
批准年份:2025
-
负责人:吴明浩
-
依托单位:
U2AF2精氯酸甲基化调控RNA转录合成在MTAP缺失骨肉瘤T细胞耗竭中的机制研究
-
批准号:--
-
项目类别:青年科学基金项目
-
资助金额:--
-
批准年份:2024
-
负责人:穆浩然
-
依托单位:
BDA-366通过MYD88/NF-κB/PGC1β通路杀伤 KMT2A/AF9 AML细胞的机制研究
-
批准号:
-
项目类别:省市级项目
-
资助金额:15.0万元
-
批准年份:2024
-
负责人:吴利新
-
依托单位:
Lu AF21934减少缺血性脑卒中导致的神经损伤的机制研究
-
批准号:
-
项目类别:省市级项目
-
资助金额:--
-
批准年份:2024
-
负责人:
-
依托单位:
H2S介导剪接因子BraU2AF65a的S-巯基化修饰促进大白菜开花的分子机制
-
批准号:32372727
-
项目类别:面上项目
-
资助金额:50万元
-
批准年份:2023
-
负责人:裴雁曦
-
依托单位:
AF9通过ARRB2-MRGPRB2介导肠固有肥大细胞活化促进重症急性胰腺炎发生MOF的研究
-
批准号:82300739
-
项目类别:青年科学基金项目
-
资助金额:30万元
-
批准年份:2023
-
负责人:贺君
-
依托单位:
剪接因子U2AF1突变在急性髓系白血病原发耐药中的机制研究
-
批准号:82370157
-
项目类别:面上项目
-
资助金额:49万元
-
批准年份:2023
-
负责人:李军民
-
依托单位:
线粒体活性氧介导的胎盘早衰在孕期双酚AF暴露致婴幼儿神经发育迟缓中的作用
-
批准号:82304160
-
项目类别:青年科学基金项目
-
资助金额:30万元
-
批准年份:2023
-
负责人:张超
-
依托单位:
U2AF2-circMMP1调控能量代谢促进结直肠癌肝转移的分子机制
-
批准号:82303789
-
项目类别:青年科学基金项目
-
资助金额:30万元
-
批准年份:2023
-
负责人:翟晓慧
-
依托单位: