权益分类	功能权益	普通用户	{{item.name}}会员
{{category.name}}	{{benefitItem.name}}

CAREER:Towards Perceptual Agents That See and Reason Like Humans

职业生涯：迈向像人类一样观察和推理的感知主体

基本信息

批准号：
1749833
负责人：
Subhransu Maji
金额：
$ 54.56万
依托单位：
University of Massachusetts Amherst
依托单位国家：
美国
项目类别：
Standard Grant
财政年份：
2018
资助国家：
美国
起止时间：
2018-06-01 至 2024-05-31
项目状态：
已结题

来源：
https://www.nsf.gov/awardsearch/showAward?AWD_ID=1749833&HistoricalAwards=false
关键词：
CAREER Towards Perceptual Agents See

项目摘要

Recent advancements in computer vision systems have enabled their widespread deployment in areas like social media, healthcare, robotics, and ecology, among many others. While such applications hold exceptional promise for improving our well-being and advancing scientific discovery, the ubiquity of these intelligent systems presents new technical, social, and cultural challenges for their wide-scale adoption. This project leads an integrated effort of research, teaching, and outreach to address some of these challenges. The project develops architectures that are substantially more accurate and capable of extracting detailed information from perceptual data across different modalities. An emphasis of this work is to develop computer vision systems that can reason about data in ways that are interpretable by humans. This project also promotes diversity, engages high school, undergraduate, and graduate students in research activities, and fosters collaborations with industry and researchers in areas such as ecology and biology through workshops.This research explores new directions that improve the capabilities of visual perception and reasoning systems for analyzing image data, spatio-temporal data, and depth data. The research develops a novel class of graph-based and factorized architectures for 3D shape and spatio-temporal analysis that provide better tradeoffs between computational cost, memory overhead, and accuracy than existing models. The research develops weakly supervised techniques for learning shape and motion representations from large amounts of unlabeled data. The research also develops a novel class of techniques for transforming visual data to semantic representations such as attributes, natural language, and symbolic programs. These techniques will improve the interpretability of machine learning models and enable collaborative learning and inference between humans and AI agents.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

计算机视觉系统的最新进展使其能够在社交媒体，医疗保健，机器人和生态等领域广泛部署。虽然这些应用程序在改善我们的福祉和推进科学发现方面具有特殊的前景，但这些智能系统的普遍存在为其大规模采用带来了新的技术，社会和文化挑战。该项目领导研究，教学和推广的综合努力，以解决其中一些挑战。该项目开发的架构更加准确，能够从不同模态的感知数据中提取详细信息。这项工作的重点是开发计算机视觉系统，可以以人类可解释的方式对数据进行推理。此外，本研究还通过研讨会，促进多样性，让高中生、大学生、研究生参与到研究活动中来，并与产业界和生态学、生物学等领域的研究人员开展合作。本研究探索了提高图像数据、时空数据、深度数据的视觉感知和推理系统的能力的新方向。该研究开发了一类新的基于图形和因子分解的架构，用于3D形状和时空分析，与现有模型相比，这些架构在计算成本、内存开销和准确性之间提供了更好的权衡。该研究开发了弱监督技术，用于从大量未标记数据中学习形状和运动表示。该研究还开发了一类新的技术，用于将视觉数据转换为属性，自然语言和符号程序等语义表示。该奖项反映了NSF的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

项目成果

期刊论文数量（15）

专著数量（0）

科研奖励数量（0）

会议论文数量（0）

专利数量（0）

Inferring 3D Shapes from Image Collections Using Adversarial Networks

DOI：
10.1007/s11263-020-01335-w
发表时间：
2020-06-24
期刊：
INTERNATIONAL JOURNAL OF COMPUTER VISION
影响因子：
19.5
作者：
Gadelha, Matheus;Rai, Aartika;Wang, Rui
通讯作者：
Wang, Rui

PhraseCut: Language-Based Image Segmentation in the Wild

DOI：
10.1109/cvpr42600.2020.01023
发表时间：
2020-06
期刊：
2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
影响因子：
0
作者：
Chenyun Wu-;Zhe Lin;Scott D. Cohen;Trung Bui;Subhransu Maji
通讯作者：
Chenyun Wu-;Zhe Lin;Scott D. Cohen;Trung Bui;Subhransu Maji

When Does Self-supervision Improve Few-shot Learning?

DOI：
10.1007/978-3-030-58571-6_38
发表时间：
2019-10
期刊：
影响因子：
0
作者：
Jong-Chyi Su;Subhransu Maji;B. Hariharan
通讯作者：
Jong-Chyi Su;Subhransu Maji;B. Hariharan

PriFit: Learning to Fit Primitives Improves Few Shot Point Cloud Segmentation

DOI：
10.1111/cgf.14601
发表时间：
2021-12
期刊：
Computer Graphics Forum
影响因子：
2.5
作者：
Gopal Sharma;Bidya Dash;Aruni RoyChowdhury;Matheus Gadelha;Marios Loizou;Liangliang Cao;Rui Wang;E. Learned-Miller;Subhransu Maji;E. Kalogerakis
通讯作者：
Gopal Sharma;Bidya Dash;Aruni RoyChowdhury;Matheus Gadelha;Marios Loizou;Liangliang Cao;Rui Wang;E. Learned-Miller;Subhransu Maji;E. Kalogerakis

Label-Efficient Learning on Point Clouds using Approximate Convex Decompositions

DOI：
10.1007/978-3-030-58607-2_28
发表时间：
2020-03
期刊：
ArXiv
影响因子：
0
作者：
Matheus Gadelha;Aruni RoyChowdhury;Gopal Sharma;E. Kalogerakis;Liangliang Cao;E. Learned-Miller;Rui Wang;Subhransu Maji
通讯作者：
Matheus Gadelha;Aruni RoyChowdhury;Gopal Sharma;E. Kalogerakis;Liangliang Cao;E. Learned-Miller;Rui Wang;Subhransu Maji