I-CORPS: First Person Visual Analytics
I-CORPS: First Person Visual Analytics
批准号:
1600474
负责人:
James Rehg
金额:
$5.0万
依托单位国家:
美国
项目类别:
Standard Grant
财政年份:
2016
资助国家:
美国
项目状态:
已结题
起止时间:
2016-02-15 至 2016-07-31
中文摘要
迫切需要对自闭症谱系障碍(ASD)患者的社会行为进行直接、持续和客观的测量,这些个体对治疗相关的变化很敏感。通过测量行为变化来跟踪治疗进展,对于确定治疗是否有效或需要修改至关重要。直接观察措施,如现场或基于视频的评分,需要耗费大量时间和资源,而且几乎不可能在诊所和家庭中实施,因为这些地方的治疗越来越多。目前还没有标准的、客观的、可靠的关键社会行为的测量方法,可以在临床环境中用于评估ASD患者的治疗结果。该项目的目标是开发视觉分析工具,以便从可穿戴相机拍摄的视频中自动检测和量化感兴趣的社会行为,I-Corps团队将这项任务称为第一人称视觉(FPV)。在之前的工作中,该团队开发了一种方法,通过分析成人戴的一副市售眼镜记录的视频,自动检测儿童与成人社交伙伴眼神接触的时刻,这种眼镜的鼻梁上嵌入了一个摄像头。通过在视频中识别和定位儿童的头部和面部,并结合头部姿势分析包含眼睛的图像区域,该算法可以确定儿童的目光是否指向成人的眼睛。所提出的方法可以在帧水平上产生眼神接触的预测,也可以用于检测眼神接触事件,从中可以导出持续时间的测量。如果得到适当的发展,提出的测量方法可能使临床提供者能够扩大他们的干预努力,有可能改善成千上万自闭症儿童及其家庭的生活质量。更广泛地说,用于从随身摄像机(第一人称视频)捕获视频的分析工具将为建模和分析人类行为提供新的机会,创建个性化的视觉体验记录,并改善广泛的精神和身体健康状况的治疗。该团队将在人力资源培训和产品营销领域进行更多的客户发现,并有可能将我们的分析重点从凝视行为扩展到与这些背景相关的其他社会行为,如面部表情和手势。该团队还希望开发一个硬件原型(具有宽视场的可穿戴相机系统),并将我们团队开发的分析功能(自动检测眼神接触、对物体的注意力、目光转移的算法)整合到系统中。提议的原型还将包括可视化和向用户报告自动分析结果的选项。
英文摘要
There is an urgent need for direct, continuous, and objective measures of social behavior in individuals with Autism Spectrum Disorder (ASD) that are sensitive to treatment-related change. Tracking progress by measuring changes in behavior is crucial to determine whether the treatment is working or needs to be modified. Direct observational measures, such as live or video-based scoring, are time and resource intensive, and all but impossible to implement in clinics and homes, where treatments are increasingly delivered. There are currently no standardized, objective, and reliable measures of key social behaviors that can be used in clinical settings to assess treatment outcomes in individuals with ASD. The goal of this project is to develop visual analytics tools to enable the automatic detection and quantification of social behaviors of interest from video captured by a wearable camera, a task this I-Corps team refers to as First Person Vision (FPV). In previous work, this team developed a method for automatically detecting moments when a child makes eye contact with an adult social partner by analyzing video recorded by a pair of commercially available glasses worn by the adult which had a camera embedded in the bridge over the nose. By identifying and localizing the child's head and face in the video and analyzing the image regions containing the eyes in conjunction with the head pose, the proposed algorithm can determine whether the child's gaze is directed towards the adult's eyes. The proposed approach can generate predictions for eye contact at the frame level, and can also be used to detect eye contact events from which measures of duration can be derived. If properly developed, the proposed measurement approach may enable clinical providers to scale their intervention efforts, with the potential of improving the quality of life for thousands of children with autism and their families. More broadly, analytics tools for video captured from body-worn cameras (first person video) will provide new opportunities to model and analyze human behavior, create personalized records of visual experiences, and improve the treatment of a broad range of mental and physical health conditions. This team will conduct additional customer discovery in the areas of human resources training and product marketing, with the potential of expanding the focus of our analytics from gaze behavior to other social behaviors relevant to these contexts, such as facial expressions and gestures. The team also expects to develop a prototype of the hardware (wearable camera system with wide field of view) and incorporate analytic capabilities developed by our group (algorithms for automated detection of eye contact, attention to objects, gaze shifts) into the system. the proposed prototype will also include options for visualizing and reporting the results of the automated analysis back to the user.
期刊论文(0)
专著(0)
科研奖励(0)
会议论文
CRI: CI-EN: Collaborative Research: mResearch: A platform for Reproducible and Extensible Mobile Sensor Big Data Research
-
批准号:1823201
-
项目类别:Standard Grant
-
资助金额:$22.5万
-
财政年份:2018
-
负责人:James Rehg
-
依托单位:
Comp Cog: Collaborative Research on the Development of Visual Object Recognition
-
批准号:1524565
-
项目类别:Continuing Grant
-
资助金额:$31.36万
-
财政年份:2015
-
负责人:James Rehg
-
依托单位:
RI: Small: A Compositional Approach to Video Segmentation
-
批准号:1320348
-
项目类别:Standard Grant
-
资助金额:$48.34万
-
财政年份:2013
-
负责人:James Rehg
-
依托单位:
RI: Small: Temporal Causality For Video Event Analysis
-
批准号:1016772
-
项目类别:Standard Grant
-
资助金额:$45.58万
-
财政年份:2010
-
负责人:James Rehg
-
依托单位:
Collaborative Research: Automating the Large-Scale Measurement of Insect Behavior
-
批准号:0960618
-
项目类别:Continuing Grant
-
资助金额:$78.49万
-
财政年份:2010
-
负责人:James Rehg
-
依托单位:
Collaborative Research: Sino-USA Summer School in Vision, Learning, Pattern Recognition VLPR 2010
-
批准号:1037845
-
项目类别:Standard Grant
-
资助金额:$2.5万
-
财政年份:2010
-
负责人:James Rehg
-
依托单位:
Collaborative Research: Computational Behavioral Science: Modeling, Analysis, and Visualization of Social and Communicative Behavior
-
批准号:1029679
-
项目类别:Continuing Grant
-
资助金额:$325.07万
-
财政年份:2010
-
负责人:James Rehg
-
依托单位:
Collaborative Research:Creating Dynamic Social Network Models from Sensor Data
-
批准号:0433012
-
项目类别:Standard Grant
-
资助金额:$16.05万
-
财政年份:2004
-
负责人:James Rehg
-
依托单位:
ITR: Analysis of Complex Audio-Visual Events Using Spatially Distributed Sensors
-
批准号:0205507
-
项目类别:Continuing Grant
-
资助金额:$106.57万
-
财政年份:2002
-
负责人:James Rehg
-
依托单位:
CAREER: Motion Capture from Movies: Video-Based Tracking and Modeling of Human Motion
-
批准号:0133779
-
项目类别:Continuing Grant
-
资助金额:$37.0万
-
财政年份:2002
-
负责人:James Rehg
-
依托单位:
Interdisciplinary Automated Manufacturing Laboratory for theElectro-Mechanical Engineering Technology Program
-
批准号:9651001
-
项目类别:Standard Grant
-
资助金额:$5.03万
-
财政年份:1996
-
负责人:James Rehg
-
依托单位:
Process Control Laboratory Exercises
-
批准号:8162786
-
项目类别:Standard Grant
-
资助金额:$1.33万
-
财政年份:1981
-
负责人:James Rehg
-
依托单位:
Course Improvement Through Equipment Integration
-
批准号:7814652
-
项目类别:Standard Grant
-
资助金额:$0.4万
-
财政年份:1978
-
负责人:James Rehg
-
依托单位:
国内基金
海外基金
“Lignin-first”策略下镁碱催化原生木质素定向氧化为小分子有机酸的机制研究
-
批准号:21908075
-
项目类别:青年科学基金项目
-
资助金额:25.0万元
-
批准年份:2019
-
负责人:蒋叶涛
-
依托单位:
基于First Principles的光催化降解PPCPs同步脱氮体系构建及其电子分配机制研究
-
批准号:51778175
-
项目类别:面上项目
-
资助金额:59.0万元
-
批准年份:2017
-
负责人:丁杰
-
依托单位: