AutoViDev: A Computer-Vision Framework to Enhance and Accelerate Research in Human Development

AutoViDev: A Computer-Vision Framework to Enhance and Accelerate Research in Human Development
复制标题

AutoViDev:增强和加速人类发展研究的计算机视觉框架

DOI:
--
复制
发表时间:
2019
期刊:
Advances in Intelligent Systems and Computing
影响因子:
--
通讯作者:
K. Adolph
K. Adolph
中科院分区:
--
文献类型:
--
作者:
O. Ossmy;R. Gilmore;K. Adolph

文献摘要

参考文献

被引文献

相似文献

跨学科的思想和工具交流可以加速科学进步。例如,发展和视觉科学的发现推动了人工智能和计算机视觉的最新进展。然而,相对较少关注人工智能和计算机视觉如何促进发展科学的研究。目前的研究提出了AutoViDev-a自动视频分析工具,使用机器学习和计算机视觉来支持基于视频的发展研究。AutoViDev使用卷积姿势机器学习算法在实时视频流中识别全身位置估计。AutoViDev提供了关于各种行为的有价值的信息,包括注视方向、面部表情、姿势、运动、手动动作以及与对象的交互。我们提出了该框架的高级体系结构,并描述了两个展示其可用性的项目。我们讨论了将AutoViDev应用于大规模共享视频数据集的好处,并强调了机器学习和计算机视觉如何增强和加速发展科学的研究。
Interdisciplinary exchange of ideas and tools can accelerate scientific progress. For example, findings from developmental and vision science have spurred recent advances in artificial intelligence and computer vision. However, relatively little attention has been paid to how artificial intelligence and computer vision can facilitate research in developmental science. The current study presents AutoViDev—an automatic video-analysis tool that uses machine learning and computer vision to support video-based developmental research. AutoViDev identifies full body position estimations in real-time video streams using convolutional pose machine-learning algorithms. AutoViDev provides valuable information about a variety of behaviors, including gaze direction, facial expressions, posture, locomotion, manual actions, and interactions with objects. We present a high-level architecture of the framework and describe two projects that demonstrate its usability. We discuss the benefits of applying AutoViDev to large-scale, shared video datasets and highlight how machine learning and computer vision can enhance and accelerate research in developmental science.
通过开放视频数据共享改变教育研究。
DOI: --
发表时间: 2016
影响因子: --
作者:
Gilmore,RickO;Adolph,KarenE;Millman,DavidS;Gordon,Andrew
通讯作者: Gordon,Andrew
视频作为数据:从瞬态行为到有形记录。
DOI: --
发表时间: 2016
期刊: APS observer
影响因子: --
作者:
Adolph,Karen
通讯作者: Adolph,Karen