权益分类	功能权益	普通用户	{{item.name}}会员
{{category.name}}	{{benefitItem.name}}

CAREER: Perceptually Guided Hand Motion Synthesis

职业：感知引导的手部动作合成

基本信息

批准号：
1652210
负责人：
Sophie Joerg
金额：
$ 49.72万
依托单位：
Clemson University
依托单位国家：
美国
项目类别：
Continuing Grant
财政年份：
2017
资助国家：
美国
起止时间：
2017-02-01 至 2025-01-31
项目状态：
未结题

来源：
https://www.nsf.gov/awardsearch/showAward?AWD_ID=1652210&HistoricalAwards=false
关键词：
CAREER Perceptually Guided Hand Motion

项目摘要

This research will explore ways to automatically synthesize hand and finger animation for virtual characters that exploit human perception as an inherent part of the algorithm. In recent years, character animation has taken tremendous strides towards realistic virtual agents, with increasingly better solutions for body motion capture, for achieving highly realistic facial animation, and for simulating cloth and hair. With these key components in place, the need to create plausible hand and finger motions has become important because these play a crucial role in communicating information while also allowing us to conduct basic tasks and to handle complex tools. But the differences in size and complexity of hand motions compared to body motions make it difficult to capture or synthesize both at the same time. Therefore, finger motions are typically still animated manually, which is a cumbersome process. Taking advantage of perceptual findings could enable the creation of new algorithms to accomplish this task (e.g., by suggesting new methods and by aiding in algorithm parameter adjustment). The ultimate goal of this research is to merge character animation and motion perception into an interdisciplinary field that yields new insights and approaches to finger and hand movement synthesis as well as a better understanding of how we communicate. If successful, the work will significantly advance the way we design algorithms to bring virtual characters to life, and project outcomes will have broad impact not only in computer graphics but also in applications such as virtual reality, robotics and prosthetics. The project includes integrated educational and outreach activities for K-12, undergraduate, and graduate students. This research will initiate a fundamental transformation of how we design algorithms for character animation by coupling perceptual experiments with computer animation algorithm development for hand and finger motion synthesis. Several approaches and devices have been suggested for hand and finger animation, each with their own drawbacks. Some of these approaches show promise and could be improved or combined, but the options are many and a more systematic approach is required. This work will focus on two applications: data-driven hand motion synthesis for virtual characters, and hand motions for interaction and communication in virtual reality. The plan is to develop an algorithm for hand motion synthesis based on segment and pose matching, on perceptual insights on the relevance of finger poses and dynamics, and on the perception of collisions, to support real-time interaction in virtual reality.

本研究将探索利用人类感知作为算法固有部分的虚拟人物自动合成手和手指动画的方法。近年来，角色动画在逼真的虚拟代理方面取得了巨大的进步，在身体动作捕捉、实现高度逼真的面部动画以及模拟布料和头发方面有了越来越好的解决方案。有了这些关键部件，创造合理的手部和手指动作就变得很重要，因为这些动作在信息交流中起着至关重要的作用，同时也使我们能够执行基本任务和处理复杂的工具。但是，与身体动作相比，手部动作的大小和复杂性的差异使得同时捕捉或合成两者变得困难。因此，手指运动通常仍然是手动动画，这是一个繁琐的过程。利用感知发现可以创建新的算法来完成这项任务（例如，通过提出新的方法和帮助算法参数调整）。这项研究的最终目标是将角色动画和运动感知合并到一个跨学科领域，产生新的见解和方法来手指和手的运动合成，以及更好地理解我们如何沟通。如果成功，这项工作将大大推进我们设计算法的方式，使虚拟人物栩栩如生，项目成果将不仅在计算机图形学领域，而且在虚拟现实、机器人和假肢等应用领域产生广泛影响。该项目包括针对K-12、本科生和研究生的综合教育和推广活动。本研究将通过将感知实验与手和手指运动合成的计算机动画算法开发相结合，启动我们如何设计角色动画算法的根本性转变。对于手和手指动画，已经提出了几种方法和设备，每种方法和设备都有自己的缺点。其中一些方法显示出希望，可以加以改进或结合，但可供选择的方法很多，需要一种更系统的方法。这项工作将集中在两个应用上：数据驱动的虚拟人物手部动作合成，以及虚拟现实中用于交互和交流的手部动作。该计划是开发一种基于片段和姿势匹配的手部运动合成算法，基于对手指姿势和动态相关性的感知洞察，以及对碰撞的感知，以支持虚拟现实中的实时交互。

项目成果

期刊论文数量（5）

专著数量（0）

科研奖励数量（0）

会议论文数量（0）

专利数量（0）

Performance Is Not Everything: Audio Feedback Preferred Over Visual Feedback for Grasping Task in Virtual Reality

性能并不代表一切：在虚拟现实中的抓取任务中，音频反馈优于视觉反馈

DOI：
10.1145/3424636.3426897
发表时间：
2020
期刊：
Interaction and Games
影响因子：
0
作者：
Canales, Ryan;Jörg, Sophie
通讯作者：
Jörg, Sophie

Virtual Grasping Feedback and Virtual Hand Ownership

DOI：
10.1145/3343036.3343132
发表时间：
2019-09
期刊：
ACM Symposium on Applied Perception 2019
影响因子：
0
作者：
Ryan Canales;Aline Normoyle;Yu Sun;Yuting Ye;Massimiliano Di Luca;S. Jörg
通讯作者：
Ryan Canales;Aline Normoyle;Yu Sun;Yuting Ye;Massimiliano Di Luca;S. Jörg

How Important are Detailed Hand Motions for Communication for a Virtual Character Through the Lens of Charades?

通过字谜镜头，详细的手势对于虚拟角色的交流有多重要？

DOI：
10.1145/3578575
发表时间：
2023
期刊：
ACM Transactions on Graphics
影响因子：
6.2
作者：
Adkins, Alex;Normoyle, Aline;Lin, Lorraine;Sun, Yu;Ye, Yuting;Di Luca, Massimiliano;Jörg, Sophie
通讯作者：
Jörg, Sophie

Evaluating Grasping Visualizations and Control Modes in a VR Game