CISE Research Resources: The LiveActor Virtual Reality Environment

EIA 0224432 Badler，Norman I.宾夕法尼亚大学标题：CEISE RR：LiveActor虚拟现实环境这个建议，创建、控制实时体现的虚拟人类代理并与其交互，旨在支持需要交互支持的研究项目，以检测、建模和描述人类参与者的运动，用于建立动作模型或为人际交互提供实时输入，例如培训和使人类参与者在有利于在物体以及真实和虚拟人的环境中执行动作的可视环境中。将购买组件，以构建实时参与者在交互体验中的沉浸式空间。这个房间将由一个扬升反应堆运动捕捉系统和一个名为LiveActor的四面背投影室组成。反过来，这个设施至少支持三个研究项目：动词语义的计算模型、实时决策关键训练和来自语言的虚拟动画环境。第一个项目使用了一个参数化的动作表示(PAR)，它保存了人类和其他主体运动的计算定义。PAR既用于合成动画，又用于识别运动捕捉输入流中的存在。参与者彼此交互并与虚拟代理交互的沉浸式环境为捕获、表征和表现真实的物理和情感行为以及使用这些行为来影响和控制虚拟代理中的反应行为提供了机会。第二个项目利用具体化代理的图形描绘来进行近距离接触训练，要求用户分析面部动作、身体姿势和手势质量并做出反应。与VR导航和探索根本不同的是，这些交互需要真实的人体模型和详细的、可变的、可控的参数。最后一个项目鼓励探索，但不鼓励建筑和动画，因为必须提前设计和编写VR世界的脚本，这构成了一个瓶颈。这个项目提出了一种“想象”机器，用户可以在其中创建、填充和动画他们自己的虚拟世界。自然语言理解情况和动作的描述，描述图形排列，并将当前和未来的上下文相关行为设置到其动画代理中，是该系统的主要组成部分。身临其境的LiveActor空间允许用户输入自己的身体动作，用于角色及其交互的特定但可参数化的动作。

EIA 0224432Badler, Norman I.University of Pennsylvania Title: CISE RR: The LiveActor Virtual Reality Environment This proposal, creating, controlling, and interacting with real-time embodied virtual human agents, aims at supporting research projects that require interactivity support toDetect, model, and describe human participant motion either for building action models or for providing real-time input to interpersonal interactions, such as training andImmerse the human participant in a visual environment conducive to the execution of actions in a context of objects and both real and virtual people.Components will be purchased to construct an immersive room for real-time participants in interactive experiences. The room will consist of an Ascension ReaCTor motion capture system and a 4 surface rear-projection room, called the LiveActor. In turn, this facility supports at least three research projects:Computational Models of Verb Semantics.Real Time Decision Critical Training, andVirtual Animated Environments from Language.The first project utilizes a Parameterized Action Representation (PAR) that holds computational definitions of human and other agent motions. PAR is used to both synthesize animations and recognize presence in a motion captured input stream. An immersive environment in which participants interact with each other and with virtual agents provides opportunities for capturing, characterizing, and representing genuine physical and emotional actions, and for employing these actions to affect and control reactive behaviors in virtual agents. The second project utilizes the graphical portrayal of embodied agents to close encounter training requiring the user to analyze and react to facial actions, body posture, and gesture quality. Fundamentally different from VR navigation and exploration, these interactions require realistic human models and detailed, variable, controllable parameters. The last project encourages exploration, but not construction and animation, since the necessity to design and script VR worlds in advance constitutes a bottleneck. This project proposes an "imagination" machine in which users create, populate, and animate their own virtual worlds. Natural language that understands descriptions of situations and action, depicts the graphical arrangements, and sets current and future context-dependent behaviors into its animated agents, serves as the primary ingredient in this system. The immersive LiveActor space allows a user to input her own body motions for specific yet parameterizable movements for characters and their interactions.