The Actionary: A Dictionary that Portrays Natural Language Expressions as Context-Sensitive Simulations of Human Actions

摘要IIS-9900297 Badler，Norman I.；Joshi，Aravind，K.；&amp；Palmer，MarthaUniversity of Pennsylvania$178,712-12 mos。动作：一本将自然语言表达描绘为对人类行为的上下文敏感模拟的词典。它建立在参数化动作表示(PARs)的基础上，它显式地将词汇化的树邻接语法结构链接到驱动虚拟人类运动生成器的并行转换网络。PAR提供了不同类型动作的概念性表示：状态改变、位置改变(运动学)和力的施加(动力学)。到目前为止，自然语言处理系统只处理了状态改变操作。众所周知，‘跑步’、‘慢跑’或‘跳跃’之间没有语言上的区别，只有参考视觉模型和上下文才能区分它们。Active方法定义了涉及连续更改或流程执行的操作，参考了适合可视化性能的情景具体模型。行动词典将促进：将人类行动指令翻译成不同的语言，用于教育(例如，外语学习)和培训(例如，机械操作和维修)的样本行动执行。多人活动的低带宽通信：通过传输通过Actional本地解释的紧凑文本指令，智能代理可以为远程技能培训、虚拟视频会议和3D虚拟社区中的潜在应用程序执行指令。

AbstractIIS-9900297Badler, Norman I.; Joshi, Aravind, K.; & Palmer, MarthaUniversity of Pennsylvania$178,712 - 12 mos.The Actionary: A Dictionary that Portrays Natural Language Expressions as Context-Sensitive Simulations of Human Actions The `Actionary' is an action database that associates natural language expressions with context-sensitive graphical simulations acted out by ``smart'' virtual human agents. It rests on a foundation of Parameterized Action Representations (PARs) that explicitly link Lexicalized Tree-Adjoining Grammar structures to the Parallel Transition Networks that drive virtual human motion generators. PARs provide a conceptual representation of different types of actions: changes of state, changes of location (kinematic), and exertion of force (dynamic). To date, only change of state actions have been addressed by natural language processing systems. It is known that there are no linguistic distinctions between `running,' `jogging,' or `loping,' and that these can only be distinguished by making reference to visual models and context. The Actionary approach defines actions involving continuous changes or process execution with reference to situated concrete models suitable for a visualized performance. The Actionary will facilitate: Translation of human action instructions into different languages for sample action execution for education (e.g., foreign language learning) and training (e.g., machinery operation and repair). Low bandwidth communication of multi-person activities: by transmitting compact textual instructions locally interpreted via the Actionary, smart agents can execute instructions for potential applications in remote skill training, virtual video-conferencing, and 3D virtual communities.