The Actionary: A Dictionary that Portrays Natural Language Expressions as Context-Sensitive Simulations of Human Actions

巴德勒文摘Joshi，Aravind，K.; &Palmer，MarthaUniversity of Pennsylvania $178，712 - 12 mos.The Actionary：A Dictionary that Portrays Natural Language Expressions as Context-Sensitive Simulations of Human Actions "动作词典“是一个动作数据库，它将自然语言表达与由”智能“虚拟人类代理执行的上下文敏感图形模拟相关联。 它依赖于参数化动作表示（PAR）的基础上，明确链接词汇化树邻接语法结构的并行过渡网络，驱动虚拟人体运动发生器。 PAR提供了不同类型动作的概念表示：状态变化、位置变化（运动学）和力的施加（动力学）。到目前为止，只有状态的变化动作已经由自然语言处理系统解决。 众所周知，在“跑步”、“慢跑"或”慢跑“之间没有语言上的区别，只能通过参考视觉模型和上下文来区分。 行动方法定义了涉及持续变化或流程执行的行动，并参考适合可视化性能的具体模型。 行动将促进：人类行动指令翻译成不同的语言，用于教育的样本行动执行（例如，外语学习）和培训（例如，机械操作和维修）。 多人活动的低带宽通信：通过传输由Actionary本地解释的紧凑文本指令，智能代理可以执行远程技能培训、虚拟视频会议和3D虚拟社区中潜在应用的指令。

AbstractIIS-9900297Badler, Norman I.; Joshi, Aravind, K.; & Palmer, MarthaUniversity of Pennsylvania$178,712 - 12 mos.The Actionary: A Dictionary that Portrays Natural Language Expressions as Context-Sensitive Simulations of Human Actions The `Actionary' is an action database that associates natural language expressions with context-sensitive graphical simulations acted out by ``smart'' virtual human agents. It rests on a foundation of Parameterized Action Representations (PARs) that explicitly link Lexicalized Tree-Adjoining Grammar structures to the Parallel Transition Networks that drive virtual human motion generators. PARs provide a conceptual representation of different types of actions: changes of state, changes of location (kinematic), and exertion of force (dynamic). To date, only change of state actions have been addressed by natural language processing systems. It is known that there are no linguistic distinctions between `running,' `jogging,' or `loping,' and that these can only be distinguished by making reference to visual models and context. The Actionary approach defines actions involving continuous changes or process execution with reference to situated concrete models suitable for a visualized performance. The Actionary will facilitate: Translation of human action instructions into different languages for sample action execution for education (e.g., foreign language learning) and training (e.g., machinery operation and repair). Low bandwidth communication of multi-person activities: by transmitting compact textual instructions locally interpreted via the Actionary, smart agents can execute instructions for potential applications in remote skill training, virtual video-conferencing, and 3D virtual communities.