A Study on Production of Personalized Programs with a Virtual Human Agent on the WWW

WWW虚拟人代理制作个性化节目的研究

• 批准号: 11680418
• 负责人: NOMA Tsukasa
• 金额: $ 2.11万
• 依托单位: Kyushu Institute of Technology
• 依托单位国家: 日本
• 项目类别: Grant-in-Aid for Scientific Research (C)
• 财政年份: 1999
• 资助国家: 日本
• 起止时间: 1999 至 2000
• 项目状态: 已结题
• 来源: https://kaken.nii.ac.jp/grant/KAKENHI-PROJECT-11680418/
• 关键词: virtual human agent; human body animation; WWW; presentation; contents generation; weather report

The purpose of this research project is to develop an environment which enables us to produce TV-like programs, where a virtual human agent acts as a presenter, on the World Wide Web (WWW).We first extended our virtual human presenter system, whose animation language is in the form of speech texts with gesture-related embedded commands, so that it works with Japanese language on the WWW.Secondly, we tried automatic generation of animated weather reports, where a virtual human performs as a weatherman, as an example of automated TV-like program production. An input to our prototype system is a set of (location, time, weather)-type weather forecast data. The system then summarizes the data by clustering and generates its case frame representations. A set of templates translates these representations into Japanese texts with embedded candidates of gestures. By selecting the gesture candidates appropriately, command-embedded speech texts for the weather reports are obtained. From the generated speech texts, the extended virtual human presenter system makes the virtual human agent act as a weatherman with weather charts in real-time 3D animation synchronized with speech outputs.Our experiments showed that the system well produces animated weather report programs on the WWW, and proved the validity of our approach. The results of this research were presented at the International Conference on Multimedia Modeling (MMM2000).

这个研究项目的目的是开发一个环境，使我们能够在万维网（WWW）上制作类似于电视的节目，其中虚拟人类代理充当演示者。我们首先扩展了我们的虚拟人类演示系统，其动画语言采用带有手势相关嵌入命令的语音文本形式，以便它可以在 WWW 上使用日语。其次，我们尝试自动生成动画天气预报，其中虚拟人类代理 扮演天气预报员，作为自动化电视类节目制作的一个例子。我们原型系统的输入是一组（位置、时间、天气）类型的天气预报数据。然后，系统通过聚类来汇总数据并生成其案例框架表示。一组模板将这些表示形式转换为嵌入候选手势的日语文本。通过适当地选择候选手势，可以获得天气预报的嵌入命令的语音文本。根据生成的语音文本，扩展的虚拟人类演示系统使虚拟人类代理充当天气预报员，并以与语音输出同步的实时 3D 动画天气图。我们的实验表明，该系统很好地生成了 WWW 上的动画天气预报节目，并证明了我们方法的有效性。这项研究的结果已在国际多媒体建模会议（MMM2000）上发表。

项目成果

T.Noma 他: "Automated Generation of Animated Weather Reports with a Virtual Weatherman"Multimedia Modeling. 413-427 (2000)

T. Noma 等人：“使用虚拟气象员自动生成动画天气报告”多媒体建模 413-427 (2000)。

T.Noma, Y.Shiratori, and H.Baba: "Automated Generation of Animated Weather Reports with a Virtual Weatherman"Multimedia Modeling. 413-427 (2000)

T.Noma、Y.Shiratori 和 H.Baba：“使用虚拟天气预报员自动生成动画天气预报”多媒体建模。