Human Interface employing Intelligent Anthropomorphic Agent with Realistic Figure

采用具有逼真图形的智能拟人代理的人机界面

• 批准号: 06558045
• 负责人: ISHIZUKA Mitsuru
• 金额: $ 4.8万
• 依托单位: The University of Tokyo
• 依托单位国家: 日本
• 项目类别: Grant-in-Aid for Developmental Scientific Research (B)
• 财政年份: 1994
• 资助国家: 日本
• 起止时间: 1994 至 1995
• 项目状态: 已结题
• 来源: https://kaken.nii.ac.jp/grant/KAKENHI-PROJECT-06558045/
• 关键词: human interface; anthropomorphic agent; multi-modal interface; computer graphics; realtime texture mapping; speech dailog; intelligent agent; ヒューマンインタフェース; マルチモーダルインタフェース; コンピュータグラフィックス; 実時間動画像認識

Human interface technologies are becoming important increasingly in the advanced information-oriented society. As a new-type human interface, we have developed an anthropomorhipc agent system called VSA(visual software agent), which is based on the fusion of realtime image synthesis, realtime moving image recognition, speech recognition/synthesis and knowledge base technologies. Our VSA has a realistic facial image generated by a realtime texture-mapping onto a 3D model, speech communication capability, interactive capability responsive to the visual recognition result of a human user, and an access function to Internet/WWW.In particular, we have successfully connected our VSA with Mosaic, a typical browser of WWW (World Wide Wed) in the Internet. As a result, our VSA system becomes to have a big advantage that it can use vast multimedia information sources in the Internet and new information to be transmitted through the VSA interface can be written in a wide-spreaded standalized HTML (hyper text makeup language) format. Also, it becomes possible to provide a new-type WWW browser with new multi-modalities close to face-to-face communication in human daily life.

人机界面技术在信息化社会中越来越重要。作为一种新型的人机接口，我们开发了一个融合实时图像合成、实时运动图像识别、语音识别/合成和知识库技术的拟人智能体系统VSA（visualsoftwareagent）。我们的VSA具有通过实时纹理映射到3D模型上生成的逼真的面部图像、语音通信能力、响应于人类用户的视觉识别结果的交互能力以及对Internet/WWW的访问功能。特别地，我们已经成功地将我们的VSA与Mosaic连接，Mosaic是Internet中WWW（World Wide Wed）的典型浏览器。因此，我们的VSA系统变得有一个很大的优势，它可以使用大量的多媒体信息源在互联网上和新的信息传输通过VSA接口可以写在一个广泛的标准化的HTML（超文本化妆语言）格式。而且，提供一种具有接近人类日常生活中面对面通信的新的多模态的新型WWW浏览器成为可能。

项目成果

T. Kawamura, M. Ishizuka: "Realtime CG Animation of Realistic Fishes using NURBS Inverse Kinematics and Co-operative" Proc. Int'1 Conf. on Virtual Systems and Multimedia. 260-265 (1995)

T. Kawamura、M. Ishizuka：“使用 NURBS 逆向运动学和合作实现逼真鱼类的实时 CG 动画”Proc。

O.Hasegawa,K.Yokosawa,M.Ishizuka: "Real-time Parallel and Cooperative Recognition of Facial Images for an Interactive Visual Human Interface" Proc. 12th Int'l Conf. on Pattern Recognition. Vol.III. 384-387 (1994)

O.Hasekawa，K.Yokosawa，M.Ishizuka：“交互式视觉人机界面的面部图像实时并行和协作识别”Proc。

O.Hasegawa, M.Ishizuka et al.: "Real-time Synthesis of a Human Agent in response to the User's Moving Image" Machine Vision and Applications (Springer-Verlag). Vol.8. 122-130 (1995)

O.Hasekawa、M.Ishizuka 等人：“响应用户移动图像的人类代理的实时合成”机器视觉和应用（Springer-Verlag）。

O. Hasegawa, M. Ishizuka: "Realtime Synethesis of a Humanlike Agent in response to the Users′ Moving Imafe" Machine Vision and Applications(Springer-Velag). 8. 122-130 (1995)

O. Hasekawa、M. Ishizuka：“响应用户移动 Imafe 的类人代理的实时合成”机器视觉和应用（Springer-Velag）。

Y.Hiramoto, H.Dohi, M.Ishizuka: "A Speech Dialogue Management System for Human Interface employing Visual Anthropomorphous Agent" Proc.3rd Int'l Workshop on Robot and Human Communications (RO-MAN'94). 277-282 (1994)

Y.Hiramoto、H.Dohi、M.Ishizuka：“采用视觉拟人代理的人机界面语音对话管理系统”Proc.3rd 国际机器人与人类通信研讨会 (RO-MAN94)。