课题基金 / 基金详情

Construction of Prototype Multi-modal Interface by Lifelike Agent

Construction of Prototype Multi-modal Interface by Lifelike Agent
Lifelike Agent构建原型多模态界面
批准号:
09555119
负责人:
MORISHIMA Shigeo
金额:
$5.82万
依托单位:
依托单位国家:
日本
项目类别:
Grant-in-Aid for Scientific Research (B)
财政年份:
1997
资助国家:
日本
项目状态:
已结题
起止时间:
1997 至 1999

项目摘要

项目成果

MORISHIMA Shigeo的其他基金

相关文献

中文摘要
翻译
构建了多个客户端之间面对面交流的原型系统。在其他客户的交互驱动下,网络空间中出现了逼真的智能体。该系统由一个服务器和多个客户端组成,每个客户端都有一个摄像头和麦克风。从麦克风捕获的语音逐帧传输到服务器。然后对语音信号进行分析,并通过神经网络将其转换为口型参数。该嘴型参数通过网络传输到各个客户端,并通过该参数控制模仿对方客户端的逼真代理的表情和嘴唇动作。语音信号也被发送到每个客户端,并由每个客户端系统处的扬声器与合成的面部图像同步地回放。通过按功能键选择基本表情,可以改变在其他客户端显示的逼真代理人的面部图像。本系统准备了两种模式:漫游模式和飞越模式。在漫游模式中,每个用户都可以通过与他人的目光接触进行交流,并改变代理人眼睛的位置和方向。在飞行模式下,用户可以作为观察者参与通信,利用该原型通信系统进行了三个用户之间的通信实验。合成速率为每秒10帧。可以实现自然的通信环境。
英文摘要
Prototype communication system between multiple clients in face-to-face style is constructed. Lifelike agent appears in cyberspace driven by other client interactively. This system is composed of one server and multiple clients, and each client has a camera and microphone. Voice captured from microphone is transmitted to server frame by frame. And then voice signal is analyzed and converted to mouth shape parameters by neural network. This mouth shape parameter is transmitted to each client through network and, expression and lip movement of lifelike agent copying other side client are controlled by this parameter. Voice signal is also transmitted to each client and played back by speaker at each client system synchronizing with synthesized face image. Basic expression can be selected by pushing function key to change the face image of lifelike agent displayed at other clients. Two mode is prepared in this system ; walk through mode and fly through mode. In the walk through mode, each user can communicate by eye contact with others and change the location and direction of agent eye. In the fly mode, user can be an observer in communication.By using this prototype communication system, the experiment in which three users communicate each other is performed. Synthesis rate is 10 frames per second. And natural communication environment can be achieved.
期刊论文(0)
专著(0)
科研奖励(0)
会议论文
Shigeo Morishima, T.Ishikawa: "Facial Muscle Parameter Decision from 2D Froutal Image" IEEE Proc.of ICPR. 14巻. 160-162 (1998)
Shigeo Morishima,T. Ishikawa:“二维 Froutal 图像的面部肌肉参数决策”ICPR 的 IEEE Proc。14. 160-162 (1998)
DOI: --
发表时间:
期刊:
影响因子: --
作者: []
通讯作者:
森島繁生: "A Physics-based Talking Head for Interface Agent" Proceedings of IJCAI Workshop on Animated Agent. 91-97 (1997)
Shigeo Morishima:“基于物理的界面智能体说话头”IJCAI 动画智能体研讨会论文集 91-97 (1997)。
DOI: --
发表时间:
期刊:
影响因子: --
作者: []
通讯作者:
Shigeo Morishima: "Real-time Voice Driver Facial Animation System"Proceedings of IEEE ICSMC. FP13-5 (1999)
Shigeo Morishima:“实时语音驱动面部动画系统”IEEE ICSMC 论文集。
DOI: --
发表时间:
期刊:
影响因子: --
作者: []
通讯作者:
四倉達夫、藤井英史、森島繁生: "サイバースペース上の仮想人物による実時間対話システムの構築" 情報処理学会論文誌. 40巻2号. 677-686 (1999)
Tatsuo Shikura、Hidefumi Fujii、Shigeo Morishima:“在网络空间中使用虚拟角色构建实时对话系统”,《日本信息处理学会会刊》第 40 卷,第 2 期。677-686(1999 年)。
DOI: --
发表时间:
期刊:
影响因子: --
作者: []
通讯作者:
共 21 条
    Face Analysis and Synthesis Model Expressing Individual Characteristics and Aging Features with High Reality
    • 批准号:
      22300070
    • 项目类别:
      Grant-in-Aid for Scientific Research (B)
    • 资助金额:
      $11.81万
    • 财政年份:
      2010
    • 负责人:
      MORISHIMA Shigeo
    • 依托单位:
    A Biometrics Person Authentication Algorithm by Dynamic Feature of Facial Expression
    • 批准号:
      18300062
    • 项目类别:
      Grant-in-Aid for Scientific Research (B)
    • 资助金额:
      $11.41万
    • 财政年份:
      2006
    • 负责人:
      MORISHIMA Shigeo
    • 依托单位:
    HIGH FIDELITY FACIAL MUSCLE MODELING AND ITS DYNAMIC CONTROL BY ANATOMICALAPPROACH
    Media Conversion for User-friendly Human-Machine Interface
    • 批准号:
      04650295
    • 项目类别:
      Grant-in-Aid for General Scientific Research (C)
    • 资助金额:
      $1.34万
    • 财政年份:
      1992
    • 负责人:
      MORISHIMA Shigeo
    • 依托单位: