Multimedia sensing system for robot
Multimedia sensing system for robot
复制标题
机器人多媒体传感系统
DOI：
10.1109/roman.1995.531939
复制
发表时间：
1995
期刊：
影响因子：
--
通讯作者：
S. Hashimoto
中科院分区：
文献类型：
--
作者：
T. Kurata;D. Chang;S. Hashimoto
本研究的目的是实现一个机器人多媒体感知系统。该系统使用图像和声音处理，使机器人跟踪说话的人。根据到达机器人左右麦克风（耳朵）的声音之间的相位差计算声音方向。然后通过检测声音和图像变化之间的同步，系统识别说话者。此外，通过引入多级同步检查和上下文分析，可以调整机器人的动作模式，使机器人在多个扬声器的复杂环境中执行。所有过程都是实时执行的。该系统是在信息辅助机器人“Hadaly”中实现的。
The purpose of this study is to realize a multimedia sensing system for robot. Using both image and sound processing, the system makes a robot track the person who is speaking. The sound direction is calculated from the phase difference between the sounds arriving at the right and left microphones (ears) of the robot. Then by detecting the synchronization between the sound and image changes, the system identifies the speaker. Furthermore, by introducing a multi-level synchronization checking and context analysis, the action pattern of the robot can be regulated to make the robot perform in a complicated environment with plural speakers. All the processes are performed in real-time. The proposed system is implemented in the information assistant robot "Hadaly".