Urgent Signal Extraction for Human-interface

人机界面紧急信号提取

• 批准号: 10650262
• 负责人: NISHIHARA Kazue
• 金额: $ 0.9万
• 依托单位: Kanagawa Institute of Technology
• 依托单位国家: 日本
• 项目类别: Grant-in-Aid for Scientific Research (C)
• 财政年份: 1998
• 资助国家: 日本
• 起止时间: 1998 至 2000
• 项目状态: 已结题
• 来源: https://kaken.nii.ac.jp/grant/KAKENHI-PROJECT-10650262/
• 关键词: voice recognition; urgent signal; emergency; tapping and clapping; sound direction; hand waving; 笛の音の抽出; 振動ジャイロの応用

In order to issue an order to the machine, we can use some means of crying, voice, tapping or clapping sounds and hand shaking. This report is concerned with recognition of urgent signals at the human-machine interface.(1) Command by sound or voice : Experiments on catching direction of hand clapping sounds and speaking voice were done by using a speech recognition software(Via Voice (IBM)). The obtained signals were inputted into a 2-degree of freedom servo mechanism which followed the signal directions within accuracy ±15 deg. Next, using wavelet analysis tapping and clapping numbers were recognized surely in a real time under noisy environment. It is confirmed that tapping and clapping sounds are good for urgent signals.(2) Optical fiber jyro sensor : Combining 3 jyro sensor, we could get very accurate angular velocity signals, which could be a good ordering device to the machine.(3) Image processing of hand wavings Human can transmit his intention by hand wavings as no-no, bye-bye, nodding and driving away. It is very difficult to distinguish nodding from driving away, however, we should avoid the misunderstanding. To separate motions of nodding from driving away, we introduced a modified DP matching method, and could raise recognition ratio up to 90〜80%. Taking further strict condition, we suppressed missrecognition ratio under 4% though the correct recognition ratio came down to 60%. On the other hand, we distinguished no-no and bye-bye among hand wavings as 100%.(4) We recommend to use voice control under ordinary conditions, but at the emergency tapping or clapping sounds to stop machines.

为了向机器发出命令，我们可以使用哭声、声音、敲击声或拍手声以及握手等手段。本报告涉及人机界面上紧急信号的识别。(1)声音或语音命令：使用语音识别软件(Via Voice (IBM))进行了捕捉拍手声和说话声音方向的实验。获得的信号被输入到二自由度伺服机构，该机构在±15度的精度内跟随信号方向。接下来，使用小波分析，可以在嘈杂的环境下实时识别敲击和拍手的数字。经证实，敲击声和拍手声对于紧急信号有好处。（2）光纤陀螺仪传感器：结合3个陀螺仪传感器，我们可以获得非常准确的角速度信号，这对于机器来说是一个很好的命令装置。（3）挥手的图像处理人类可以通过挥手来传达他的意图，例如“不”，再见，点头和开车走。点头和走开很难区分，但我们应该避免误会。为了区分点头和离开的动作，我们引入了改进的DP匹配方法，可以将识别率提高到90〜80%。在进一步严格的条件下，我们将误识别率抑制在 4% 以下，而正确识别率则降至 60%。另一方面，我们将挥手中的“不”和“再见”区分为100％。（4）我们建议在正常情况下使用语音控制，但在紧急情况下使用敲击声或拍手声来停止机器。

项目成果

西原主計,河原崎: "人間の腕手のつかみ運動と関数化" 第16回日本ロボット学会学術講演会. 1B25-p.63 (1998)

Kazue Nishihara，Kawarasaki：“人类手臂抓握运动和功能化”日本机器人学会第 16 届学术会议 1B25-p.63（1998）。

河原崎,鍛冶,西原: "Intelligent manipulator work system using tracking vision"Proc.16th Int.Conf.on CAP Engineering. 97-104 (2000)

Kawarazaki、Kaji、Nishihara：“使用跟踪视觉的智能机械手工作系统”Proc.16th Int.Conf.on CAP Engineering 97-104 (2000)。

N.Kawarazaki, Kaji and K.Nishihara: "Intelligent manipulator work system using tracking vision"Proc.16th Int.Conf.on CAP Engineering. 97-104 (2000)

N.Kawarazaki、Kaji 和 K.Nishihara：“使用跟踪视觉的智能机械手工作系统”Proc.16th Int.Conf.on CAP Engineering。

K.Nishihara and N.Kawarazaki: "Transmission of Human Intention by Impulsive Sounds"Proc.4^<th> Japan-France Congron Mechatronics. vol.2. 526-529 (1998)

K.Nishihara 和 N.Kawarazaki：“通过脉冲声音传输人类意图”Proc.4^<th> 日本-法国 Congron 机电一体化。

河原崎,西原,柏木: "ジェスチャ認識によるマニピュレータ作業システム"日本機械学会ロボティクス・メカトロニクス講演会'99. 6月. (1999)

Kawarasaki、Nishihara、Kashiwagi：“使用手势识别的机械手工作系统”日本机械工程师学会机器人和机电一体化会议 99 年 6 月。