Teaching English to the healthy and speech training to the intellectually challenged : an integrative analysis of speech and body movements

健康人英语教学和智力障碍者言语训练：言语和身体动作的综合分析

• 批准号: 09551012
• 负责人: MASUDA Yoshiharu
• 金额: $ 4.1万
• 依托单位: NAGOYA GAKUIN UNIVERSITY
• 依托单位国家: 日本
• 项目类别: Grant-in-Aid for Scientific Research (B)
• 财政年份: 1997
• 资助国家: 日本
• 起止时间: 1997 至 1999
• 项目状态: 已结题
• 来源: https://kaken.nii.ac.jp/grant/KAKENHI-PROJECT-09551012/
• 关键词: BODY MOVEMENTS AND SPEECH; A SPEECH SYNCHRONIZED TWO-DIMENSIONAL MOTION CAPTURE; HAND MOVEMENTS AND FUNDAMENTAL FREQUENCY; HAND MOVEMENTS AND THEIR TRAJECTORY; THE MAXIMUM VELOCITY OF HAND MOVEMENTS AND FUNDAMENTAL FREQUENCY; 手の運動の最大速度と基本周波数; 2次元動画像

A speech synchronized two-dimensional motion capture system was designed in order to correlate body movements and speech. This has made the measurement of movement in relation to connected speech possible. At the firs stage of software development, 200 ms to 300 ms lag time between speech waves and video images was detected, which was not within an acceptable error range. Almost a year and a half was consumed to calibrate the lag within less than 33.3 ms.Three predominant tendencies are detected concerning observations on hand movements and their relation to speech by utilising a speech synchronized two-dimensional motion capture system 1) various patterns of trajectory ＆ velocity of hand movements display patterns of pathological features among the intellectually challenged but not among normal subjects 2) the intentional increase of downward and/or upward velocity of hand movements without any reference to the articulation of speech influences the fundamental frequency and the pitch pattern. 3) there exists minimum time lag between the onset of fundamental frequency and the maximum velocity of hand movements among the normal people but not the intellectually challenged.

设计了一个语音同步的二维运动捕捉系统，以关联身体动作和语音。这使得测量与连接语音相关的运动成为可能。在软件开发的初期，检测到语音波和视频图像之间的200 ms至300 ms的滞后时间，这不在可接受的误差范围内。利用语音同步二维动作捕捉系统对手部运动及其与语音的关系进行观察，发现了三种主要趋势：1）手部运动的各种轨迹和速度模式在智力障碍者中显示出病理特征的模式，而在正常受试者中则没有在不涉及语音清晰度的情况下，手运动的向下和/或向上速度的有意增加影响基频和音高模式。3)正常人的基频起始与手部动作的最大速度之间存在最小时滞，而智力障碍者则不存在。

项目成果

Yoshiharu Masuda: "Gesture and Speech : Velocity of Hand Movement and its Effects on Segmental & Suprasegmental Features of Spoken English"The Proceedings of the Thai TESOL Conference in Khon Kaen. (2000)

Yoshiharu Masuda：“手势和言语：手部运动的速度及其对节段性神经元的影响

増田喜治: "知的障害者への音楽療法と母音の変化(発表予定)" 日本バイオミュージック学会. 16. (1998)

Yoshiharu Masuda：“智力障碍人士的音乐治疗和元音变化（待提交）”日本生物音乐协会 16。（1998）。

増田喜治: "知的障害者の発話と頭部運動の事例研究" 言葉の心理と学習(金星堂). 229-224 (1998)

Yoshiharu Masuda：“智力障碍者言语和头部运动的案例研究”语言和学习心理学（Kinseido）229-224（1998）。

増田喜治: "知的障害者への音楽療法と母音の変化(発表予定)" 日本バイオミュージック学会誌. 16. 82-91 (1998)

Yoshiharu Masuda：“智力障碍者的音乐治疗和元音变化（待出版）”日本生物音乐学会杂志16. 82-91（1998）。

Yoshiharu Masuda: "The impacts of English rhythm on body movements of learners in Japan ; ways to experience rhythm of English via hand movements & bodysonic apparatus"The Proceedings of the 5th English in South East Asia Conference. 21 (2000)

Yoshiharu Masuda：“英语节奏对日本学习者身体动作的影响；通过手部动作体验英语节奏的方法