Development of a speech act identification system considering prosodic, voice quaility and linguistic information

开发考虑韵律、语音质量和语言信息的言语行为识别系统

• 批准号: 23680019
• 负责人: ISHI Carlos Toshinori
• 金额: $ 16.06万
• 依托单位: Advanced Telecommunications Research Institute International
• 依托单位国家: 日本
• 项目类别: Grant-in-Aid for Young Scientists (A)
• 财政年份: 2011
• 资助国家: 日本
• 起止时间: 2011-04-01 至 2014-03-31
• 项目状态: 已结题
• 来源: https://kaken.nii.ac.jp/grant/KAKENHI-PROJECT-23680019/
• 关键词: 知覚情報処理; 音声情報処理; パラ言語情報処理; 韻律情報処理; 言語情報処理; 声質特徴; 感情音声; 自然対話音声

We constructed a natural conversational dialogue speech database, including linguistic, prosodic and paralinguistic information. A new acoustic parameter was proposed for breathy voice quality. Monosyllabic interjection utterances (such as "un", "oh", "haa") were extracted from the database, and the relations between speaking style and speech acts were analyzed. A set of interjections expressing different meanings were made available in the web. Automatic identification of speech acts were also evaluated, indicating the effectiveness of the proposed acoustic features. Repeated interjection utterances (such as "unun") were also analyzed, indicating relation between the number of repetitions and the paralinguistic functions. Question-type utterances were also analyzed, indicating relations between the phrase final intonation and the inter-personal relationship.

我们构建了一个自然对话语音库，包括语言信息、韵律信息和副语言信息。提出了一种新的衡量呼吸音质的声学参数。从数据库中提取出单音节感叹话语(如“un”、“oh”、“haa”)，并分析了言语风格与言语行为之间的关系。一组表达不同意思的感叹词可以在网上找到。对言语行为的自动识别也进行了评估，表明了所提出的声学特征的有效性。本文还对重复叹词(如unun)进行了分析，指出重复次数与副语言功能之间的关系。对问句类型的话语也进行了分析，指出了短语语调与人际关系之间的关系。

项目成果

感動詞の音例集

感叹词示例集合

自然対話音声を対象にした発話行為ラベルの構築にむけて

构建自然对话语音的言语行为标签

• 发表时间: 2012
• 作者: 山口;小川;中尾;神保;小谷;Takayuki Shiina,Akira Obara,Hiroshi Takemura,Hiroshi Mizoguchi;新井潤,波多野博顕,石井カルロス寿憲;菊地圭子,豊田茉莉,遠藤恵子,大平光子;波多野 博顕
• 通讯作者: 波多野 博顕

Interpersonal factors affecting tones of question-type utterances in Japanese

影响日语疑问句语气的人际因素

• 作者: Hiroaki Hatano;Carlos T. Ishi;Miyako Kiso
• 通讯作者: Miyako Kiso

「うんうん」と「うーん」の識別における音響特徴の分析

“是啊是”与“嗯”辨别的声学特征分析

• 发表时间: 2013
• 期刊: 日本音響学会２０１３年秋季研究発表会論文集
• 作者: Hiroaki Hatano;Miyako Kiso;Carlos T. Ishi;小原晃,竹村裕,溝口博;石井カルロス寿憲，波多野博顕，萩田紀博
• 通讯作者: 石井カルロス寿憲，波多野博顕，萩田紀博

Analysis of acoustic-prosodic features related to paralinguistic information carried by interjections in dialogue speech

对话语音中感叹词携带的副语言信息相关的声韵特征分析

• 发表时间: 2011
• 作者: Ishi;Carlos
• 通讯作者: Carlos