The joint roles of movement and simulation in vocal communication of emotion

动作与模拟在声音情感交流中的共同作用

基本信息

  • 批准号:
    341583-2012
  • 负责人:
  • 金额:
    $ 3.42万
  • 依托单位:
  • 依托单位国家:
    加拿大
  • 项目类别:
    Discovery Grants Program - Individual
  • 财政年份:
    2015
  • 资助国家:
    加拿大
  • 起止时间:
    2015-01-01 至 2016-12-31
  • 项目状态:
    已结题

项目摘要

The proposed project is a continuation of our research explicating mechanisms involved with vocal communication of emotion, and embraces several methods that we have been developing over the past few years in the context of singing including movement tracking, gaze tracking, electromyography (EMG), and electroencephalography (EEG). Our research has thus far identified a small number of universal principles of song production that appear to stem from constraints of the human voice. Violation of these principles is effortful, leading to visible displays of emotional arousal such as exaggerated head movement. New experiments are required to understand the relation between different aspects of vocal effort, head movement, and facial animation. Head movement and facial animation of singers/speakers will be tracked in three-dimensional space (forward/backward, up/down, left/right) and with rotation about three perpendicular axes (pitch, yaw, roll). We have also found that observers track these movements and mimic them, suggesting that simulation may be an important aspect of perceiving vocal communication of emotion. However, our evidence of observer simulation has been limited to audio-visual presentations of song. New experiments will involve auditory-only, visual-only, and audio-visual presentations of speech and song. Observers' eye movements, head movements, facial muscles, and brain waves will be examined for evidence of simulation. We envisage that these experiments will reveal new insights about the joint role of movement and simulation in perception of vocal communication of emotion, with striking implications for understanding the dynamics of communication -- for example, how speakers/singers can use their voices to regulate engagement and the focus of visual attention in observers. Furthermore, benefits to Canada include the generation of basic knowledge that may impact the development of communication technologies (e.g., improved avatars for human-computer interaction), communication skills training, and therapies for special populations with emotion-processing deficits (e.g., autistic children).
这项拟议的项目是我们解释声音情感交流机制的研究的继续,并包含了我们在过去几年中在歌唱背景下开发的几种方法,包括运动跟踪、凝视跟踪、肌电(EMG)和脑电(EEG)。到目前为止,我们的研究已经确定了一小部分歌曲制作的普遍原则,这些原则似乎源于人类声音的限制。违反这些原则是费力的,会导致情绪唤醒的明显表现,比如夸张的头部运动。需要新的实验来理解发声努力、头部运动和面部动画的不同方面之间的关系。歌手/扬声器的头部运动和面部动画将在三维空间(向前/向后、向上/向下、左侧/右侧)跟踪,并绕三个垂直轴(俯仰、偏航、滚动)旋转。我们还发现,观察者会跟踪并模仿这些动作,这表明模拟可能是感知声音情感交流的一个重要方面。然而,我们对观察者模拟的证据仅限于对SING的视听呈现。新的实验将包括语音和歌曲的纯听觉、纯视觉和视听呈现。观察者的眼睛运动、头部运动、面部肌肉和脑电波将被检查以寻找模拟的证据。我们预计,这些实验将揭示运动和模拟在感知情感的声音交流中的联合作用的新见解,对理解交流的动力学具有显著的意义--例如,说话者/歌手如何利用他们的声音来调节观察者的参与和视觉注意的焦点。此外,对加拿大的好处包括产生可能影响通信技术发展的基本知识(例如,改进的人机交互化身)、交流技能培训,以及为情绪处理缺陷的特殊人群(例如自闭症儿童)提供治疗。

项目成果

期刊论文数量(0)
专著数量(0)
科研奖励数量(0)
会议论文数量(0)
专利数量(0)

数据更新时间:{{ journalArticles.updateTime }}

{{ item.title }}
{{ item.translation_title }}
  • DOI:
    {{ item.doi }}
  • 发表时间:
    {{ item.publish_year }}
  • 期刊:
  • 影响因子:
    {{ item.factor }}
  • 作者:
    {{ item.authors }}
  • 通讯作者:
    {{ item.author }}

数据更新时间:{{ journalArticles.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ monograph.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ sciAawards.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ conferencePapers.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ patent.updateTime }}

Russo, Frank其他文献

Music-based interventions in community settings: Navigating the tension between rigor and ecological validity.
  • DOI:
    10.1111/nyas.14908
  • 发表时间:
    2022-12
  • 期刊:
  • 影响因子:
    5.2
  • 作者:
    Habibi, Assal;Kreutz, Gunter;Russo, Frank;Tervaniemi, Mari
  • 通讯作者:
    Tervaniemi, Mari

Russo, Frank的其他文献

{{ item.title }}
{{ item.translation_title }}
  • DOI:
    {{ item.doi }}
  • 发表时间:
    {{ item.publish_year }}
  • 期刊:
  • 影响因子:
    {{ item.factor }}
  • 作者:
    {{ item.authors }}
  • 通讯作者:
    {{ item.author }}

{{ truncateString('Russo, Frank', 18)}}的其他基金

Engagement of the motor system in the perception and cognition of music
运动系统参与音乐的感知和认知
  • 批准号:
    RGPIN-2017-06969
  • 财政年份:
    2022
  • 资助金额:
    $ 3.42万
  • 项目类别:
    Discovery Grants Program - Individual
NSERC/ Industrial Research Chair in NSERC/Sonova IRC in Auditory Cognitive Neuroscience
NSERC/NSERC 工业研究主席/Sonova IRC 听觉认知神经科学
  • 批准号:
    548776-2018
  • 财政年份:
    2021
  • 资助金额:
    $ 3.42万
  • 项目类别:
    Industrial Research Chairs
Engagement of the motor system in the perception and cognition of music
运动系统参与音乐的感知和认知
  • 批准号:
    RGPIN-2017-06969
  • 财政年份:
    2021
  • 资助金额:
    $ 3.42万
  • 项目类别:
    Discovery Grants Program - Individual
NSERC/ Industrial Research Chair in NSERC/Sonova IRC in Auditory Cognitive Neuroscience
NSERC/NSERC 工业研究主席/Sonova IRC 听觉认知神经科学
  • 批准号:
    548776-2018
  • 财政年份:
    2020
  • 资助金额:
    $ 3.42万
  • 项目类别:
    Industrial Research Chairs
Engagement of the motor system in the perception and cognition of music
运动系统参与音乐的感知和认知
  • 批准号:
    RGPIN-2017-06969
  • 财政年份:
    2020
  • 资助金额:
    $ 3.42万
  • 项目类别:
    Discovery Grants Program - Individual
Engagement of the motor system in the perception and cognition of music
运动系统参与音乐的感知和认知
  • 批准号:
    RGPIN-2017-06969
  • 财政年份:
    2019
  • 资助金额:
    $ 3.42万
  • 项目类别:
    Discovery Grants Program - Individual
NSERC/ Industrial Research Chair in NSERC/Sonova IRC in Auditory Cognitive Neuroscience
NSERC/NSERC 工业研究主席/Sonova IRC 听觉认知神经科学
  • 批准号:
    548776-2018
  • 财政年份:
    2019
  • 资助金额:
    $ 3.42万
  • 项目类别:
    Industrial Research Chairs
Engagement of the motor system in the perception and cognition of music
运动系统参与音乐的感知和认知
  • 批准号:
    RGPIN-2017-06969
  • 财政年份:
    2018
  • 资助金额:
    $ 3.42万
  • 项目类别:
    Discovery Grants Program - Individual
Engagement of the motor system in the perception and cognition of music
运动系统参与音乐的感知和认知
  • 批准号:
    RGPIN-2017-06969
  • 财政年份:
    2017
  • 资助金额:
    $ 3.42万
  • 项目类别:
    Discovery Grants Program - Individual
A dynamic emotion feedback system for music using audio, symbolic, and physiological features
使用音频、符号和生理特征的音乐动态情感反馈系统
  • 批准号:
    470378-2014
  • 财政年份:
    2015
  • 资助金额:
    $ 3.42万
  • 项目类别:
    Collaborative Research and Development Grants

相似海外基金

Severe neonatal hyperbilirubinemia (SNH) and the expression of UDP-glucuronosyltransferase 1A1 (UGT1A1) play key roles in the development of necrotizing enterocolitis (NEC)
严重新生儿高胆红素血症 (SNH) 和 UDP-葡萄糖醛酸基转移酶 1A1 (UGT1A1) 的表达在坏死性小肠结肠炎 (NEC) 的发生中起关键作用
  • 批准号:
    10713549
  • 财政年份:
    2023
  • 资助金额:
    $ 3.42万
  • 项目类别:
Rethinking Legionella pneumophila type IV pili and their roles in intracellular infection
重新思考嗜肺军团菌 IV 型菌毛及其在细胞内感染中的作用
  • 批准号:
    10738431
  • 财政年份:
    2023
  • 资助金额:
    $ 3.42万
  • 项目类别:
Causal Roles of Dorsolateral Prefrontal and Dorsal Premotor Cortex in Perceptual Decision-Making
背外侧前额叶和背侧前运动皮层在知觉决策中的因果作用
  • 批准号:
    10790672
  • 财政年份:
    2023
  • 资助金额:
    $ 3.42万
  • 项目类别:
Eye tracking and computational approaches to understand the roles of maturation and experience in infant looking
眼动追踪和计算方法可用于了解成熟和经验在婴儿注视中的作用
  • 批准号:
    10602809
  • 财政年份:
    2023
  • 资助金额:
    $ 3.42万
  • 项目类别:
Uncovering the Roles of Chaperonin CCT in Neural Health and Disease.
揭示伴侣蛋白 CCT 在神经健康和疾病中的作用。
  • 批准号:
    10607652
  • 财政年份:
    2023
  • 资助金额:
    $ 3.42万
  • 项目类别:
Roles of autophagy in microglial senescence and Parkinson's disease
自噬在小胶质细胞衰老和帕金森病中的作用
  • 批准号:
    10664560
  • 财政年份:
    2023
  • 资助金额:
    $ 3.42万
  • 项目类别:
Roles of Gsx factors in basal ganglia development
Gsx 因子在基底神经节发育中的作用
  • 批准号:
    10544505
  • 财政年份:
    2022
  • 资助金额:
    $ 3.42万
  • 项目类别:
Deconstructing the roles of basal ganglia and cerebellum-related thalamic inputs to motor cortex during control of dexterous behavior
解构基底神经节和小脑相关丘脑输入在控制灵巧行为过程中对运动皮层的作用
  • 批准号:
    10366236
  • 财政年份:
    2022
  • 资助金额:
    $ 3.42万
  • 项目类别:
Deconstructing the roles of basal ganglia and cerebellum-related thalamic inputs to motor cortex during control of dexterous behavior
解构基底神经节和小脑相关丘脑输入在控制灵巧行为过程中对运动皮层的作用
  • 批准号:
    10546492
  • 财政年份:
    2022
  • 资助金额:
    $ 3.42万
  • 项目类别:
Roles of the superficial zone in mature articular cartilage
浅表区在成熟关节软骨中的作用
  • 批准号:
    10704023
  • 财政年份:
    2022
  • 资助金额:
    $ 3.42万
  • 项目类别:
{{ showInfoDetail.title }}

作者:{{ showInfoDetail.author }}

知道了