Multimodal Stancetaking: Expressive Movement and Affective Stance. Political Debates in the German Bundestag and the Polish Sejm
多模式立场:表达性动作和情感立场。
基本信息
- 批准号:426600435
- 负责人:
- 金额:--
- 依托单位:
- 依托单位国家:德国
- 项目类别:Research Grants
- 财政年份:2019
- 资助国家:德国
- 起止时间:2018-12-31 至 2023-12-31
- 项目状态:已结题
- 来源:
- 关键词:
项目摘要
Objective: Despite the abundant and diverse literature on stance and stancetaking the role of gesture and body movement as well as prosodic properties of this communicative activity remain hitherto only scarcely studied. The project responds to the challenge of including multimodality in stancetaking research and advances a new framework to multimodal stancetaking. Initially developed as a theoretical and methodological concept to account for metaphorical meaning-making in audiovisual media and in face-to-face interaction, the notion of 'expressive movement' is the pathway offered to explain and analyze how stancetaking as a multimodal activity becomes a temporally-structured affective experience.Integrating Methods: Multimodal stancetaking is investigated in political debates in the German Bundestag and the Polish Sejm. The focus is on dynamic gestural patterns along with body-postures, head movements, and speech, including its prosodic properties as multimodal expressive movements. Stancetaking is analyzed on the level of 'expressive movement units'. Units will be tagged and independently analyzed for gestural and prosodic form as well as for co-occurring speech. The debates will be transcribed, annotated, and submitted to analyses with regard to: (1) segmentation of expressive movement units, (2) analysis of expressive forms and patterns with high levels of affectivity, (3) multimodal orchestration of affective stancetaking in terms of (a) affective stance, (b) interaffective alignment. By integrating the analysis of co-speech gesture with prosodic parameters that are relatively well explored in terms of their relation to emotions or attitudes, a new angle is provided on the analysis of multimodal stancetaking. Expected Impact: The project breaks new ground by: (1) offering a new approach to multimodal stancetaking as expressive movement, (2) complementing existing research on multimodal stancetaking by including gesture-speech-prosody synchronization, and by (3) investigating multimodal stancetaking in political debates across two languages (German and Polish). The project thus provides the basis for future comparative research of multimodal stancetaking, be it across cultures, discourse genres, or different forms of political debates, and will offer open access to results and methodology.Added value of the international cooperation. To capture the dynamic complexity of multimodal forms and patterns of stancetaking as affective forms, i.e., as multimodal 'expressive movements' and their orchestration along political debates, the project integrates two unique expert teams. While the Polish team takes the lead in speech prosody analyses, the German team leads with regard to linguistic gesture analysis and application of the key concept of 'expressive movement'. By integrating the two types of expertise the project offers a unique perspective on stancetaking as multimodal expressive movement.
目的:尽管关于姿态和姿态在手势和肢体运动中的作用以及这种交际活动的韵律特性的研究文献丰富多样,但迄今为止研究的很少。该项目响应了将多模态纳入站位研究的挑战,提出了一个新的多模态站位研究框架。“表达性运动”的概念最初是作为一种理论和方法论概念发展起来的,用于解释视听媒体和面对面互动中的隐喻意义制造,它是解释和分析作为多模态活动的站立如何成为一种时间结构的情感体验的途径。综合方法:在德国联邦议院和波兰瑟姆的政治辩论中调查了多模式立场。重点是动态手势模式以及身体姿势,头部运动和言语,包括其作为多模态表达运动的韵律特性。在“表达动作单元”的层面上分析立姿。单元将被标记并独立分析手势和韵律形式以及共存的语音。这些辩论将被转录、注释,并提交给以下方面的分析:(1)表达动作单元的分割,(2)高水平情感的表达形式和模式的分析,(3)情感立场的多模态编排(a)情感立场,(b)情感间对齐。将同语音手势与韵律参数的分析结合起来,为多模态站位分析提供了一个新的视角。预期影响:该项目开辟了新的领域:(1)提供了一种将多模态站立作为表达运动的新方法,(2)通过包括手势-言语-韵律同步来补充现有的多模态站立研究,以及(3)研究跨两种语言(德语和波兰语)政治辩论中的多模态站立。因此,该项目为未来跨文化、话语类型或不同形式的政治辩论的多模态立场比较研究提供了基础,并将提供开放的结果和方法。国际合作的附加值。为了捕捉作为情感形式的多模态形式和立场模式的动态复杂性,即作为多模态“表达运动”及其在政治辩论中的协调,该项目整合了两个独特的专家团队。波兰队在语音韵律分析方面处于领先地位,而德国队在语言手势分析和“表达运动”关键概念的应用方面处于领先地位。通过整合两种类型的专业知识,该项目提供了一种独特的视角,将站立作为多模式表达运动。
项目成果
期刊论文数量(0)
专著数量(0)
科研奖励数量(0)
会议论文数量(0)
专利数量(0)
数据更新时间:{{ journalArticles.updateTime }}
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
数据更新时间:{{ journalArticles.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ monograph.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ sciAawards.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ conferencePapers.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ patent.updateTime }}
Professorin Dr. Cornelia Müller其他文献
Professorin Dr. Cornelia Müller的其他文献
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}