Multisensory integration in the development of mobility / Pitch organization in music cognition

移动性发展中的多感官整合/音乐认知中的音调组织

• 批准号: RGPIN-2019-04166
• 负责人: Schmuckler, Mark
• 金额: $ 2.4万
• 依托单位: University of Toronto
• 依托单位国家: 加拿大
• 项目类别: Discovery Grants Program - Individual
• 财政年份: 2022
• 资助国家: 加拿大
• 起止时间: 2022-01-01 至 2023-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=764221
• 关键词: Multisensory; integration; development; mobility; Pitch

My research program consists of two parallel streams - one in perceptual-motor development and the other in adult music cognition. Because these programs are theoretically and empirically divergent, these research streams are described separately. Cutting across these programs is an interest in how perception functions across basic motor tasks and complex auditory processing. Research in Perceptual-Motor Development: My research in perceptual-motor development focuses on the development of mobility in children. Why such an interest in mobility? Simply put, the acquisition of mobility is, along with learning to communicate, one of the two most critical milestones in early development. As such, this achievement provides an invaluable window into basic processes of development. Within this framework my work assumes a "multisensory" approach to the development of mobility. Such a framework emphasizes, and subsequently explores, the contributions of multisensory information - including vision, audition, touch, and body sense (e.g., proprioception and kinaesthetic) to three basic aspects of mobility: How toddlers and young children learn to balance on two legs, how they learn to walk, and how they make their way around the world (spatial orientation). Within each of these domains, the primary experimental thrust involves modifying the nature of the various sensory system information, and examining the impact of such changes on children's ability to maintain their balance, to walk around a crowded environment, or to find previously seen objects that are now hidden from view. The ultimate goal of this work is to determine what sources of sensory information are used by children at different ages to complete the tasks required for mobility, and how the relative contributions of these different sensory inputs change with increasing age and experience. Research in Music Cognition: In Western music, pitch is the primary dimension of interest when individuals listen to music. My work in musical cognition focuses on how it is that adults are able to understand pitch during music listening, and more specifically, how the understand the complex "pitch structures" they typically encounter when listening to various forms of music. This work has emphasized two complementary pitch structures - the idea of musical tonality, which is the structuring of all of the possible notes one could hear around a central reference tone, and the idea of melodic contour, which involves the patterns of rises and falls in pitch that one typically hears in a melody. Both of these processes have been formally modeled, and these models are currently being extended to incorporate both rhythmic and metrical information, as well as in terms of their applicability to other aspects of pitch information, such as harmonic structure. In general, this research provides insights into how it is that adults perceive, respond to, remember, and potentially perform, complex musical information.

我的研究项目由两个平行的部分组成——一个是知觉运动发展，另一个是成人音乐认知。由于这些项目在理论上和经验上存在差异，因此这些研究方向是分开描述的。 跨越这些程序是对感知如何在基本运动任务和复杂的听觉处理中发挥作用的兴趣。知觉运动发展研究：我在知觉运动发展方面的研究重点是儿童活动能力的发展。为什么对移动性如此感兴趣？简而言之，获得移动能力和学习沟通是早期发展中两个最关键的里程碑之一。因此，这一成就为了解基本发展过程提供了宝贵的窗口。在这个框架内，我的工作采用“多感官”方法来发展移动性。这样的框架强调并随后探索了多感官信息——包括视觉、听觉、触觉和身体感觉（例如本体感觉和动觉）对移动性的三个基本方面的贡献：幼儿和幼儿如何学习用两条腿保持平衡，他们如何学习走路，以及他们如何环游世界（空间定向）。在每个领域中，主要的实验重点涉及修改各种感觉系统信息的性质，并检查这些变化对儿童保持平衡、在拥挤的环境中行走或找到以前见过但现在隐藏起来的物体的能力的影响。这项工作的最终目标是确定不同年龄段的儿童使用哪些感官信息来源来完成移动所需的任务，以及这些不同感官输入的相对贡献如何随着年龄和经验的增加而变化。 音乐认知研究：在西方音乐中，音高是人们听音乐时感兴趣的主要维度。我在音乐认知方面的工作重点是成年人如何在听音乐时理解音高，更具体地说，是如何理解他们在听各种形式的音乐时通常遇到的复杂“音高结构”。这项工作强调了两种互补的音高结构——音乐调性的概念，即围绕中心参考音调可以听到的所有可能音符的结构；以及旋律轮廓的概念，涉及人们通常在旋律中听到的音调上升和下降的模式。这两个过程都已被正式建模，并且这些模型目前正在扩展以合并节奏和韵律信息，以及它们对音高信息其他方面（例如和声结构）的适用性。总的来说，这项研究提供了关于成年人如何感知、响应、记忆和潜在地表演复杂音乐信息的见解。