Multisensory integration in the development of mobility / Pitch organization in music cognition

我的研究项目包括两个平行的流程，一个是知觉运动发展，另一个是成人音乐认知。因为这些项目在理论上和经验上是不同的，所以这些研究流是分开描述的。贯穿这些项目的是对感知如何在基本运动任务和复杂听觉处理中起作用的兴趣。******感知运动发展研究：我在感知运动发展方面的研究重点是儿童行动能力的发展。为什么对移动性如此感兴趣？简单地说，获得行动能力和学会沟通是早期发展中最重要的两个里程碑之一。因此，这一成就为了解发展的基本进程提供了一个宝贵的窗口。在这个框架内，我的作品采用了一种“多感官”的方法来发展移动性。这样的框架强调并随后探索了多感官信息的贡献，包括视觉、听觉、触觉和身体感觉（例如本体感觉和动觉）对活动的三个基本方面的贡献：幼儿和幼儿如何学习用两条腿保持平衡，他们如何学习走路，以及他们如何在世界各地行走（空间方向）。在这些领域中，主要的实验重点包括修改各种感觉系统信息的性质，并检查这些变化对儿童保持平衡的能力的影响，在拥挤的环境中行走，或者找到以前看到的现在隐藏在视线之外的物体。这项工作的最终目标是确定不同年龄的儿童在完成活动所需的任务时使用了哪些感官信息来源，以及这些不同感官输入的相对贡献如何随着年龄和经验的增长而变化。******音乐认知研究：在西方音乐中，音高是人们听音乐时兴趣的主要维度。我在音乐认知方面的工作主要集中在成年人在听音乐时是如何理解音高的，更具体地说，他们是如何理解他们在听各种形式的音乐时通常遇到的复杂的“音高结构”的。这部作品强调了两个互补的音高结构一个是音乐调性的概念，它是围绕一个中心参考音所能听到的所有可能的音符的结构，另一个是旋律轮廓的概念，它涉及到一个旋律中通常听到的音调的升降模式。这两个过程都已经正式建模，这些模型目前正在扩展，以纳入节奏和韵律信息，以及它们对音高信息的其他方面的适用性，如和声结构。总的来说，这项研究提供了关于成年人如何感知、反应、记忆和潜在地表演复杂音乐信息的见解。

My research program consists of two parallel streams one in perceptual-motor development and the other in adult music cognition. Because these programs are theoretically and empirically divergent, these research streams are described separately. Cutting across these programs is an interest in how perception functions across basic motor tasks and complex auditory processing.******Research in Perceptual-Motor Development: My research in perceptual-motor development focuses on the development of mobility in children. Why such an interest in mobility? Simply put, the acquisition of mobility is, along with learning to communicate, one of the two most critical milestones in early development. As such, this achievement provides an invaluable window into basic processes of development. Within this framework my work assumes a “multisensory” approach to the development of mobility. Such a framework emphasizes, and subsequently explores, the contributions of multisensory information including vision, audition, touch, and body sense (e.g., proprioception and kinaesthetic) to three basic aspects of mobility: How toddlers and young children learn to balance on two legs, how they learn to walk, and how they make their way around the world (spatial orientation). Within each of these domains, the primary experimental thrust involves modifying the nature of the various sensory system information, and examining the impact of such changes on children's ability to maintain their balance, to walk around a crowded environment, or to find previously seen objects that are now hidden from view. The ultimate goal of this work is to determine what sources of sensory information are used by children at different ages to complete the tasks required for mobility, and how the relative contributions of these different sensory inputs change with increasing age and experience. ******Research in Music Cognition: In Western music, pitch is the primary dimension of interest when individuals listen to music. My work in musical cognition focuses on how it is that adults are able to understand pitch during music listening, and more specifically, how the understand the complex “pitch structures” they typically encounter when listening to various forms of music. This work has emphasized two complementary pitch structures the idea of musical tonality, which is the structuring of all of the possible notes one could hear around a central reference tone, and the idea of melodic contour, which involves the patterns of rises and falls in pitch that one typically hears in a melody. Both of these processes have been formally modeled, and these models are currently being extended to incorporate both rhythmic and metrical information, as well as in terms of their applicability to other aspects of pitch information, such as harmonic structure. In general, this research provides insights into how it is that adults perceive, respond to, remember, and potentially perform, complex musical information.