A tripartite trans-modal relationship among sounds, shapes and emotions: A case of abrupt modulation
A tripartite trans-modal relationship among sounds, shapes and emotions: A case of abrupt modulation
复制标题
声音、形状和情感之间的三方跨模态关系：突然调制的案例
作者：
S. Kawahara;K. Shinohara
声音、形状和情感之间的三重跨模态关系：一个突变调制的例子（kawahara@rci.rutgers.edu）罗格斯大学语言学系，美国新玩法NJ 08901（k-shino@cc.tuat.ac.jp）东京农工大学工学院，东京小金井中町2-24-16，邮编184-8588例如，萨皮尔发现说英语的人倾向于将[a]（后元音和低元音）与大对象联系起来，将[i]（前高元音）与小对象联系起来;然而，有一些词汇项目，如big，与这种趋势相反。自Sapir的工作以来，在许多其他语言中发现了将较低和较低元音与较大物体相关联的趋势（例如Shinohara & Kawahara（2012））。简而言之，以前关于自然语言中声音象征的工作已经确定，我们至少可以识别声音和意义之间某种联系的随机趋势（尽管事实上一些词汇项可能并不严格遵循这种联系）（欣顿等人，1994年）。因此，毫无疑问，尽管可能是以非范畴的方式，声音和意义之间存在着某种联系。此外，这些声音和意义之间的联系往往具有语音意义。例如，在许多不同的语言中，[a]通常被认为比[i]大，这种联系的产生是因为[a]的嘴巴比[i]更宽（Sapir，1929; Shinohara & Kawahara，2012）。或者，从（心理）声学角度来看，[a]涉及比[i]更低的第二谐振频率（F2），这意味着更大的谐振器（Ohala，1994）。另见Shinohara & Kawahara（2012），比较这两种声音象征理论。目前的项目是对声音象征的传统调查的一个案例研究和延伸（欣顿等人，1994年）。几项研究表明，某些声音会唤起特定形状的图像;例如，口头塞音通常与角形有关，而响音（鼻音，液体和滑音）与圆形有关（柏林，2006;科勒，1947）。柏林（2006）将这些联系归因于塞音的突然声学振幅调制和线条方向的突然变化之间的相似性，即，突然的视觉变化。在这项研究中，我们扩展了停止角的声音象征关系的领域的情绪。停顿不仅唤起了有棱角的形象，而且还与涉及突然发作的情绪有关。我们进一步表明，角形状本身与这种情绪。因此，我们的三个实验建立了三个认知领域（声音，形状和情感）之间的三方跨模态符号关系。作为一个额外的一般含义，我们认为，我们的实验结果支持声学，而不是发音，声音象征的基础。保留字：声音象征;塞音;响音;棱角性;情绪;突变调制;模块化;通感导论现代语言学中普遍存在的假设是语义（意义）与声音的自治性。索绪尔的语言原则之一表明，意义和声音之间没有内在的联系。例如，我们称之为[k h aet]的东西以这样的方式命名并没有内在的原因。事实上，不同的语言对这种动物有不同的称呼。因此，该论点认为，音义关系必须是任意的。事实上，索绪尔把这种任意性原则作为自然语言的第一原则提出来（de Saussure，1960）。然而，也有相反观点的证据，即声音和意义之间存在某种内在联系，这一观点的支持者至少可以追溯到柏拉图（Harris & Taylor，1989）中的古希腊人。特别是自萨皮尔（1929）开创性的实验工作以来，大量的实验工作表明，声音通常与特定的意义相关联。这种关系，通常被称为声音象征，通常不是绝对的，并带有一些词汇图1：本文的路线图。在当前的项目中，我们专注于口头塞音（如[p，t，k]）的含义，这在声学上涉及突然的振幅变化，而不是涉及逐渐振幅变化的响音（鼻音，液体，滑音，如[n，l，r，j]）（参见第2节这些语音概念的说明）。我们发现，这些声学特性的停止与角的形状
A tripartite trans-modal relationship among sounds, shapes and emotions: A case of abrupt modulation Shigeto Kawahara (kawahara@rci.rutgers.edu) Linguistics Department, Rutgers University, New Brunswick NJ 08901, USA Kazuko Shinohara (k-shino@cc.tuat.ac.jp) Institute of Engineering, Tokyo University of Agriculture & Technology, 2-24-16 Nakacho, Koganei, Tokyo 184-8588, JAPAN Abstract exceptions. For example, Sapir found that English speakers tend to associate [a] (back and low vowels) with big objects and [i] (high front vowels) with small objects; however, there are lexical items such as big that go against this trend. Since Sapir’s work, the tendency to associate lower and backer vowels with bigger objects have been found in many other languages (e.g. Shinohara & Kawahara (2012) among many others). In short, the previous work on sound symbolism in natural languages has established that we can at least identify stochastic tendencies toward some connection between sounds and meanings (despite the fact that some lexical items may not strictly follow such connections) (Hinton et al., 1994). There is thus little doubt, albeit perhaps in non-categorical ways, that there are some associations between sounds and meanings. Moreover, these associations between sounds and meanings tend to make phonetic sense. For example, [a] is often considered to be larger than [i] in many different languages, and this association arises because [a] has wider opening of the mouth than [i] (Sapir, 1929; Shinohara & Kawahara, 2012). Alternatively, viewed from a (psycho)acoustic perspective, [a] involves lower second resonant frequency (F2) than [i], which would imply a larger resonator (Ohala, 1994). See also Shinohara & Kawahara (2012) for the comparison of these two theories of sound symbolism. The current project is a case study–and an extension–of the traditional investigation into sound symbolism (Hinton et al., 1994). Several studies have shown that certain sounds evoke images of particular shapes; for example, oral stop consonants are often associated with angular shapes, whereas sonorants (nasals, liquids, and glides) are associated with round shapes (Berlin, 2006; Kohler, 1947). Berlin (2006) attributes these associations to the similarities between abrupt acoustic amplitude modulation of stop consonants and abrupt change of the directions of lines, i.e., abrupt visual changes. In this study, we extend the stop-angular sound symbolic relation to the domain of emotions. Stops not only evoke the images of angular shapes, but are also associated with emotions that involve abrupt onsets. We further show that angular shapes themselves are associated with such emotions. Our three experiments thus establish a tripartite trans-modal symbolic relationship among three domains of cognition (sounds, shapes, and emotions). As an additional general implication, we argue that our experimental results support acoustic, rather than articulatory, bases of sound symbolism. Keywords: sound symbolism; stop consonants; sonorants; angularity; emotions; abrupt modulations; modularity; synesthesia Introduction A prevalent assumption in modern linguistics is the autonomy of semantics (meanings) from sounds. One of the Saussurian principles of languages suggests that there is no inherent connection between meanings and sounds. For example, there is no inherent reason why what we call [k h aet] is called in such a way. In fact, different languages call that animal by different names. Therefore, the argument goes, the sound-meaning relationship must be arbitrary. Saussure in fact raises this principle of arbitrariness as a first principle of natural languages (de Saussure, 1960). However, evidence for an opposing view—that there is some inherent connection between sounds and meanings— is also available, and proponents of this view date back to at least Cratylus in Plato (Harris & Taylor, 1989). Especially since the seminal experimental work by Sapir (1929), a substantial body of experimental work shows that sounds are often associated with particular meanings. This relationship, often referred to as sound symbolism, is usually not absolute, and comes with some lexical Figure 1: The roadmap of this paper. In the current project, we focus on the meanings of oral stop consonants (like [p, t, k]), which acoustically involve abrupt amplitude changes, as opposed to sonorants, which involve gradual amplitude changes (nasals, liquids, glides, like [n, l, r, j]) (see section 2 for the illustration of these phonetic concepts.). We show that these acoustic characteristics of stops are associated with angular shapes
影响因子：
4.8
作者：
Xu, Alison Jing;Labroo, Aparna A.
通讯作者：
Labroo, Aparna A.