Measurement of colored-hearing synesthesia-Non-verbal mapping between sound and color-

彩色听觉联觉的测量-声音和颜色之间的非语言映射-

• 批准号: 17560382
• 负责人: NAGATA Noriko
• 金额: $ 2.18万
• 依托单位: Kwansei Gakuin University
• 依托单位国家: 日本
• 项目类别: Grant-in-Aid for Scientific Research (C)
• 财政年份: 2005
• 资助国家: 日本
• 起止时间: 2005 至 2006
• 项目状态: 已结题
• 来源: https://kaken.nii.ac.jp/en/grant/KAKENHI-PROJECT-17560382/
• 关键词: Colored-hearing; Synesthesia; fMRI; Color perception; Music; Visual; Interaction; CM

(1)Brain activity in colored-hearing synesthetes when listening to music : an fMRI studyWe measured brain activity in colored-hearing (musical tonality-color ) synesthesia, in which a person sees colors when listening to music, by using functional magnetic resonance imaging (fMRI). We compared the images acquired from two colored-hearing subjects and 11 non-colored-hearing subjects when listening to various kinds of music. The results showed that the fusiform gyrus, cerebellum, right lateral inferior parietal lobule and superior frontal gyrus were activated only in the colored-hearing synesthetes. Moreover we found that the area of activity in the cerebellum and the color area, V4/V8 (V4 complex), in the fusiform gyrus which was also activated, are next to each other, and were activated coincidently. It indicates that colored-hearing synesthetes actually perceive colors when listening to music and that they experience a direct interaction between the auditory and visual modalities. In … More addition, this suggests evidence for the synesthesia cross-wiring hypothesis that there is a strong neurological connection between the color V4 complex and the cerebellum, and that the activity in the V4 complex occurs as a result of the activity of the cerebellum caused by listening to music.(2)Interactions between pictures and music in TV commercials-We presented an analysis of the relationship between the elements of pictures and music which make up commercials. In order to clarify the interactions between the expressions of pictures and music, the expressions were classified into 9 elements, 71categories. These categories were applied to commercial samples using Hayashi's Quantification Theory III. The result shows picture and music elements contribute greatly to the impression such as Exciting-Calm and Homely-Sophisticated made by commercial. We have been also successful in clarifying the relationship between basic elements such as color tone and tonality, indicating the probability of their appeal to the subconscious feelings of human beings. Less

（1）听音乐时有色听觉联觉者的大脑活动：一项功能磁共振成像研究我们通过功能磁共振成像（fMRI）测量了有色听觉（音乐音调-颜色）联觉者的大脑活动，即一个人在听音乐时看到颜色。我们比较了从两个有色听觉主体和11个非有色听觉主体在听各种音乐时获得的图像。结果表明，只有色听联觉者的梭状回、小脑、右侧顶下小叶和上级额回被激活。此外，我们还发现小脑的活动区和梭状回的颜色区V4/V8（V4复合体）也被激活，它们彼此相邻，并且被同时激活。这表明，有色听觉联觉者在听音乐时实际上感知到了颜色，并且他们经历了听觉和视觉模态之间的直接相互作用。在 ...更多信息 此外，这为联觉交叉布线假说提供了证据，即颜色V4复合体和小脑之间存在强烈的神经联系，V4复合体的活动是听音乐引起小脑活动的结果。（2）电视广告中的画面与音乐的互动--分析了构成电视广告的画面元素与音乐元素之间的关系。为了阐明画面与音乐的表达之间的相互作用，将画面与音乐的表达分为9个要素，71个类别。使用Hayashi的量化理论III将这些类别应用于商业样品。结果表明，画面和音乐元素对广告给人的印象有很大的影响，如激动人心的平静和朴实的成熟。我们还成功地阐明了色调和调性等基本元素之间的关系，表明了它们对人类潜意识感受的吸引力。少

项目成果

A synesthesia measurement by fMRI : V4/V8 activity at the time of the music seeing and hearing of a person of chromesthesia

通过 fMRI 进行联觉测量：色觉者看到和听到音乐时的 V4/V8 活动

• 发表时间: 2005
• 期刊: Japanese cognitive psychology society level three times meet lecture memoirs
• 作者: Takashima;A.;Anna Takashima;Shinichi Yokoi
• 通讯作者: Shinichi Yokoi

Non-verbal Mapping between Sound and Color

声音和颜色之间的非语言映射

• 发表时间: 2005
• 期刊: Entertainment Computing - ICEC2005, Lecture Notes in Computer Science 3711
• 作者: Nagata;N.
• 通讯作者: N.

Entertainment Computing - ICEC 2005, Lecture Notes in Computer Science 3711

娱乐计算 - ICEC 2005，计算机科学讲义 3711

• 发表时间: 2005
• 作者: Shumpei Ohashi;et al.;Fumio kishino編
• 通讯作者: Fumio kishino編

An fMRI Study of Synesthesia - Brain activity in colored-hearing by listening to music -

联觉的功能磁共振成像研究 - 通过听音乐进行彩色听觉的大脑活动 -

• 发表时间: 2007
• 期刊: Proc. 13th Annual Meeting of the Organization for Human Brain Mapping
• 作者: Takahashi;R
• 通讯作者: R

fMRIによる共感覚計測 : 色聴者の音楽視聴時のV4/V8活動

使用 fMRI 进行联觉测量：彩色听力人群听音乐时的 V4/V8 活动

• 发表时间: 2005
• 期刊: 日本認知心理学会第3回大会講演論文集
• 作者: Takashima;A.;高島杏菜;横井真一
• 通讯作者: 横井真一