Cognitive and Structural Approaches to Contemporary Audiovisual Computer Aided Composition
当代视听计算机辅助作曲的认知和结构方法
基本信息
- 批准号:AH/D000602/1
- 负责人:
- 金额:$ 25.83万
- 依托单位:
- 依托单位国家:英国
- 项目类别:Fellowship
- 财政年份:2006
- 资助国家:英国
- 起止时间:2006 至 无数据
- 项目状态:已结题
- 来源:
- 关键词:
项目摘要
Recent research in Neuroscience supports the long-held belief of many in the Visual arts and Experimental music community that there is a sensory connection between our experience of sound and our experience of light. These connections have been shown to be dynamic, changing in a reliable fashion depending on the way in which sonic and visual material is organised. The philosophical implications and potential cultural impact of this realisation is enormous. As such, it is carving a path for cutting edge research into the nature of human audiovisual perception in ways which have previously been thought impossible. Furthermore, recent progress into the development of real-time software for the simultaneous manipulation of sonic and visual material, in addition to the falling cost of increasingly more powerful multimedia technology, is making possible the exploration of multisensory, structurally related audiovisual composition techniques in ways which will revolutionise our perception of, and our interaction with moving images and sound.Concurrently, research in the fields of Cognition, Neuroscience, Psychology and Computation are highlighting specific new approaches to the structuring and perception of audiovisual material which may potentially be even more significant. This research reveals strategies for the understanding, engagement with and manipulation of our conscious experience of sound and vision. These strategies are reliable, repeatable, and demonstrative of the limits of consciousness itself. In the same way that the multisensory nature of audiovisual experience is already a feature of experimental audiovisual work, other extraordinary revelations in scientific and arts research have been and are becoming a major part of existing experimental audiovisual practice. These connections will only increase as research reveals evidence which aids in our understanding of how we interact with the universe. These facts alone support the specific engagement with contemporary theory and practice proposed by this research project.This research will engage and interact with leading academics in the fields of Neuroscience, Cognition, Psychology, Computation, Computer Music, Film and Visual arts. In addition it will liaise with contemporary Broadcast media practitioners from Television, Film and Computer Games design. It aims to discover and reveal novel concepts in the creation of audiovisual works using techniques uncovered through developments in the understanding of our engagement with audiovisual material. It will achieve this through collaboration, consultation, experimentation, software development, Audiovisual composition practice, Film making, Digital Media practice, Computer Music research, generative and algorithmic exploration and Artificial Intelligence research. This continuing program of interdisciplinary practice will be supported by the excellent research culture at Goldsmiths College. Housed in the Goldsmiths Electronic Music Studio, it will benefit from the direct involvement of institution's own researchers in the fields of Visual Perception, Music Cognition, Artificial Intelligence and Cognitive Neuropsychology. As such, the research will be taking place within an environment which will effectively support its successful development and completion.This research will result in the creation of specific works which exploit cognitive and structural approaches to audiovisual composition, and in addition gain high visibility at key international events which focus on contemporary approaches to Sound, Music, Film, Video and digital technology. It will engage with contemporary theory and practice at festivals, and also through publication. Furthermore, it will instantiate, develop and maintain a relevant discourse with the broadcast industries, and lead to an increased understanding of some of the most engaging and important issues surrounding our interaction with audiovisual and digital media culture.
神经科学最近的研究支持了视觉艺术和实验音乐界许多人长期以来的信念,即我们对声音的体验和对光的体验之间存在感官联系。这些联系被证明是动态的,根据声音和视觉材料的组织方式以可靠的方式变化。这种认识的哲学意义和潜在的文化影响是巨大的。因此,它正在以以前认为不可能的方式为人类视听感知的本质开辟一条前沿研究的道路。此外,除了日益强大的多媒体技术的成本下降之外,最近在开发用于同时操纵声音和视觉材料的实时软件方面的进展,使得探索多感官的、结构相关的视听合成技术成为可能,其方式将彻底改变我们对运动图像和声音的感知以及我们与运动图像和声音的交互。在认知、神经科学、心理学和计算领域的研究突出了对视听材料的结构和感知的具体新方法,这可能甚至更有意义。这项研究揭示了理解,参与和操纵我们有意识的声音和视觉体验的策略。这些策略是可靠的,可重复的,并证明了意识本身的局限性。视听体验的多感官性质已经成为实验视听作品的一个特征,同样,科学和艺术研究中的其他非凡启示已经并正在成为现有实验视听实践的主要部分。这些联系只会随着研究揭示的证据而增加,这些证据有助于我们理解我们如何与宇宙互动。这些事实本身就支持了本研究项目提出的与当代理论和实践的具体接触。本研究将与神经科学、认知、心理学、计算、计算机音乐、电影和视觉艺术领域的领先学者进行接触和互动。此外,它还将与电视,电影和计算机游戏设计的当代广播媒体从业者保持联系。它旨在发现和揭示视听作品创作中的新概念,使用通过我们对视听材料的理解的发展而发现的技术。它将通过合作,咨询,实验,软件开发,视听作曲实践,电影制作,数字媒体实践,计算机音乐研究,生成和算法探索以及人工智能研究来实现这一目标。这个跨学科实践的持续计划将得到金史密斯学院优秀研究文化的支持。它位于Goldsmiths电子音乐工作室,将受益于该机构在视觉感知,音乐认知,人工智能和认知神经心理学领域的研究人员的直接参与。因此,研究将在一个有效支持其成功发展和完成的环境中进行,这项研究将导致创造出利用视听作曲的认知和结构方法的具体作品,并在重点关注当代声音,音乐,电影,视频和数字技术的国际活动中获得高知名度。它将与当代理论和实践在节日,并通过出版。此外,它将实例化,发展和保持与广播行业的相关话语,并导致对围绕我们与视听和数字媒体文化互动的一些最具吸引力和重要问题的理解。
项目成果
期刊论文数量(7)
专著数量(0)
科研奖励数量(0)
会议论文数量(0)
专利数量(0)
STEAM WORKS: Student coders experiment more and experimenters gain higher grades
- DOI:10.1109/educon.2017.7942873
- 发表时间:2017-04
- 期刊:
- 影响因子:0
- 作者:M. Yee-King;M. Grierson;M. d'Inverno
- 通讯作者:M. Yee-King;M. Grierson;M. d'Inverno
Making music with images: interactive audiovisual performance systems for the deaf
用图像创作音乐:聋人互动视听表演系统
- DOI:10.1515/ijdhd.2011.009
- 发表时间:2011
- 期刊:
- 影响因子:0
- 作者:Grierson M
- 通讯作者:Grierson M
Soundspotter / Remix-TV: Fast Approximate Matching for Audio and Video Performance
Soundspotter / Remix-TV:音频和视频性能的快速近似匹配
- DOI:
- 发表时间:2007
- 期刊:
- 影响因子:0
- 作者:Casey, M
- 通讯作者:Casey, M
Composing With Brainwaves: Minimal Trial P300b Recognition as an Indication of Subjective Preference for the Control of a Musical Instrument
用脑电波作曲:最小试验 P300b 识别作为对乐器控制的主观偏好的指示
- DOI:
- 发表时间:2008
- 期刊:
- 影响因子:0
- 作者:Mick Grierson
- 通讯作者:Mick Grierson
PLUNDERMATICS : REAL-TIME INTERACTIVE MEDIA SEGMENTATION FOR AUDIOVISUAL ANALYSIS, COMPOSITION AND PERFORMANCE
PUNDERMATICS:用于视听分析、构图和表演的实时交互式媒体分段
- DOI:10.14236/ewic/eva2009.32
- 发表时间:2009
- 期刊:
- 影响因子:0
- 作者:Grierson M
- 通讯作者:Grierson M
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
数据更新时间:{{ journalArticles.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ monograph.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ sciAawards.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ conferencePapers.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ patent.updateTime }}
Mick Grierson其他文献
NoiseBear : A Wireless Malleable Multiparametric Controller for use in Assistive Technology Contexts
NoiseBear:用于辅助技术环境的无线可延展多参数控制器
- DOI:
- 发表时间:
2015 - 期刊:
- 影响因子:0
- 作者:
Mick Grierson - 通讯作者:
Mick Grierson
Progress Report on the EAVI BCI Toolkit for Music: Musical Applications of Algorithms for use with consumer brain computer interfaces
EAVI BCI 音乐工具包进展报告:与消费者脑机接口一起使用的算法的音乐应用
- DOI:
- 发表时间:
2011 - 期刊:
- 影响因子:0
- 作者:
Mick Grierson - 通讯作者:
Mick Grierson
Maximillian: An easy to use, cross platform C++ Toolkit for interactive audio and synthesis applications
Maximillian:一个易于使用的跨平台 C 工具包,用于交互式音频和合成应用程序
- DOI:
- 发表时间:
2011 - 期刊:
- 影响因子:0
- 作者:
Mick Grierson - 通讯作者:
Mick Grierson
Mick Grierson的其他文献
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
{{ truncateString('Mick Grierson', 18)}}的其他基金
Digital equity through e-waste reduction
通过减少电子垃圾实现数字公平
- 批准号:
AH/W008211/1 - 财政年份:2021
- 资助金额:
$ 25.83万 - 项目类别:
Research Grant
MIMIC: Musically Intelligent Machines Interacting Creatively
MIMIC:创造性互动的音乐智能机器
- 批准号:
AH/R002657/1 - 财政年份:2018
- 资助金额:
$ 25.83万 - 项目类别:
Research Grant
Oramics - Precedents, Technology and Influence
Oramics - 先例、技术和影响
- 批准号:
AH/I024798/1 - 财政年份:2011
- 资助金额:
$ 25.83万 - 项目类别:
Training Grant
Sound, Image and the Brain: Cognitive Live-Arts Technology in Contemporary Game-Oriented and Accessibility Paradigms.
声音、图像和大脑:当代游戏导向和辅助范式中的认知现场艺术技术。
- 批准号:
AH/H038264/1 - 财政年份:2010
- 资助金额:
$ 25.83万 - 项目类别:
Fellowship
相似国自然基金
Understanding structural evolution of galaxies with machine learning
- 批准号:n/a
- 批准年份:2022
- 资助金额:10.0 万元
- 项目类别:省市级项目
相似海外基金
EAGER: IMPRESS-U: Developing new approaches and structural materials to rebuild damaged Ukrainian infrastructure with environmental sustainability considerations
EAGER:IMPRESS-U:开发新方法和结构材料,在考虑环境可持续性的情况下重建受损的乌克兰基础设施
- 批准号:
2412196 - 财政年份:2024
- 资助金额:
$ 25.83万 - 项目类别:
Standard Grant
Elucidating the molecular basis and expanding the biological applications of the glycosyltransferases using biochemical and structural biology approaches
利用生化和结构生物学方法阐明糖基转移酶的分子基础并扩展其生物学应用
- 批准号:
23K14138 - 财政年份:2023
- 资助金额:
$ 25.83万 - 项目类别:
Grant-in-Aid for Early-Career Scientists
IMAT-ITCR Collaboration: Combining FIBI and topological data analysis: Synergistic approaches for tumor structural microenvironment exploration
IMAT-ITCR 合作:结合 FIBI 和拓扑数据分析:肿瘤结构微环境探索的协同方法
- 批准号:
10884028 - 财政年份:2023
- 资助金额:
$ 25.83万 - 项目类别:
Intrinsically Disordered Protein Structural Dynamics from Combined Solution and Gas-Phase Approaches
结合溶液和气相方法的本质无序蛋白质结构动力学
- 批准号:
10714896 - 财政年份:2023
- 资助金额:
$ 25.83万 - 项目类别:
IMAT-ITCR Collaboration: Combining FIBI and topological data analysis: Synergistic approaches for tumor structural microenvironment exploration
IMAT-ITCR 合作:结合 FIBI 和拓扑数据分析:肿瘤结构微环境探索的协同方法
- 批准号:
10885376 - 财政年份:2023
- 资助金额:
$ 25.83万 - 项目类别:
Ion/ion Chemistry and Ion Trap Approaches for the Structural Characterization of the Lipidome
用于脂质组结构表征的离子/离子化学和离子阱方法
- 批准号:
2304386 - 财政年份:2023
- 资助金额:
$ 25.83万 - 项目类别:
Continuing Grant
Community-Engaged Structural Approaches to Prevent Violence and Improve HIV Prevention and Care Outcomes Among Trans Women of Color
社区参与的结构性方法,以防止有色人种跨性别女性的暴力并改善艾滋病毒预防和护理结果
- 批准号:
10693570 - 财政年份:2023
- 资助金额:
$ 25.83万 - 项目类别:
Development of Relativistic Electronic Structure Approaches for the Calculation of Structural, Mechanical and Spectroscopic Properties of Infinite Periodic Systems
开发用于计算无限周期系统的结构、力学和光谱特性的相对论电子结构方法
- 批准号:
545643-2020 - 财政年份:2022
- 资助金额:
$ 25.83万 - 项目类别:
Postdoctoral Fellowships
Automated analysis approaches for Structural Health Monitoring on aerospace primary structure with ultrasonic and electromagnetic sensor arrays
利用超声波和电磁传感器阵列对航空航天主结构进行结构健康监测的自动分析方法
- 批准号:
2737813 - 财政年份:2022
- 资助金额:
$ 25.83万 - 项目类别:
Studentship
Structural bioinformatics and chemogenomics approaches to navigate GPCR ligand interaction space
导航 GPCR 配体相互作用空间的结构生物信息学和化学基因组学方法
- 批准号:
BB/X51178X/1 - 财政年份:2022
- 资助金额:
$ 25.83万 - 项目类别:
Training Grant