EAGER: Investigating the Neural Correlates of Musical Rhythms from Intracranial Recordings

EAGER：研究颅内录音音乐节奏的神经关联

• 批准号: 1451028
• 负责人: Dean Krusienski
• 金额: $ 14.99万
• 依托单位: Old Dominion University Research Foundation
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2014
• 资助国家: 美国
• 起止时间: 2014-09-01 至 2017-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1451028&HistoricalAwards=false
• 关键词: EAGER; Investigating; Neural; Correlates; Musical

The project will develop an offline and then a real-time brain computer interface to detect rhythms that are imagined in people's heads, and translate these rhythms into actual sound. The project builds upon research breakthroughs in electrocorticographic (ECoG) recording technology to convert music that is imagined into synthesized sound. The project researchers will recruit from a specialized group of people for this project, specifically patients with intractable epilepsy who are currently undergoing clinical evaluation of their condition at the Mayo Clinic in Jacksonville, Florida, and are thus uniquely prepared to use brain-computer interfaces based on ECoG recording techniques. This is a highly multidisciplinary project that will make progress towards developing a "brain music synthesizer" which could have a significant impact in the neuroscience and musical domains, and lead to creative outlets and alternative communication devices and thus life improvements for people with severe disabilities.Most brain-computer interfaces (BCIs) use surface-recorded electrophysiological measurements such as surface-recorded electroencephalogram (EEG). However, while some useful signals can be extracted from such surface techniques, it is nearly impossible to accurately decode from such signals the intricate brain activity involved in activities such as language with the detail needed to achieve a natural, transparent translation of thought to device control. On the contrary, intracranial electrodes such as ECoG are closer to the source of the desired brain activity, and can produce signals that, compared to surface techniques, have superior spatial and spectral characteristics and signal-to-noise ratios. Research has already shown that intracranial signals can provide superior decoding capabilities for motor and language signals, and for BCI control. Because complex language and auditory signals (both perceived and imagined) have been decoded using intracranial activity, it is conceivable to decode perceived and imagined musical content from intracranial signals. This project will attempt to similarly use ECoG to decode perceived and imagined musical content from intracranial signals as has been done for language and auditory signals.

该项目将开发一个离线和实时的脑机接口，以检测人们头脑中想象的节奏，并将这些节奏转化为实际的声音。该项目建立在脑皮层电图（ECoG）记录技术的研究突破之上，该技术可以将想象中的音乐转换为合成声音。该项目的研究人员将从一组专门的人群中招募，特别是顽治性癫痫患者，他们目前正在佛罗里达州杰克逊维尔的梅奥诊所接受病情的临床评估，因此他们为使用基于ECoG记录技术的脑机接口做了独特的准备。这是一个高度跨学科的项目，将朝着开发“大脑音乐合成器”的方向取得进展，这可能对神经科学和音乐领域产生重大影响，并导致创造性的出口和替代通信设备，从而改善严重残疾人士的生活。大多数脑机接口（bci）使用表面记录的电生理测量，如表面记录的脑电图（EEG）。然而，虽然可以从这些表面技术中提取一些有用的信号，但几乎不可能从这些信号中准确解码复杂的大脑活动，这些活动涉及语言等活动，其细节需要实现将思想自然、透明地翻译为设备控制。相反，像ECoG这样的颅内电极更接近所需大脑活动的来源，并且与表面技术相比，可以产生具有优越的空间和频谱特性以及信噪比的信号。研究已经表明，颅内信号可以为运动和语言信号以及脑机接口控制提供优越的解码能力。由于复杂的语言和听觉信号（包括感知和想象）已经通过颅内活动解码，因此可以想象从颅内信号解码感知和想象的音乐内容。这个项目将尝试类似地使用ECoG从颅内信号中解码感知和想象的音乐内容，就像对语言和听觉信号所做的那样。