CAREER: Multimodal Brain and Body Music Interfaces to Promote Entrainment, Connection, and Creative Science Education
职业:多模式大脑和身体音乐界面促进夹带、联系和创造性科学教育
基本信息
- 批准号:2313518
- 负责人:
- 金额:$ 48.99万
- 依托单位:
- 依托单位国家:美国
- 项目类别:Continuing Grant
- 财政年份:2023
- 资助国家:美国
- 起止时间:2023-04-01 至 2027-08-31
- 项目状态:未结题
- 来源:
- 关键词:
项目摘要
This award is funded in part under the American Rescue Plan Act of 2021 (Public Law 117-2). Entrainment is a process in which people’s natural brain and body rhythms synchronize, through stimuli such as music, which may create feelings of connection and well-being. This project addresses entrainment by building multimodal signal mapping interfaces that mediate interpersonal connections by deriving music from brain and body rhythms. The investigator will integrate sensor hardware and signal processing software to stream live brain and body data, perform calculations to extract signal characteristics, and use this to drive sound synthesis. A series of music cognition and listening experiments study physiological, behavioral, and affective entrainment phenomena, which are expected to result, from a series of multimodal brain music interfaces. A use-case study, developed in consultation with doctors, connects mothers and infants, physically separated by distance, using the multimodal entrainment interface. Mother and infant hear music derived from each other’s heartbeats and breathing. This study investigates the entrainment created in their body rhythms, and maps health and well-being effects of the virtual connection environment. For researchers, doctors, and caretakers, multimodal brain music interfaces have the potential to expand our scientific understanding of music’s beneficial effects on the brain and body, which may lead to new health and well-being interventions for adults, children, and infants. This project will result in an open-source tool kit of accessible technologies and STEM learning modules to inspire educators and students to develop projects that further our understanding of brain and body signals. These learning modules will be integrated into a summer research experience--involving high school students and their teachers--in which authentic learning encourages students’ training in the scientific method through their natural interest in music. This project develops and evaluates an interface with new multimodal signal mapping technologies that translate neurophysiological signals (e.g., EEG, ECG, EDA, respiration) into musical sound to promote biological, behavioral, and affective synchrony between individuals and computers by: (1) engineering sonification techniques that perform real-time signal processing and algorithmic music generation for transforming physiological signals into music; (2) investigating the neuropsychological mechanisms that govern auditory neurostimulation and physiological entrainment by designing new rhythmic auditory neurophysiological sonification stimuli and measuring how the human body responds; and (3) designing and evaluating a use case that involves co-generating music for infants and their mothers with each other’s physiological data. Quantitative data will address synchronies in physiology, protocol analysis of video will address behavioral synchronies, and qualitative data will address experiences. These research activities will contribute to an overarching goal of discovering how using computing to pair music and physiology can function as a significant information channel in human-centered computing. One expected use of this channel is to promote human connection and well-being through entrainment.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
该奖项部分由2021年美国救援计划法案(公法117-2)资助。娱乐是一个过程,在这个过程中,人们的自然大脑和身体的节奏同步,通过刺激,如音乐,这可能会产生联系和幸福的感觉。该项目通过构建多模态信号映射接口,通过从大脑和身体节奏中提取音乐来调解人际关系,从而解决了娱乐问题。研究人员将集成传感器硬件和信号处理软件,以实时传输大脑和身体数据,执行计算以提取信号特征,并使用它来驱动声音合成。一系列的音乐认知和听力实验研究了一系列多模态脑音乐接口预期产生的生理、行为和情感夹带现象。在与医生协商后开展的一项用例研究使用多模式娱乐界面将物理上相隔很远的母亲和婴儿联系起来。母亲和婴儿从彼此的心跳和呼吸中听到音乐。本研究调查了在他们的身体节奏中产生的娱乐,并绘制了虚拟连接环境对健康和福祉的影响。对于研究人员、医生和看护人来说,多模态脑音乐接口有可能扩展我们对音乐对大脑和身体有益影响的科学理解,这可能会为成人、儿童和婴儿带来新的健康和福祉干预。该项目将产生一个开源工具包,包括可访问的技术和STEM学习模块,以激励教育工作者和学生开发进一步了解大脑和身体信号的项目。这些学习模块将被整合到一个暑期研究体验中——高中生和他们的老师都参与其中——在这个过程中,真实的学习鼓励学生通过他们对音乐的自然兴趣来训练科学方法。该项目开发并评估了一个新的多模态信号映射技术接口,该接口将神经生理信号(如脑电图、心电图、EDA、呼吸)转换为音乐声音,以促进个人与计算机之间的生物、行为和情感同步,方法如下:(1)执行实时信号处理的工程超声技术和将生理信号转换为音乐的算法音乐生成;(2)通过设计新的有节奏的听觉神经生理声刺激并测量人体的反应,研究控制听觉神经刺激和生理卷带的神经心理学机制;(3)设计和评估一个用例,该用例涉及使用彼此的生理数据为婴儿和母亲共同生成音乐。定量数据将解决生理学上的同步问题,视频协议分析将解决行为同步问题,定性数据将解决经验问题。这些研究活动将有助于实现一个总体目标,即发现如何使用计算将音乐和生理学结合起来,作为以人为中心的计算的重要信息渠道。这一渠道的一个预期用途是通过娱乐来促进人与人之间的联系和幸福。该奖项反映了美国国家科学基金会的法定使命,并通过使用基金会的知识价值和更广泛的影响审查标准进行评估,被认为值得支持。
项目成果
期刊论文数量(0)
专著数量(0)
科研奖励数量(0)
会议论文数量(0)
专利数量(0)
数据更新时间:{{ journalArticles.updateTime }}
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
数据更新时间:{{ journalArticles.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ monograph.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ sciAawards.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ conferencePapers.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ patent.updateTime }}
Grace Leslie其他文献
Design of a physiological parameter monitoring system, implementing internet of things communication protocols by using embedded Systems
生理参数监测系统的设计,利用嵌入式系统实现物联网通信协议
- DOI:
10.1109/ropec55836.2022.10018715 - 发表时间:
2022 - 期刊:
- 影响因子:0
- 作者:
Daniel Llamas;Grace Leslie;J. A. Salazar;Adriana del Carmen Téllez;Miguelangel Fraga - 通讯作者:
Miguelangel Fraga
First demonstration of an EEG-based emotion BCI
首次演示基于脑电图的情感 BCI
- DOI:
- 发表时间:
2010 - 期刊:
- 影响因子:0
- 作者:
S. Makeig;Grace Leslie;T. Mullen;D. Sarma;N. Bigdely;Christian Kothe - 通讯作者:
Christian Kothe
Simulation of Networked Ensemble Performance with Varying Time Delays: Characterization of Ensemble Accuracy
具有不同时延的网络集成性能的仿真:集成精度的表征
- DOI:
- 发表时间:
2004 - 期刊:
- 影响因子:0
- 作者:
Michael Gurevish;C. Chafe;Grace Leslie;S. Tyan - 通讯作者:
S. Tyan
Measuring and classifying musical engagement using EEG and motion capture
使用脑电图和动作捕捉测量和分类音乐参与度
- DOI:
10.7490/f1000research.1096389.1 - 发表时间:
2014 - 期刊:
- 影响因子:0
- 作者:
Grace Leslie;A. Ojeda;S. Makeig - 通讯作者:
S. Makeig
MoodMixer: EEG-based Collaborative Sonification
MoodMixer:基于脑电图的协作发声
- DOI:
10.5281/zenodo.1178089 - 发表时间:
2011 - 期刊:
- 影响因子:0
- 作者:
Grace Leslie;T. Mullen - 通讯作者:
T. Mullen
Grace Leslie的其他文献
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
{{ truncateString('Grace Leslie', 18)}}的其他基金
CAREER: Multimodal Brain and Body Music Interfaces to Promote Entrainment, Connection, and Creative Science Education
职业:多模式大脑和身体音乐界面促进夹带、联系和创造性科学教育
- 批准号:
2142959 - 财政年份:2022
- 资助金额:
$ 48.99万 - 项目类别:
Continuing Grant
相似海外基金
Multi-National Implementation of Multimodal Strategies to promote Healthy Brain Ageing in Sub-Saharan Africa (The AFRICA-FINGERS Project)
多国实施多模式战略,促进撒哈拉以南非洲地区大脑健康老化(AFRICA-FINGERS 项目)
- 批准号:
MR/Y019822/1 - 财政年份:2024
- 资助金额:
$ 48.99万 - 项目类别:
Research Grant
Dynamic multimodal connectivity analysis of brain networks in focal epilepsy
局灶性癫痫脑网络的动态多模态连接分析
- 批准号:
10678514 - 财政年份:2023
- 资助金额:
$ 48.99万 - 项目类别:
Multimodal longitudinal imaging of brain and cervical cord as an ALS disease biomarker using microstructure statistics and morphometry
使用微观结构统计和形态测量对大脑和颈髓进行多模态纵向成像作为 ALS 疾病生物标志物
- 批准号:
10836791 - 财政年份:2023
- 资助金额:
$ 48.99万 - 项目类别:
Establishing Multimodal Brain Biomarkers Using Data-driven Analyticsfor Treatment Selection in Depression
使用数据驱动分析建立多模式脑生物标志物以选择抑郁症的治疗方法
- 批准号:
10660219 - 财政年份:2023
- 资助金额:
$ 48.99万 - 项目类别:
Blood-Brain Barrier Permeable Multimodal Imaging Agents for Neurodegenerative Diseases
用于神经退行性疾病的血脑屏障渗透性多模态成像剂
- 批准号:
10740351 - 财政年份:2023
- 资助金额:
$ 48.99万 - 项目类别:
CAREER: MINDWATCH: Multimodal Intelligent Noninvasive brain state Decoder for Wearable AdapTive Closed-loop arcHitectures
职业:MINDWATCH:用于可穿戴自适应闭环结构的多模态智能无创大脑状态解码器
- 批准号:
2226123 - 财政年份:2022
- 资助金额:
$ 48.99万 - 项目类别:
Continuing Grant
How the brain integrates emotional information with context: a multimodal and multidimensional approach
大脑如何将情绪信息与情境整合:多模式和多维方法
- 批准号:
RGPIN-2020-06706 - 财政年份:2022
- 资助金额:
$ 48.99万 - 项目类别:
Discovery Grants Program - Individual
Toward Healthy Aging in Adults with Autism: A Longitudinal Clinical and Multimodal Brain Imaging Study
成年自闭症患者健康老龄化:纵向临床和多模态脑成像研究
- 批准号:
10698180 - 财政年份:2022
- 资助金额:
$ 48.99万 - 项目类别:
Use of 7T multimodal imaging to detect brain changes associated with light therapy in persons with mild cognitive impairment and mild Alzheimer's Disease
使用 7T 多模态成像检测轻度认知障碍和轻度阿尔茨海默病患者与光疗相关的大脑变化
- 批准号:
10673010 - 财政年份:2022
- 资助金额:
$ 48.99万 - 项目类别:
Multimodal prediction of seizure recurrence after unprovoked first seizure to guide clinical decision-making: A multi-centre study of cognition, mood and brain connectivity as predictors
无端首次癫痫发作后癫痫复发的多模式预测以指导临床决策:认知、情绪和大脑连接作为预测因素的多中心研究
- 批准号:
461490 - 财政年份:2022
- 资助金额:
$ 48.99万 - 项目类别:
Operating Grants