Using Machine Learning and Cognitive Modeling to Understand the fMRI-measured Brain Activation Underlying the Representations of Words and Sentences
Using Machine Learning and Cognitive Modeling to Understand the fMRI-measured Brain Activation Underlying the Representations of Words and Sentences
批准号:
0423070
负责人:
Tom Mitchell
金额:
$22.46万
依托单位国家:
美国
项目类别:
Standard Grant
财政年份:
2004
资助国家:
美国
项目状态:
已结题
起止时间:
2004-09-15 至 2006-08-31
中文摘要
使用机器学习和认知建模来理解词和句子的表征背后的fMRI测量的大脑激活Tom M.Mitchell和Marcel A.Just Project摘要最近的许多fMRI研究报告了当人类受试者感知来自不同语义类别(例如,描述工具、建筑物或人的图片或单词)的图片或词语描述对象时,fMRI大脑激活的显著且可重复的差异。基于人们的大脑活动,目前可以很准确地确定一个人在思考几个语义类别中的哪一个。我们提出了基于这些最新发现的新研究,并试图了解(1)与不同语义类别的对象和动作(名词和动词)相关的人脑活动;(2)与语义类别相关的大脑活动是否可以被划分为更原始的语义成分(例如,与工具有关的词语相关的大脑活动是否包括一个表征工具视觉外观的成分和第二个表征使用工具所涉及的运动动作的成分?);这项研究涉及:(1)应用机器学习算法来发现与特定语义域相关的大脑皮层激活模式,(2)开发一个人类语言处理的计算模型,该模型实例化所发现的表征原则,并做出具体的、可测试的预测,以及(3)进行新的fMRI研究,以获得关于人类语义类别表征的新数据。如果成功,我们的研究将导致对大脑如何组织关于单词、对象和动作的意义的信息的新的科学见解。这也将为fMRI数据分析带来新的方法,特别是发现准确区分不同心理状态的fMRI激活的复杂时空模式。这项研究还将导致一种新的范式,用于开发计算认知模型,并将它们与从功能磁共振成像和行为测量获得的经验数据相匹配。拟议研究的更广泛影响将通过对几个社区的具体推广活动来放大。除了在认知和计算神经科学文献上发表我们的科学成果外,我们还将积极参与这个社区,通过NSF资助的fMRI数据中心传播我们新的实验性fMRI数据,并在互联网上记录和发布我们的新数据分析算法。我们将积极参与统计机器学习社区,这对开发新的功能磁共振成像分析方法有很大贡献,并将为本科生和研究生教育社区开发和传播教材,包括功能磁共振数据集。最后,我们拟议的研究对医学研究界有潜在的影响,特别是关于阿尔茨海默病、阅读障碍和高功能自闭症等神经疾病的研究-这三个领域涉及语言障碍,我们已经在这方面进行了积极的研究合作,为转移可能从这项研究中产生的新的科学见解提供了直接渠道。
英文摘要
Using machine learning and cognitive modeling to understand the fMRI-measuredbrain activation underlying the representations of words and sentencesTom M. Mitchell and Marcel A. Just Project AbstractA number of recent fMRI studies have reported significant and repeatable differences in fMRI brain activation when human subjects perceive pictures or words describing objects from different semantic categories (e.g., pictures or words that describe tools, buildings, or people). It is currently possible to determine with good accuracy which of several semantic categories a person is thinking about, based on their brain activation.We propose new research that builds on these recent discoveries, and seeks to understand (1) human brain activity associated with different semantic categories of objects and actions (nouns and verbs); (2) whether the brain activity associated with semantic categories can be partitioned into more primitive semantic components (e.g., does the brain activity associated with words about tools factor into one component characterizing the tool's visual appearance and a second component characterizing the motor actions involved in using the tool?); and (3) how brain activity associated with individual words is combined into more complex patterns when reading word pairs or simple phrases and sentences.This research involves:(1) applying machine learning algorithms to discover cortex-wide brain activation patterns associated with particular semantic domains, (2) developing a computational model of human language processing that instantiates the representational principles discovered and that makes specific, testable predictions, and (3) conducting new fMRI studies to obtain novel data about human semantic category representations.The intellectual merit of the proposed research is multifaceted. If successful, our research will lead to new scientific insights into how the brain organizes information about meanings of words, objects, and actions. It will also lead to new methods for fMRI data analysis, especially for discovering complex temporal-spatial patterns of fMRI activation that accurately distinguish different mental states. The research will also lead toward a new paradigm for developing computational cognitive models and fitting them to empirical data obtained from fMRI and from behavioral measures.The broader impacts of the proposed research will be amplified by specific outreach activities to several communities. In addition to publishing our scientific results in the cognitive and computational neuroscience literature, we will also actively engage this community by disseminating our new experimental fMRI data through the NSF-funded fMRI Data Center, and by documenting and publishing our new data analysis algorithms on the internet. We will proactively engage the statistical machine learning community, which has much to contribute to development of new fMRI analysis methods, and will develop and disseminate teaching materials for the undergraduate and graduate educational community,including fMRI data sets. Finally, our proposed research has potential impact on the medical research community, especially regarding the study of neurological conditions such as Alzheimer's disease, dyslexia and high-functioning autism - three areas entailing a language disturbance in which we already have active research collaborations, providing a direct conduit for transferring new scientific insights that may arise from this research.
期刊论文(0)
专著(0)
科研奖励(0)
会议论文
CDI-TYPE II: From Language to Neural Representations of Meaning
-
批准号:0835797
-
项目类别:Standard Grant
-
资助金额:$210.0万
-
财政年份:2008
-
负责人:Tom Mitchell
-
依托单位:
Learning, Visualization, and the Analysis of Large-scale Multiple-media Data
-
批准号:9720374
-
项目类别:Standard Grant
-
资助金额:$82.5万
-
财政年份:1997
-
负责人:Tom Mitchell
-
依托单位:
Explanation-Based Neural Network Learning
-
批准号:9313367
-
项目类别:Continuing Grant
-
资助金额:$35.59万
-
财政年份:1993
-
负责人:Tom Mitchell
-
依托单位:
Symposium on Cognitive and Computer Science: Mind Matters; October 25-27, 1992; Pittsburgh, PA
-
批准号:9220985
-
项目类别:Standard Grant
-
资助金额:$0.59万
-
财政年份:1992
-
负责人:Tom Mitchell
-
依托单位:
Presidential Young Investigator Award (Computer and Information Science)
-
批准号:8740522
-
项目类别:Continuing Grant
-
资助金额:$16.25万
-
财政年份:1987
-
负责人:Tom Mitchell
-
依托单位:
Presidential Young Investigator Award (Computer Research)
-
批准号:8351523
-
项目类别:Continuing Grant
-
资助金额:$14.93万
-
财政年份:1984
-
负责人:Tom Mitchell
-
依托单位:
Improving Problem Solving Strategies By Experimentation
-
批准号:8008889
-
项目类别:Standard Grant
-
资助金额:$8.78万
-
财政年份:1980
-
负责人:Tom Mitchell
-
依托单位:
国内基金
海外基金
Understanding structural evolution of galaxies with machine learning
-
批准号:
-
项目类别:省市级项目
-
资助金额:10.0万元
-
批准年份:2022
-
负责人:Nicola Rosario Napolitano
-
依托单位: