Improving deep neural networks as a modelling framework for human ventral stream computations

改进深度神经网络作为人类腹侧流计算的建模框架

• 批准号: 2114371
• 金额: --
• 依托单位: University of Cambridge
• 依托单位国家: 英国
• 项目类别: Studentship
• 财政年份: 2018
• 资助国家: 英国
• 起止时间: 2018 至 无数据
• 项目状态: 未结题
• 来源: https://gtr.ukri.org/projects?ref=studentship-2114371
• 关键词: Improving; deep; neural; networks; modelling

The overall aim of my doctoral research is to develop better models of the ventral stream. The standard test of mechanistic similarity between such a model and the brain is the model's ability to predict neuroimaging data from healthybrains. Currently, DNNs can explain more than half the variance of primate electrophysiological data. However, a model of the ventral stream should not only predict healthy neural activations, but should also reproduce human-like errors in response to progressive lesions of the system. Filling in this gap, I am developing a test case that would act as an additional assessment of how brain-like a DNN's visual information processing is. To this aim, I am using semantic dementia (SD) patient data. SD patients have localised lesions in the temporal lobe and exhibit well-defined impairments, for example, subordinate level categorisation is impaired while basic level categorisation is preserved. DNNs that act as models of the human temporal lobe should therefore replicate these impairments when parts of the model are lesioned. Once successful models are found, lesioned DNNs mayalso be useful predictors of the types of judgements and distinctions that may be difficult for SD patients. The aim of the second stage of my proposed research will be to develop DNNs that better predict both healthy neuroimaging data and patient data. Whilst DNNs are biologically-inspired, they have not been developed with the intention of explaining neural computations, but instead are used most commonly as engineering solutions to computer vision problems. Therefore, it is reasonable to suggest that their architecture, functional objective(s), input training data and learning algorithms could all be improved based on neuroanatomy and neuropsychology in order to achieve biological plausibility. I hypothesise that the inclusion of relevant biological detail will result in more brain-like models. I will initially explore DNNs with a different functional objective; trained to predict an item's position in a high-dimensional semantic embedding space rather than the commonly used categorisation objective. It is unlikely that the visual system's primary goal is categorisation. A category-trained DNN aims to separate the clusters of 'cat,' 'dog' and 'umbrella' orthogonally as far apart as possible in order to be able to differentiate between them, but to be more realistic, the 'cat' and 'dog' clusters should be much closer together than 'umbrella' in the model's feature space. I will therefore train a DNN to predict high-dimensional word embedding vectors, obtained from linguistics in which items with similar WEVs appear in similar written contexts. I hypothesis that these DNNs will be able to better predict both behavioural data from healthy humans and also SD patients when the models are lesioned as part of my new testbed.

我博士研究的总体目标是开发更好的腹侧流模型。这种模型和大脑之间机械相似性的标准测试是模型预测健康大脑神经成像数据的能力。目前，DNN可以解释灵长类动物电生理数据的一半以上。然而，腹侧流的模型不仅应该预测健康的神经激活，而且还应该再现类似人类的错误，以应对系统的进行性病变。为了填补这一空白，我正在开发一个测试用例，作为对DNN视觉信息处理与大脑相似程度的额外评估。为此，我使用语义痴呆（SD）患者数据。SD患者在颞叶有局部病变，并表现出明确的损伤，例如，次级分类受损，而基本水平分类保留。因此，作为人类颞叶模型的DNN应该在模型的部分受损时复制这些损伤。一旦成功的模型被发现，损伤的DNN也可能是有用的预测类型的判断和区分，可能是困难的SD患者。我所提出的研究的第二阶段的目标是开发更好地预测健康神经成像数据和患者数据的DNN。虽然DNN是受生物启发的，但它们并不是为了解释神经计算而开发的，而是最常用作计算机视觉问题的工程解决方案。因此，可以合理地建议，它们的架构、功能目标、输入训练数据和学习算法都可以基于神经解剖学和神经心理学进行改进，以实现生物相容性。我假设，包括相关的生物学细节将导致更多的大脑模型。我将首先探索具有不同功能目标的DNN;训练用于预测项目在高维语义嵌入空间中的位置，而不是常用的分类目标。视觉系统的主要目标不太可能是分类。分类训练的DNN旨在将“猫”，“狗”和“伞”的聚类尽可能正交地分开，以便能够区分它们，但更现实的是，“猫”和“狗”聚类在模型的特征空间中应该比“伞”更接近。因此，我将训练DNN来预测高维词嵌入向量，这些向量是从语言学中获得的，其中具有相似WEV的项目出现在相似的书面上下文中。我假设这些DNN将能够更好地预测来自健康人类和SD患者的行为数据，当模型作为我的新测试平台的一部分被损坏时。