Visual attention neuroprosthesis in marmoset to elucidate midbrain mechanisms of bottom-up attention

狨猴视觉注意神经假体阐明自下而上注意的中脑机制

• 批准号: 21K15609
• 负责人: Veale Richard
• 金额: $ 2.91万
• 依托单位: Kyoto University
• 依托单位国家: 日本
• 项目类别: Grant-in-Aid for Early-Career Scientists
• 财政年份: 2021
• 资助国家: 日本
• 起止时间: 2021-04-01 至 2024-03-31
• 项目状态: 已结题
• 来源: https://kaken.nii.ac.jp/en/grant/KAKENHI-PROJECT-21K15609/
• 关键词: Free Viewing; Superior Colliculus; Blindsight; Gaze Behavior; Saliency; Silicon Probe; Marmoset; Neural Prosthesis; Visual Attention; Neuroprosthesis

This year, primary achievements were analysis of free viewing gaze data from control subjects and from human infants (a model with less top-down input), implementation of better predictive models for replacing missing visual cortex activity, and design and planning of the superior colliculus silicon probe implantations. Interestingly, infants past 12 months do not appear to have different looking patterns than marmosets, in contrast to our predictions (and thus using 12 month old infants as a null model against marmosets for comparison is tenable).On the modeling side, I implemented foveation and gaze-centered versions of the target prediction (i.e. saliency map) models. This took longer than expected due to underestimation of their difficulty for real-time implementation. These are available freely on github.Finally, to enable better throughput and administration of data, I implemented a pipeline to analyze gaze data and saliency (including saccade and other eye movement detections) which uses relational databases instead of the previous distributed file format, to save space and computation. I submitted a large review paper as well as several other original papers regarding the infant data as well as free viewing data from marmoset.

今年，主要的成就是分析了来自对照受试者和人类婴儿的自由观看凝视数据（一种自上而下输入较少的模型），实现了更好的预测模型来取代缺失的视觉皮层活动，以及设计和规划了上级丘硅探针的植入。有趣的是，与我们的预测相反，超过12个月的婴儿似乎没有与绒猴不同的注视模式（因此使用12个月大的婴儿作为绒猴的空模型进行比较是站得住脚的）。在建模方面，我实现了目标预测（即显着图）模型的中心凹和凝视中心版本。由于低估了实时实施的难度，这比预期的时间要长。最后，为了更好地实现数据吞吐量和管理，我实现了一个管道来分析凝视数据和显著性（包括扫视和其他眼动检测），它使用关系数据库而不是以前的分布式文件格式，以节省空间和计算。我提交了一篇大型综述论文以及其他几篇关于婴儿数据的原创论文，以及免费查看绒猴数据。

项目成果

Why We Should Report Colorimetric Data In Every Paper.

为什么我们应该在每篇论文中报告比色数据。

• 发表时间: 2021
• 作者: Veale;Richard
• 通讯作者: Richard

Visual attention in 9- and 12-month human infants and adults versus macaque and marmoset monkeys

9 个月和 12 个月大的人类婴儿和成人与猕猴和狨猴的视觉注意力

• 发表时间: 2023
• 作者: Veale Richard;Chen Chih-yang;Isa Tadashi;Richard Veale
• 通讯作者: Richard Veale

Marmoset Monkeys Model Human Infant Gaze?

狨猴模仿人类婴儿的目光？

• DOI: 10.1109/icdl49984.2021.9515602
• 发表时间: 2021
• 期刊: Proceedings of the IEEE International Conference on Development and Learning (ICDL)
• 作者: Veale Richard;Chen Chih-yang;Isa Tadashi
• 通讯作者: Isa Tadashi

Software for analysis of model

模型分析软件

Salmap Computation

Salmap计算