Illusory Motion Reproduced by Deep Neural Networks Trained for Prediction.
Illusory Motion Reproduced by Deep Neural Networks Trained for Prediction.
复制标题
DOI：
10.3389/fpsyg.2018.00345
复制
发表时间：
2018
影响因子：
3.8
通讯作者：
Tanaka K
中科院分区：
文献类型：
--
作者：
Watanabe E;Kitaoka A;Sakamoto K;Yasugi M;Tanaka K
大脑皮层预测视觉运动，使人类的行为适应周围物体的实时移动。尽管潜在的机制尚不清楚，预测编码是主要理论之一。预测编码假设大脑的内部模型（通过学习获得）随时预测视觉世界，预测和实际感官输入之间的误差进一步完善了内部模型。在过去的一年里，基于预测编码的深度神经网络被报道用于名为PredNet的视频预测机。如果该理论实质上再现了大脑皮层的视觉信息处理过程，那么PredNet就有望代表人类对运动的视觉感知。本研究使用观看者自身运动的自然场景视频对PredNet进行训练，并使用非学习视频验证所获得的计算机模型的运动预测能力。我们发现计算机模型准确地预测了非学习视频中旋转螺旋桨的大小和运动方向。令人惊讶的是，它也代表了没有物理运动的错觉图像的旋转运动，很像人类的视觉感知。虽然经过训练的神经网络准确地再现了虚幻旋转的方向，但它没有检测到负面控制图片中的运动成分，其中人们没有感知到虚幻运动。本研究支持了预测编码理论假设的机制是运动错觉产生的基础之一这一令人兴奋的观点。利用感觉错觉作为人类感知的指标，深度神经网络有望为大脑研究的发展做出重大贡献。
The cerebral cortex predicts visual motion to adapt human behavior to surrounding objects moving in real time. Although the underlying mechanisms are still unknown, predictive coding is one of the leading theories. Predictive coding assumes that the brain's internal models (which are acquired through learning) predict the visual world at all times and that errors between the prediction and the actual sensory input further refine the internal models. In the past year, deep neural networks based on predictive coding were reported for a video prediction machine called PredNet. If the theory substantially reproduces the visual information processing of the cerebral cortex, then PredNet can be expected to represent the human visual perception of motion. In this study, PredNet was trained with natural scene videos of the self-motion of the viewer, and the motion prediction ability of the obtained computer model was verified using unlearned videos. We found that the computer model accurately predicted the magnitude and direction of motion of a rotating propeller in unlearned videos. Surprisingly, it also represented the rotational motion for illusion images that were not moving physically, much like human visual perception. While the trained network accurately reproduced the direction of illusory rotation, it did not detect motion components in negative control pictures wherein people do not perceive illusory motion. This research supports the exciting idea that the mechanism assumed by the predictive coding theory is one of basis of motion illusion generation. Using sensory illusions as indicators of human perception, deep neural networks are expected to contribute significantly to the development of brain research.
登录
查看更多内容
影响因子：
1.8
作者：
Bogacz R
通讯作者：
Bogacz R
DOI：
10.1098/rstb.2005.1622
发表时间：
2005-04-29
影响因子：
6.3
作者：
Friston, KJ
通讯作者：
Friston, KJ
DOI：
10.1523/jneurosci.1979-16.2016
发表时间：
2017-02-15
期刊：
The Journal of neuroscience : the official journal of the Society for Neuroscience
影响因子：
--
作者：
Diederen KM;Ziauddeen H;Vestergaard MD;Spencer T;Schultz W;Fletcher PC
通讯作者：
Fletcher PC
影响因子：
4.3
作者：
Khaligh-Razavi SM;Kriegeskorte N
通讯作者：
Kriegeskorte N
影响因子：
2.9
作者：
Gori S;Molteni M;Facoetti A
通讯作者：
Facoetti A