Motion illusion-like patterns extracted from photo and art images using predictive deep neural networks.
Motion illusion-like patterns extracted from photo and art images using predictive deep neural networks.
复制标题
DOI：
10.1038/s41598-022-07438-3
复制
发表时间：
2022-03-10
影响因子：
4.6
通讯作者：
Watanabe E
中科院分区：
文献类型：
--
作者：
Kobayashi T;Kitaoka A;Kosaka M;Tanaka K;Watanabe E
在我们之前的研究中，我们使用结合预测编码理论的深度神经网络成功地再现了旋转蛇错觉中感知到的虚幻运动。在本研究中，我们使用了一组1500张图像，包括普通的静态绘画图像、照片和各种类型的运动错觉图像，进一步考察了该网络的特性。结果表明，这些网络清楚地将一组错觉图像和其他图像分类，并针对类似于人类感知的各种类型的错觉再现虚幻运动。值得注意的是，这些网络偶尔会检测到异常的运动矢量，即使在人类无法感知任何虚幻运动的正常静态图像中也是如此。此外，利用检测到异常向量的区域生成具有重复图案的类错觉设计，并进行心理物理实验，其中检测所生成设计中的错觉运动感知。观察到的网络的不准确性将为进一步理解与人类视觉相关的信息处理提供有用的信息。
In our previous study, we successfully reproduced the illusory motion perceived in the rotating snakes illusion using deep neural networks incorporating predictive coding theory. In the present study, we further examined the properties of the network using a set of 1500 images, including ordinary static images of paintings and photographs and images of various types of motion illusions. Results showed that the networks clearly classified a group of illusory images and others and reproduced illusory motions against various types of illusions similar to human perception. Notably, the networks occasionally detected anomalous motion vectors, even in ordinally static images where humans were unable to perceive any illusory motion. Additionally, illusion-like designs with repeating patterns were generated using areas where anomalous vectors were detected, and psychophysical experiments were conducted, in which illusory motion perception in the generated designs was detected. The observed inaccuracy of the networks will provide useful information for further understanding information processing associated with human vision.
登录
查看更多内容
影响因子：
2.7
作者：
Agrillo, Christian;Gori, Simone;Beran, Michael J.
通讯作者：
Beran, Michael J.
DOI：
10.1098/rstb.2005.1622
发表时间：
2005-04-29
影响因子：
6.3
作者：
Friston, KJ
通讯作者：
Friston, KJ
影响因子：
1.8
作者：
Funke CM;Borowski J;Stosio K;Brendel W;Wallis TSA;Bethge M
通讯作者：
Bethge M
影响因子：
4.6
作者：
Gori, Simone;Agrillo, Christian;Bisazza, Angelo
通讯作者：
Bisazza, Angelo
影响因子：
1.8
作者：
Gomez-Villa, A.;Martin, A.;Malo, J.
通讯作者：
Malo, J.