Recognition of a Virtual Scene via Simulated Prosthetic Vision.

Recognition of a Virtual Scene via Simulated Prosthetic Vision.
复制标题

通过模拟假肢视觉识别虚拟场景

DOI:
10.3389/fbioe.2017.00058
复制
发表时间:
2017
影响因子:
5.7
通讯作者:
Lv X
Lv X
中科院分区:
工程技术2区
文献类型:
--
作者:
Zhao Y;Geng X;Li Q;Jiang G;Gu Y;Lv X

文献摘要

相似文献

为了有效地帮助盲人获得最佳的低分辨率视觉和视觉恢复训练,使用模拟视觉假体场景进行寻路和识别测试。简单和复杂的虚拟场景使用3DMAX和Unity构建,并像素化为三种不同的分辨率(32 × 32,64 × 64和128 × 128)进行实时像素处理。招募了20名受试者完成场景内的寻路和物体识别任务。实验结束后记录并分析识别准确率和所需时间。在简单的模拟假肢视觉(SPV)场景中,当分辨率从32 × 32提高到48 × 48时,物体识别时间从92.19 ± 6.97秒降低到43.05 ± 6.08秒,识别准确率从51.22 ± 8.53%提高到85.52 ± 4.93%。此外,碰撞次数从10.00 ± 2.31减少到3.00 ± 0.68。当分辨率从48 × 48增加到64 × 64时,物体识别时间从43.05 ± 6.08减少到19.46 ± 3.71 s,识别准确率从85.52 ± 4.93增加到96.89 ± 2.06%,碰撞次数从3.00 ± 0.68下降到1.00 ± 0.29。在复杂场景中,当分辨率从48 × 48提高到64 × 64时,识别房间类型所需时间从115.00 ± 23.02秒降低到68.25 ± 17.23秒,物体识别准确率从65.69 ± 9.61提高到80.42 ± 7.70%。当分辨率从64 × 64增加到128 × 128时,识别房间类型所需的时间从68.25 ± 17.23减少到44.88 ± 9.94 s,物体识别准确率从80.42 ± 7.71增加到85.69 ± 7.39%。因此,可以得出结论,寻路和识别之间存在相关性。当分辨率增加时,识别所需的时间减少,识别精度增加,碰撞次数减少。虽然受试者可以在32 × 32的分辨率下部分完成识别任务,但识别时间太长,识别精度不足以识别简单场景。复杂的场景需要至少48 × 48的分辨率才能完全识别。此外,提高分辨率缩短了识别房间类型所需的时间,并提高了识别精度。
In order to effectively aid the blind with optimal low-resolution vision and visual recovery training, pathfinding and recognition tests were performed using a simulated visual prosthetic scene. Simple and complex virtual scenes were built using 3DMAX and Unity, and pixelated to three different resolutions (32 × 32, 64 × 64, and 128 × 128) for real-time pixel processing. Twenty subjects were recruited to complete the pathfinding and object recognition tasks within the scene. The recognition accuracy and time required were recorded and analyzed after the trials. In the simple simulated prosthetic vision (SPV) scene, when the resolution was increased from 32 × 32 to 48 × 48, the object recognition time decreased from 92.19 ± 6.97 to 43.05 ± 6.08 s, and the recognition accuracy increased from 51.22 ± 8.53 to 85.52 ± 4.93%. Furthermore, the number of collisions decreased from 10.00 ± 2.31 to 3.00 ± 0.68. When the resolution was increased from 48 × 48 to 64 × 64, the object recognition time further decreased from 43.05 ± 6.08 to 19.46 ± 3.71 s, the recognition accuracy increased from 85.52 ± 4.93 to 96.89 ± 2.06%, and the number of collisions decreased from 3.00 ± 0.68 to 1.00 ± 0.29. In complex scenes, the time required to recognize the room type decreased from 115.00 ± 23.02 to 68.25 ± 17.23 s, and object recognition accuracy increased from 65.69 ± 9.61 to 80.42 ± 7.70% when the resolution increased from 48 × 48 to 64 × 64. When the resolution increased from 64 × 64 to 128 × 128, the time required to recognize the room type decreased from 68.25 ± 17.23 to 44.88 ± 9.94 s, and object recognition accuracy increased from 80.42 ± 7.71 to 85.69 ± 7.39%. Therefore, one can conclude that there are correlations between pathfinding and recognition. When the resolution increased, the time required for recognition decreased, the recognition accuracy increased, and the number of collisions decreased. Although the subjects could partially complete the recognition task at a resolution of 32 × 32, the recognition time was too long and recognition accuracy was not good enough to identify simple scenes. Complex scenes required a resolution of at least 48 × 48 for complete recognition. In addition, increasing the resolution shortened the time required to identify the type of room, and improved the recognition accuracy.