Corneal imaging system: Environment from eyes
Corneal imaging system: Environment from eyes
复制标题
DOI：
10.1007/s11263-006-6274-9
复制
发表时间：
2006-10-01
影响因子：
19.5
通讯作者：
Nayar, Shree K.
中科院分区：
文献类型：
--
作者：
Nishino, Ko;Nayar, Shree K.
本文提供了一个全面的分析，究竟是什么视觉信息的世界是嵌入在一个单一的图像的眼睛。事实证明，眼睛的角膜和观察眼睛的相机形成了折反射成像系统。我们称之为角膜成像系统。与典型的折反射系统不同，角膜系统是柔性的，因为反射器（角膜）不是刚性地附接到相机。使用基于解剖学研究的角膜的几何模型，可以从眼睛的单个图像估计其3D位置和取向。一旦完成这一点，就可以从图像中获得人的环境的广角视图。此外，我们可以计算环境在视网膜上的投影，其中心与注视方向对齐。这个视网膜图像揭示了这个人正在看什么。本文详细分析了角膜成像系统的视场、分辨率和视点位置等特性。当一个人的双眼被捕获在一个图像中时，我们就有了一个立体角膜成像系统。我们分析了这个立体系统的对极几何，并展示了它如何可以用来计算3D结构。我们在本文中提出的框架解释眼睛图像是被动和非侵入性的。它对视觉识别、人机界面、计算机图形学和人类情感研究等领域有着直接的影响。
This paper provides a comprehensive analysis of exactly what visual information about the world is embedded within a single image of an eye. It turns out that the cornea of an eye and a camera viewing the eye form a catadioptric imaging system. We refer to this as a corneal imaging system. Unlike a typical catadioptric system, a corneal one is flexible in that the reflector (cornea) is not rigidly attached to the camera. Using a geometric model of the cornea based on anatomical studies, its 3D location and orientation can be estimated from a single image of the eye. Once this is done, a wide-angle view of the environment of the person can be obtained from the image. In addition, we can compute the projection of the environment onto the retina with its center aligned with the gaze direction. This foveated retinal image reveals what the person is looking at. We present a detailed analysis of the characteristics of the corneal imaging system including field of view, resolution and locus of viewpoints. When both eyes of a person are captured in an image, we have a stereo corneal imaging system. We analyze the epipolar geometry of this stereo system and show how it can be used to compute 3D structure. The framework we present in this paper for interpreting eye images is passive and non-invasive. It has direct implications for several fields including visual recognition, human-machine interfaces, computer graphics and human affect studies.