Pattern Recognition and understanding for Visual Information Media

视觉信息媒体的模式识别和理解

• 批准号: 11230101
• 负责人: OHTA Yuichi
• 金额: $ 16.13万
• 依托单位: University of Tsukuba
• 依托单位国家: 日本
• 项目类别: Grant-in-Aid for Scientific Research on Priority Areas
• 财政年份: 1999
• 资助国家: 日本
• 起止时间: 1999 至 2002
• 项目状态: 已结题
• 来源: https://kaken.nii.ac.jp/en/grant/KAKENHI-PROJECT-11230101/
• 关键词: Pattern recognition; Pattern understanding; Information media; Visual media; Intelligent information media; Visual selection; Visual summarization; Visual augmentation

Pattern recognition and understanding, PRU, is a fundamental technology to realize intelligent visual information media, which can select, summarize, and augment the visual information in the real world according to the need of each individual. The purpose of this project is to restructure the PRU technology, which has been developed for making automatic machines to replace humans, into a key technology in the multimedia fields where the information media are expected to support the human activity and to augment the human ability. The critical difference between the two cases is that a human consumes the output of PRU in multimedia systems, while a machine consumes it in automated systems for substituting humans.As common research targets of the project, we have focused on three problems that are typical and fundamental in the PRU for information media. L) The mechanism to handle the action and behavior of humans. 2) The mechanism to handle the ambiguous demand of humans. 3) The mechanism to handle the real world for which simple modeling is not applicable. These classic and difficult problems have been solved successfully by fully utilizing the following three assumptions. I) The final consumer of recognition results is a human. II) The real time interaction between computers and humane is possible. III) Visual data with long period, multiple cameras, wide field-of-vision are available.We have developed several visual information systems, such as a distance learning system with intelligent camera control capability, a mixed-reality community space with eye-contact recovery capability, a personal episode recording system with visual information summary mechanism, and a video surveillance system using multiple omni-directional image sensors.

模式识别与理解（Pattern Recognition and Understanding，PRU）是实现智能视觉信息媒体的基础技术，它能够根据个体的需要对真实的世界中的视觉信息进行选择、归纳和扩充。该项目的目的是将PRU技术（已开发用于制造自动机器以取代人类）重组为多媒体领域的关键技术，其中信息媒体有望支持人类活动并增强人类能力。这两种情况之间的关键区别在于，人在多媒体系统中消费PRU的输出，而机器在自动化系统中消费它以替代human.As项目的共同研究目标，我们集中在PRU中的三个典型和基本的问题，为信息媒体。（1）处理人类行为的机制。2)处理人类模糊需求的机制。3)处理简单建模不适用的真实的世界的机制。充分利用以下三个假设，成功地解决了这些经典难题。（1）识别结果的最终消费者是人。（2）计算机与人的真实的实时交互是可能的。三、可获得长周期、多摄像机、宽视野的视觉数据，开发了具有智能摄像机控制能力的远程学习系统、具有视线接触恢复能力的混合现实社区空间、具有视觉信息汇总机制的个人情节记录系统、使用多个全方位图像传感器的视频监控系统等多个视觉信息系统。

项目成果

Itaru Katahara, Yuich Ohta: "Scalable 3D Representation for 3D Video Display in a Large-scale Space"Proc. IEEE Virtual Reality Conference 2003(VR2003). (2003)

Itaru Katahara、Yuich Ohta：“大尺度空间中 3D 视频显示的可扩展 3D 表示”Proc。

末永康仁: "Camera Motion Estimation Based on Real Endoscope Images and CT images for Endoscope Navigation System"Proc.IAPR Workshop on Machine Vision and Applications. 409-412 (2000)

Yasuhito Suenaga：“基于真实内窥镜图像和 CT 图像的内窥镜导航系统的相机运动估计”Proc.IAPR 机器视觉和应用研讨会 409-412 (2000)。

末永康仁: "顔画像からの目領域推定に関する一手法の目領域抽出の能力評価"信学技報パターン認識・メディア理解. 99・114. 99-104 (1999)

Yasuhito Suenaga：“从面部图像估计眼睛区域的方法的眼睛区域提取能力的评估”IEICE 模式识别和媒体理解技术报告 99・114（1999）。

川嶋稔夫: "Structtial Representation of Personal Events"Proc. ISPRS International Workshop on Visualization and Animation of Reality-based 3D Models. (2003)

Minoru Kawashima：“个人事件的结构表示”ISPRS 国际基于现实的 3D 模型可视化和动画研讨会（2003 年）。

Yuichi Ohta, Yasuyuki Sugaya, Hiroki Igarashi, Kazutoshi Ohtsuki, Kaito Taguchi: "Share-Z : Client/Server Depth Sensing for See-Through Head-Mounted Displays"PRESENCE. 11-2. 176-188 (2002)

Yuichi Ohta、Yasuyuki Sugaya、Hiroki Igarashi、Kazutoshi Ohtsuki、Kaito Taguchi：“Share-Z：用于透视头戴式显示器的客户端/服务器深度传感”。