KDI: Virtual Environments to Elucidate Strategies in Complex Spatial Problem Solving

KDI：虚拟环境阐明复杂空间问题解决策略

• 批准号: 9980122
• 负责人: Frank Tendick
• 金额: $ 100万
• 依托单位: University of California-San Francisco
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 1999
• 资助国家: 美国
• 起止时间: 1999-09-15 至 2003-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=9980122&HistoricalAwards=false
• 关键词: KDI; Virtual; Environments; Elucidate; Strategies

Although spatial cognition has been studied in a variety of domains,there is still little known about the integration of spatial skills insolving complex problems. In this research program, virtualenvironment technology (VET) will be used to study complex spatialskills and, from the results of this study, to develop effectivevirtual environments to train these skills. With their interactiveand compelling nature, virtual environments can become an essentialtool for training, visualization, planning, and communication in anunlimited variety of applications. But if VET is to reach itspotential, there must be a better understanding of how humans acquireand integrate multi-sensory information in three-dimensional space.The focus application of the work will be surgical training, whichprovides a challenging environment for studying spatial cognition.The performance of surgical tasks requires a broad range of spatialprocesses in order to plan, navigate, and reason using complexrepresentations of space. The surgeon must develop a mental image ofthree-dimensional anatomy based on a surface view or cross sectionsfrom X-ray, CT, MRI, or ultrasound images. From this model and a goalstate based on experience and anatomical knowledge, he or she mustplan a strategy to gain exposure of the important anatomy and obtainthe desired result. With the advent of minimally invasive techniques,the surgeon relies on a video image of the internal anatomy and useinstruments constrained by a fulcrum at their passage through theskin.This work has two synergistic thrusts. The first aims to advancefundamental knowledge in cognitive science by examining how spatialcognitive skills are integrated in the performance of complex tasks.Specifically, the project will study navigation in small-scalethree-dimensional environments, mental simulation of mechanicalinteractions between deformable structures, and how these spatial andmechanical reasoning processes are integrated in solving complexspatial problems. This work will be guided by computational models ofthe construction of 3-D spatial models from multiple views. Thesecond thrust is to advance the state of the art in human-computerinteraction by designing intelligent systems to train and assist humanperformance in spatial problem solving.

虽然空间认知已经在各个领域得到了研究，但对于解决复杂问题的空间技能的整合仍然知之甚少。在这个研究项目中，虚拟环境技术（VET）将被用于研究复杂的空间技能，并根据这项研究的结果，开发有效的虚拟环境来训练这些技能。凭借其交互性和引人注目的特性，虚拟环境可以成为培训、可视化、规划和交流的基本工具，应用范围无限。但是，如果VET要发挥其潜力，就必须更好地理解人类如何在三维空间中获取和整合多感官信息。这项工作的重点应用将是外科训练，这为研究空间认知提供了一个具有挑战性的环境。外科手术任务的执行需要广泛的空间处理，以便使用复杂的空间表示进行计划、导航和推理。外科医生必须根据x光、CT、MRI或超声图像的表面视图或横切面，在脑海中形成三维解剖图像。根据这个模型和基于经验和解剖学知识的目标状态，他或她必须计划一个策略来获得重要解剖的暴露并获得期望的结果。随着微创技术的出现，外科医生依靠内部解剖的视频图像，并在通过皮肤时使用受支点约束的器械。这项工作有两个协同推动力。第一部分旨在通过研究如何将空间认知技能整合到复杂任务的执行中来推进认知科学的基础知识。具体而言，该项目将研究小尺度三维环境中的导航，可变形结构之间机械相互作用的心理模拟，以及如何将这些空间和机械推理过程整合到解决复杂的空间问题中。这项工作将以从多个视图构建三维空间模型的计算模型为指导。第二个重点是通过设计智能系统来训练和协助人类在解决空间问题方面的表现，从而推动人机交互技术的发展。