Highly interactive 3D user interfaces

该建议涉及自由曲面设计和理解的新技术的研究和开发。自由形式曲面的示例包括车身、船体和视频游戏中的奇特生物。建议的工作是旨在提高自由曲面的设计和理解，通过使用手持三维位置和方向跟踪器。在我们的实验性自由形式编辑器MeshSculptor中，当用户坐在屏幕前使用两个3D跟踪器操纵表面时，实时图形系统会连续地为编辑过的表面制作动画。每只手都扮演着不同的角色，占优势的手负责挑选和操作，而不占优势的手负责各种上下文设置。采用以用户为中心的设计方法，我们计划开发新的双手技术，用于设计表面和显示表面属性，使用专门的纹理呈现在表面上。我们的表面编辑方法是使用3D跟踪器扭曲表面的突出显示部分，该项目旨在开发功能强大且易于使用的新扭曲操作符。我们还计划开发一个新的warps抽象，允许warps在完成后重新完成和调整。我们计划将这项工作应用于儿科心脏手术规划领域。在这一领域，外科医生为心脏只有一个心室的患者重新安排血液流动。我们正在与研究人员合作，他们使用流体动力学模拟来评估改道手术的流动效率。这些研究人员正在使用我们的自由曲面编辑器来帮助理解当前的血管形状，并编辑形状，希望找到更有效的配置。

This proposal concerns the research and development of new techniques for the design and understanding of free-form surfaces. Examples of free-form surfaces include car bodies, ship hulls, and fanciful creatures in video games. The proposed work is aims to improve the design and understanding of free-form surfaces through the use of hand-held 3D position and orientation trackers. In MeshSculptor, our experimental free-form editor, a real-time graphics system continuously animates the edited surface as the user sits in front of the screen manipulating the surface using the two 3D trackers. Each hand has a distinct role to play, with the dominant hand being responsible for picking and manipulation, and the less-dominant hand being responsible for context setting of various kinds. Employing a user-centered design approach, we plan to develop new two-handed techniques for designing surfaces and for displaying surface properties using specialized textures rendered on the surface. Our approach to surface editing is to warp the highlighted part of the surface using the 3D trackers, and this project seeks to develop new warp operators that are powerful and easy to use. We also plan to develop a new abstraction for warps that will allow warps to be re-done and adjusted after they have been completed. We plan to apply this work to the domain of pediatric cardiac surgery planning. In this domain, surgeons reroute blood flow in patients whose hearts have only a single ventricle. We are working with researchers who evaluate the flow efficiency of the rerouting surgery using fluid dynamics simulations. These researchers are using our free-form surface editor to aid understanding of the current blood vessel shape, and to edit the shape in hopes of finding a more efficient configuration.