Highly interactive 3D user interfaces

该提案涉及设计和理解自由曲面的新技术的研究和发展。自由曲面的例子包括汽车车身、船体和电子游戏中的奇形怪状生物。提出的工作旨在通过使用手持式3D位置和方向跟踪器来改进自由曲面的设计和理解。在MeshSculptor，我们的实验性自由格式编辑器，实时图形系统不断地动画编辑表面，因为用户坐在屏幕前使用两个3D跟踪器操纵表面。每只手都扮演着不同的角色，优势手负责挑选和操作，而不太优势的手负责各种环境设置。采用以用户为中心的设计方法，我们计划开发新的双手技术来设计表面，并使用在表面上渲染的专门纹理来显示表面属性。我们的表面编辑方法是使用3D跟踪器扭曲表面的高亮部分，该项目旨在开发功能强大且易于使用的新扭曲操作器。我们还计划开发一个新的经线抽象，允许经线在完成后重新制作和调整。我们计划将这项工作应用于儿科心脏手术计划领域。在这个领域，外科医生为只有一个心室的病人改变血液流动的路线。我们正在与研究人员合作，利用流体动力学模拟来评估改道手术的流动效率。这些研究人员正在使用我们的自由形状表面编辑器来帮助理解当前的血管形状，并编辑形状，希望找到更有效的配置。

This proposal concerns the research and development of new techniques for the design and understanding of free-form surfaces. Examples of free-form surfaces include car bodies, ship hulls, and fanciful creatures in video games. The proposed work is aims to improve the design and understanding of free-form surfaces through the use of hand-held 3D position and orientation trackers. In MeshSculptor, our experimental free-form editor, a real-time graphics system continuously animates the edited surface as the user sits in front of the screen manipulating the surface using the two 3D trackers. Each hand has a distinct role to play, with the dominant hand being responsible for picking and manipulation, and the less-dominant hand being responsible for context setting of various kinds. Employing a user-centered design approach, we plan to develop new two-handed techniques for designing surfaces and for displaying surface properties using specialized textures rendered on the surface. Our approach to surface editing is to warp the highlighted part of the surface using the 3D trackers, and this project seeks to develop new warp operators that are powerful and easy to use. We also plan to develop a new abstraction for warps that will allow warps to be re-done and adjusted after they have been completed. We plan to apply this work to the domain of pediatric cardiac surgery planning. In this domain, surgeons reroute blood flow in patients whose hearts have only a single ventricle. We are working with researchers who evaluate the flow efficiency of the rerouting surgery using fluid dynamics simulations. These researchers are using our free-form surface editor to aid understanding of the current blood vessel shape, and to edit the shape in hopes of finding a more efficient configuration.