Mobile Mid-Air Interactive Systems and Design Workflows for Creative 3D Shape Modeling

目前，用于产品设计和制造的3D建模工具是训练有素的工程师和专业艺术家的权限。每个人都有想法，但只有少数人能把它们变成现实。虽然触摸设备，如平板电脑和智能手机无处不在，直接操作的内容本质上是二维的，而今天常用的工具过多的设计隐喻基于窗口，图标，菜单和指针。它们需要大量的训练，并且抑制了用户以简单的方式创建、操纵和修改虚拟形状的能力。对空中互动的研究表明，我们的身体和它们在世界上的感知引导运动完成了实现我们创造性目标所需的大部分工作。这种感知过程，如果仔细集成到3D建模中，可以有助于消除普通用户的障碍，使他们的创造性想法具体化。 这项工作旨在利用空中移动的交互的潜力，以满足设计中涉及的创造性过程。在这样做的过程中，它向计算机作为合作伙伴的范式迈出了重要的一步，通过手持移动的设备将我们的认知转移到虚拟环境中。将各种传感器集成到智能手机中，为设计交互过程提供了新的启示，从而实现了创造性的动态形状建模过程。然而，现有的移动的交互的研究集中在3D对象操纵，虚拟场景导航，和科学可视化。这项工作将开发一个框架，直接三维形状概念化使用移动的互动。为此，这项工作将利用智能手机作为我们身心延伸的独特优势，在空间上创建2D和3D草图，并创建，操作和修改虚拟3D对象。随后的简单空间交互，简单，直接的形状建模操作将把我们的身体运动和手机的旋转以及设备上的上下文草图转换为所需的配置和几何形状。通过结合多点触摸交互和设备传感器，这项工作旨在利用对空间交互的具身认知，开发空间控制的新隐喻，并开发形状建模的过程，以探索直观交互的新设计空间。这将通过开发受约束和自由形式的3D形状，3D对象的空间配置以及具有形状的创意3D组合的流程来实现。这些开发周期将由严格的用户评估和迭代驱动，以获得设计流程和用户体验的指导方针。

Currently 3D modeling tools for product design and manufacturing are the purview of trained engineers and professional artists. Everyone has ideas but only a select few can bring them to reality. Although touch enabled devices such as tablets and smartphones are ubiquitous, the direct manipulation of content is inherently two-dimensional, and the plethora of tools commonly used today grew out of design metaphors based on windows, icons, menus, and pointers. They require extensive training, and inhibit the user's ability to create, manipulate, and modify virtual shapes in a straightforward manner. Research on mid-air interactions has shown that our bodies and their perceptually guided motions through the world do much of the work required to achieve our creative goals. This perceptual process, if carefully integrated into 3D modeling, can be instrumental in eliminating the barrier-to-entry for common users motivated to externalize their creative ideas. This work aims at harnessing the potential of mobile interactions in mid-air to cater to the creative processes involved in design. In doing so, it takes an important step towards the computer-as-a-partner paradigm that transfers our cognition to the virtual environment through hand-held mobile devices.The integration of a variety of sensors into smartphones provides new affordances for designing interactive processes towards creative on-the-fly shape modeling processes. However, existing research on mobile interactions has focused on 3D object manipulation, virtual scene navigation, and scientific visualization. The work will develop a framework for direct 3D shape conceptualization using mobile interactions. To do so, this work will leverage the unique advantage of using smartphones as an extension to our mind and body, to spatially create 2D and 3D sketches, and create, manipulate and modify virtual 3D objects. The ensuing simplicity of spatial interactions for easy, direct shape-modeling operations will transform our bodily motions and rotations of the phone and contextual sketches on the devices to desired configurations and geometries. By combining multi-touch interactions and device sensors, the work aims to leverage embodied cognition towards spatial interaction and develop new metaphors for spatial control, and develop processes for shape modeling to explore a new design space of intuitive interactions. This will be achieved by developing process flows for constrained and free-form 3D shapes, spatial configuration of 3D objects, and creative 3D compositions with shapes. These development cycles will be driven by rigorous user evaluations and iterations to derive the guidelines for design process flow and user experiences.