I-Corps: Zero-UI: Translation of Purdue Gesture-based Creative Interaction Technologies into the Real World

在过去的30年里，使用计算机最初绘制2D图形和草图，然后设计3D形状，导致了深入的研究和过多的几何和图形设计工具。对过去工作的分析表明，应用程序受到以下因素的限制：(1)使用2D输入设备，如鼠标、键盘、触摸屏等；(2)以及将用户输入映射到计算过程的相应程序程序和用户界面的限制；以及(3)无法感知、感觉和与这些虚拟数据和形状交互。当前不自然的用户交互状态严重限制了形状的创造性表达和操作。它敦促我们开发新的人机交互形式，以释放心灵之眼的创造力。该团队的愿景是实现一种新的自然用户交互驱动的形状创建和操纵范例。该团队的方法将完全消除传统的用户界面，因为用户将能够使用手和身体直接与3D内容交互。这一愿景是基于我们最近的一系列发现，这些发现得益于NSF之前对基于自然草图的界面和形状分析的支持，这些支持为商业化奠定了基础。自然用户界面和交互的科学处于非常早期的发展阶段。使用窗口、图标、鼠标和指针的高度数字化的用户界面导致忽视了用户在与虚拟形状进行创造性交互中的作用。该团队的工作贡献并创造了用户与几何数据空间交互的新方式。我们将致力于的科学研究领域包括人机交互、机器学习、基于手势的交互和无处不在的计算。由3D传感摄像头实现的基于手势的自然用户界面(NUI)是计算、媒体和娱乐等垂直领域的下一个前沿。这项工作可以在教育和游戏设计、培训技术、残疾人触觉界面、互动广告、个人制造和许多其他尚未想象的应用方面产生新的能力。

During the last 30 years, use of computers to initially make 2D drawings and sketches, and then to design 3D shapes, have lead to deep research and plethora of geometric and graphic design tools. An analysis of past work reveals that applications are limited by (1) use of 2D input devices such as mouse, keyboard, touch screen, etc. (2) and the limitations of corresponding procedural programs and user interfaces that map user input to computational procedures, and (3) inability to sense, feel and interact with these virtual data and shapes. The current state of unnatural user interactions severely limits the creative expression and manipulation of shapes. It urges us to develop new forms of human machine interaction to unleash the creativity of the mind's eye. The team's vision is to enable a new class of natural user interaction driven shape creation and manipulation paradigms. The team's approach will completely eliminate traditional user interfaces since users will be able to directly interact with 3D content using hand and body. This vision is based on a recent set of our discoveries, enabled by prior NSF support on natural sketch-based interfaces and shape analysis that resulted in the foundation for commercialization.The science of natural user interfaces and interactions are at a very early stage of development. Highly-digitized user interfaces using windows, icons, mouse and pointer have resulted in overlooking the role of the user in creative interaction with virtual shapes. The team's work contributes and creates new ways in which users will interact with geometric data spaces. Areas of scientific inquiry we will contribute to include human-computer interaction, machine learning, gesture-based interaction, and ubiquitous computing. Gesture based natural user interfaces (NUI) enabled by 3D sensing cameras are the next frontier in computing, media and entertainment and other verticals. This work can result in new capabilities in edutainment and game design, training technologies, haptic interfaces for disabled, interactive advertising, personal manufacturing and many other applications not yet imagined.