SBIR Phase I: Direct 3D Manipulation for Computer Aided Design

这个小型企业创新研究(SBIR)第一阶段项目旨在展示用于计算机辅助设计(CAD)的3D手势用户输入系统的可行性，该系统使工程设计公司能够更快地探索和生产新设计。这项技术使用商用深度传感摄像头，并应用计算机视觉算法来提供无标记的手指精确手部跟踪，使用户只需伸手即可直接操纵虚拟3D对象。为了确认可行性，该项目的目标包括数据收集、计算机视觉算法调查、3D输入可用性问题调查以及彻底的技术和可用性评估。更具体地说，将收集手形和手势的3D扫描数据集。接下来，将详细研究用于快速校准和跟踪用户手的多视角配准和数据库驱动的手势估计算法。这项拟议技术的成功将关键取决于其提供的卓越用户体验，有关3D输入的可用性问题将被仔细分析。最后，将进行详细的技术和可用性评估，并将基于结果进行商业可行性评估。该项目更广泛的影响/商业潜力是在工程设计领域。在当今的市场环境中，工程公司的竞争力取决于其快速设计新产品和评估新工程解决方案的能力。大多数工程设计公司使用计算机辅助设计软件来加速这一过程。然而，CAD工程师的工作效率仍然受到他们可用的用户界面和用户输入设备的瓶颈。这是因为许多CAD任务涉及3D操作，而使用2D鼠标执行3D操作既困难又繁琐。一个典型的CAD用户每天花四到八个小时在CAD软件上。超过一百万的CAD用户符合这一特征。这项拟议的技术使这些用户能够在办公桌上徒手直接操作3D虚拟CAD对象，从而提高了工作效率-这是一项以前从未实现过的技术壮举。其结果是，包括制造业、建筑业和建筑业在内的多个行业的产品和工程设计速度更快，2011年这些行业在CAD软件上花费了60亿美元。这项研究将通过创造一种全新的与计算机交互的方式来促进对科学和技术的理解，以实现生产力应用。

This Small Business Innovation Research (SBIR) Phase I project aims to demonstrate the feasibility of a 3D gestural user input system for computer aided design (CAD) that enables engineering design firms to more rapidly explore and produce new designs. This technology uses commodity depth-sensing cameras and applies computer vision algorithms to deliver markerless finger-precise hand-tracking, allowing users to simply reach out with their hands to directly manipulate virtual 3D objects. In order to confirm feasibility, the objectives of the project include data gathering, investigation of computer vision algorithms, investigation of 3D input usability issues, and a thorough technical and usability evaluation. More specifically, a data set of 3D scans of hand shapes and hand poses will be collected. Next, a detailed investigation will be performed of multi-view registration and database-driven hand pose estimation algorithms for rapid calibration and tracking of a user's hands. The success of the proposed technology will crucially depend on its delivery of a superior user experience, and the usability issues regarding 3D input will be carefully analyzed. Finally, a detailed technical and usability evaluation will be performed, and the commercial viability will be based on the results.The broader impact/commercial potential of this project is in the area of engineering design. In today's market place, the competitive capacity of an engineering firm is determined by its ability to rapidly design new products and evaluate new engineering solutions. Most engineering design firms use computer aided design software to accelerate this process. However, the productivity of CAD engineers is still bottlenecked by the user interface and the user input devices available to them. This is because many CAD tasks involve 3D manipulation, which is difficult and tedious to perform with a 2D mouse. A typical CAD user spends four to eight hours a day in CAD software. Over a million CAD users fit this profile. The proposed technology makes these users more productive by enabling them to directly manipulate virtual CAD objects with their bare hands in 3D, at their desks---a technical feat that has never before been achieved. The result is faster product and engineering design in a variety of industries including manufacturing, construction and architecture which spent $6B on CAD software in 2011. This research will advance scientific and technological understanding by creating a fundamentally new way to interact with computers for productivity applications.