Ubiquitous virtual tools: Providing ad-hoc multitouch interaction on nearby surfaces

最近，使人们能够使用手指、手、手臂和全身与信息交互的研究原型和商业产品(例如，智能手机、平板电脑、视频游戏机)激增。口袋大小的手持投影仪最近也出现了，这使得人们周围的任何表面都有可能被改造成也可以感知触摸的数字显示器。 允许人们使用手指做出手势的相同技术通常要求信息在平坦、僵硬、干净的表面上进行控制。然而，我们的日常环境通常要凌乱得多。例如，在我们的环境中，桌子上通常摆满了纸、书、咖啡杯和其他文物。如果一个人要在这个烂摊子里和周围投射数字信息，还不清楚他们如何在这个环境中互动。我提议的研究探索一个人如何将附近的任何表面重新定位为数字交互触摸屏。首先，我将开发必要的硬件来构建系统的工作原型，这些系统可以在我们周围的任何地方显示和感知信息，以及访问这些信息的软件工具包。其次，我将设计、实现和评估交互技术，使人们能够在这些即席显示器上折叠、弯曲或以其他方式操作数字信息。第三，我将使用这项技术来研究人们在这些非平坦、杂乱的环境中对虚拟信息的感知，并使用这些研究的结果来改进这些交互技术的设计。 这个程序对不久的将来的计算至关重要。随着多点触控显示器在我们的日常环境中变得无处不在，一个关键问题将是如何使它们显示的信息具有互动性和意义。

There has been a recent surge in research prototypes and commercial products (e.g., smartphones, tablets, video game consoles) that enable people to interact with information using their fingers, hands, arms, and whole bodies. Pocket-sized handheld projectors have also recently become available, leading to the possibility that any surface in one's vicinity can be transformed into a digital display that can also sense touch. The same technologies that allow a person to use their fingers to make gestures typically require that the information be controlled on a flat, rigid, clean surface. However, our everyday environments are typically far messier. For example, tables in our environment are typically filled with paper, books, coffee mugs, and other artefacts. If a person were to project digital information within and around this mess, it is not clear how they could interact in this environment. My proposed research explores how a person can repurpose any nearby surface into a digital interactive touch display. First, I will develop the necessary hardware to build working prototypes of systems that display and sense information everywhere in our surroundings, and software toolkits for accessing this information. Second, I will design, implement, and evaluate interaction techniques that allow people to fold, bend, and otherwise manipulate digital information on these ad-hoc displays. Third, I will use this technology to perform studies about people's perception of the virtual information in these non-flat, messy environments, and use the results of these studies to inform improved designs of these interaction techniques. This program is critical to near-future computing. As multitouch displays become ubiquitous in our everyday environments, a key issue will be how to make the information they display interactive and meaningful.