Inferring user intention in stylus input systems

过去二十年的个人电脑革命已经进入了一个新阶段，键盘-鼠标界面不再主导人类与电脑的互动。虽然从长远来看，未来可能会涉及对话界面、视网膜投影和手势的计算机视觉识别，但目前被采用最快的硬件技术是针对笔或手写笔输入的，包括书目界面（如个人尺寸的、通常是水平的，如pda、平板电脑）和文字界面（即共享的、通常是垂直的，如SMARTBoard、iRoom）。触控笔交互的一个吸引人的方面是它所承诺的交互的流动性。笔和计算机应用程序之间的交互可以包括数据输入、注释、手绘、内容选择以及与用户界面对象（如菜单和按钮）的交互。使用触控笔输入设备（如平板电脑）的用户希望获得在这些操作之间流畅移动的交互体验。然而，手写平板电脑通常无法提供用户所期望的流畅交互。这些程序在切换任务时需要频繁地切换模式，导致除了最简单的任务外，所有任务的输入都缓慢而迂腐。这项研究的目的是在捕捉和分析用户的行为时，为基于触控笔的计算机系统所执行的活动增加智能。为此，本研究旨在建立用户用笔创建的内容和用户用笔执行的当前操作的模型。有了这些模型，该研究的目的是开发计算机程序，在上下文中分析这些当前行为，以推断用户在界面中执行操作时的意图。最终的结果将是，在平板电脑界面中，用户可以通过应用程序界面中的操作流畅地移动。软件应用程序有责任理解用户的目标，而不是用户有责任理解软件应用程序。

The personal computing revolution of the past two decades has moved to a new phase where the keyboard-mouse interface no longer dominates humans' interactions with computers.  While the long-term future may involve conversational interfaces, retinal projection, and computer vision recognition of hand gestures, the hardware technology currently being adopted most rapidly is directed toward pen or stylus input, on both bibliographic surfaces (i.e. personal-sized, normally horizontal, e.g. PDAs, Tablet PCs) and epigraphic surfaces (i.e. shared, normally vertical, e.g. SMARTBoard, iRoom). One attractive aspect of stylus-based interaction is the fluidity of interaction it appears to promise. Interactions between a pen and a computer application can include data input, annotations, free-hand drawings, the selection of content, and the interaction with user interface objects such as menus and buttons.  Users, using a stylus-based entry device such as a tablet computer, want an interaction experience that moves fluidly between these operations.  Pen-tablet computers, however, have typically not delivered the fluidity of interaction expected by users. These programs require frequent mode switches when switching tasks, and result in slow, pedantic input for all but the simplest of tasks. This research seeks to add intelligence to the activities performed by a stylus-based computer system when capturing and analyzing the actions of the user.  To do this, this research aims to build models of both the content created by the user with a pen and current actions performed by the user with the pen.  Given these models, the research aims to then develop computer programs that analyze these current actions in context to reason about the intention of the user when performing actions in interfaces.  The end result will be tablet interfaces in which users move fluidly though actions in the application interface. Onus is placed on the software application to understand users' goals, rather than on the user to understand the software application.