Inferring user intention in stylus input systems

过去二十年的个人计算机革命已经进入了一个新的阶段，键盘鼠标界面不再主导人类与计算机的交互。 虽然长远的未来可能涉及会话界面，视网膜投影和手势的计算机视觉识别，但目前采用最快的硬件技术是针对笔或手写笔输入，在书目表面（即个人大小，通常水平，例如PDA，Tablet PC）和epigraphic表面（即共享，通常垂直，例如SMARTBoard，iRoom）上。基于手写笔的交互的一个吸引人的方面是它似乎承诺的交互的流动性。笔和计算机应用程序之间的交互可以包括数据输入、注释、手绘、内容选择以及与用户界面对象（如菜单和按钮）的交互。 使用诸如平板计算机之类的基于触笔的输入设备的用户想要在这些操作之间流畅地移动的交互体验。 然而，手写板计算机通常没有提供用户所期望的交互的流动性。这些程序在切换任务时需要频繁的模式切换，结果除了最简单的任务外，所有任务的输入都很慢，很迂腐。这项研究旨在增加智能的活动时，基于手写笔的计算机系统捕获和分析用户的行动。 要做到这一点，本研究的目的是建立模型的内容创建的用户与笔和当前的行动由用户与笔。 考虑到这些模型，研究的目的是开发计算机程序，分析这些当前的行动在上下文中的原因，用户的意图时，在界面上执行的动作。 最终的结果将是平板电脑界面，用户可以在应用程序界面中流畅地移动。软件应用程序有责任理解用户的目标，而不是让用户理解软件应用程序。

The personal computing revolution of the past two decades has moved to a new phase where the keyboard-mouse interface no longer dominates humans' interactions with computers.  While the long-term future may involve conversational interfaces, retinal projection, and computer vision recognition of hand gestures, the hardware technology currently being adopted most rapidly is directed toward pen or stylus input, on both bibliographic surfaces (i.e. personal-sized, normally horizontal, e.g. PDAs, Tablet PCs) and epigraphic surfaces (i.e. shared, normally vertical, e.g. SMARTBoard, iRoom). One attractive aspect of stylus-based interaction is the fluidity of interaction it appears to promise. Interactions between a pen and a computer application can include data input, annotations, free-hand drawings, the selection of content, and the interaction with user interface objects such as menus and buttons.  Users, using a stylus-based entry device such as a tablet computer, want an interaction experience that moves fluidly between these operations.  Pen-tablet computers, however, have typically not delivered the fluidity of interaction expected by users. These programs require frequent mode switches when switching tasks, and result in slow, pedantic input for all but the simplest of tasks. This research seeks to add intelligence to the activities performed by a stylus-based computer system when capturing and analyzing the actions of the user.  To do this, this research aims to build models of both the content created by the user with a pen and current actions performed by the user with the pen.  Given these models, the research aims to then develop computer programs that analyze these current actions in context to reason about the intention of the user when performing actions in interfaces.  The end result will be tablet interfaces in which users move fluidly though actions in the application interface. Onus is placed on the software application to understand users' goals, rather than on the user to understand the software application.