Inferring user intention in stylus input systems

推断手写笔输入系统中的用户意图

• 批准号: 327527-2006
• 负责人: Lank, Edward
• 金额: $ 1.6万
• 依托单位: University of Waterloo
• 依托单位国家: 加拿大
• 项目类别: Discovery Grants Program - Individual
• 财政年份: 2006
• 资助国家: 加拿大
• 起止时间: 2006-01-01 至 2007-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=337897
• 关键词: Inferring; user; intention; stylus; input

The personal computing revolution of the past two decades has moved to a new phase where the keyboard-mouse interface no longer dominates humans' interactions with computers.  While the long-term future may involve conversational interfaces, retinal projection, and computer vision recognition of hand gestures, the hardware technology currently being adopted most rapidly is directed toward pen or stylus input, on both bibliographic surfaces (i.e. personal-sized, normally horizontal, e.g. PDAs, Tablet PCs) and epigraphic surfaces (i.e. shared, normally vertical, e.g. SMARTBoard, iRoom). One attractive aspect of stylus-based interaction is the fluidity of interaction it appears to promise. Interactions between a pen and a computer application can include data input, annotations, free-hand drawings, the selection of content, and the interaction with user interface objects such as menus and buttons.  Users, using a stylus-based entry device such as a tablet computer, want an interaction experience that moves fluidly between these operations.  Pen-tablet computers, however, have typically not delivered the fluidity of interaction expected by users. These programs require frequent mode switches when switching tasks, and result in slow, pedantic input for all but the simplest of tasks. This research seeks to add intelligence to the activities performed by a stylus-based computer system when capturing and analyzing the actions of the user.  To do this, this research aims to build models of both the content created by the user with a pen and current actions performed by the user with the pen.  Given these models, the research aims to then develop computer programs that analyze these current actions in context to reason about the intention of the user when performing actions in interfaces.  The end result will be tablet interfaces in which users move fluidly though actions in the application interface. Onus is placed on the software application to understand users' goals, rather than on the user to understand the software application.

过去二十年的个人电脑革命已经进入了一个新的阶段，键盘-鼠标界面不再主导人类与计算机的交互。虽然长期的未来可能涉及会话界面，视网膜投影和手势的计算机视觉识别，但目前最迅速采用的硬件技术是指向笔或手写笔输入，在书目表面（即个人尺寸，通常水平，例如PDA，Tablet PC）和金石表面（即共享，通常垂直，例如SMARTBoard，iRoom）上。基于手写笔的交互的一个吸引人的方面是它似乎承诺的交互的流动性。笔和计算机应用程序之间的交互可以包括数据输入、注释、手绘、内容选择以及与诸如菜单和按钮之类的用户界面对象的交互。使用诸如平板计算机之类的基于触笔的输入设备的用户想要在这些操作之间流畅地移动的交互体验。通常不能提供用户所期望的交互的流动性。这些程序在切换任务时需要频繁的模式切换，结果除了最简单的任务外，所有任务的输入都很慢，很迂腐。本研究旨在为基于手写笔的计算机系统在捕获和分析用户动作时执行的活动添加智能。为此，本研究旨在构建用户用笔创建的内容和用户用笔执行的当前动作的模型。鉴于这些模型，该研究的目的是开发计算机程序，分析这些当前的行为，在界面上执行行为时推理用户的意图，最终的结果将是用户在其中移动的平板电脑界面流畅地通过应用程序界面中的操作。软件应用程序有责任理解用户的目标，而不是让用户理解软件应用程序。