IDInteraction: Capturing Indicative Usage Models in Software for Implicit Device Interaction

IDInteraction项目提出的问题是：我们能否利用人类行为模型，从直接、明确的用户命令转向无缝的用户与设备交互？它将调查和开发捕捉“指示性使用模式”（IUMs）、特定活动之前的行为模式或线索的技术，并将其转化为基于软件的“指示性使用模式”（IUPs），以驱动与应用程序的交互。该项目将重点关注未来的电视广播，检查从设备传感器和事件数据中捕获IUMs的可能性。并将其部署为IUPs，将内容（额外信息或相关活动）拉到“第二屏幕配套应用程序”中，观众可以在移动设备上观看电视节目。这项研究的核心——调查我们能在多大程度上预测用户的命令和请求——将在塑造我们使用未来技术的方式方面发挥重要作用。物联网正在迅速成为现实，但与之交互的适当范例远未被理解。连接设备数量的快速增长意味着人们必须成功使用的技术类型可能会大量增加。虽然一个人可能准备学习如何使用新的家庭自动化系统或汽车，但期望他或她对每台机器都这样做是不现实的。我们已经开始明白，考虑到人类基本感知和思维过程的互动体验比那些需要用户大量学习的互动体验更成功。隐式设备交互是下一个步骤，即设备在发出命令之前自动知道用户想要什么。所调查的场景——第二次屏幕观看——也特别及时。广播公司热衷于开发人们用移动设备看电视的创新潜力，尤其是因为它将在未来几年成为电视观看的主要形式。然而，目前，这种情况还没有得到很好的理解：虽然一些研究集中在这种情况的社会方面，但很少有人研究第二屏幕互动的感知或行为方面。当前的配套应用程序是为了补充主程序而设计的，它们在特定的时间点向移动设备推送信息，而这种发生在辅助屏幕上的变化（发生在外围视觉上）可能会分散注意力。信息流根据观看者注意力的位置直观地停止和开始的情况是一个非常理想的目标。IDInteraction是一个雄心勃勃的研究项目，研究人类行为的一个方面，这对隐式用户界面的未来发展至关重要，并计划从端到端解决这个问题。通过研究研究问题的一部分，从行为建模到测试一个新的用户界面，它将提供一个理论和技术挑战的概述，无缝用户设备交互的发展将需要，并标记关键领域进一步调查。从有效软件开发的角度来看，项目需要相当程度的风险：ums可能难以捕获和部署，并且无缝的信息提供可能在此上下文中难以实现。然而，从建筑理论的角度来看，这些结果仍然具有重要的价值。提高我们对隐式交互限制的理解对于推动这一重要的新兴领域的发展至关重要。

The IDInteraction project asks: can we exploit models of human behaviour to move away from direct, unambiguous user commands, towards seamless user-device interaction? It will investigate and develop the techniques to capture 'Indicative Usage Models (IUMs), behavioural patterns or cues that precede a particular activity, and translate these into software-based 'Indicative Usage Patterns' (IUPs), to drive interaction with an app. The project will focus on future television broadcasting, examining the extent to which it is possible to capture IUMs from device sensor and event data, and deploy these as IUPs to pull content (additional information or related activities) to a 'second screen companion app', which a viewer watches on a mobile device alongside a TV programme.The core of the research - investigating the extent to which we can anticipate user commands and requests - will play an important role in shaping the way we use future technology. The Internet of Things is fast becoming a reality, but the appropriate paradigms for interacting with it are far from understood. A rapidly growing number of connected devices means a potentially vast increase in the types of technology which people must use successfully. Whilst a person may be prepared to learn how to use a new home automation system or car, expecting him or her to do this for every machine with which there is a cursory encounter is unrealistic. We have already started to understand that interactive experiences which take fundamental human perception and thought processes into account are more successful than those which require significant learning on the part of the user. Implicit Device Interaction, where devices automatically know what the user wants, before a command is issued, is the next step.The scenario investigated - second screen viewing - is also particularly timely. Broadcasters are keen to exploit the creative potential of a context where people are watching television with a mobile device, not least because it is set to become the principle form of TV viewing in the next few years. At present, however, the scenario is not well understood: whilst some research has focused on social aspects of this situation, very little has examined the perceptual or behavioural aspects of second screen interaction. Current companion apps, designed to complement the main programme, push information to the mobile device at given points in time, and this change on the secondary screen, which occurs in peripheral vision, is potentially distracting. A situation where information flow intuitively stops and starts according to the location of the viewer's attention is a highly desirable goal.IDInteraction is an ambitious research project, investigating an aspect of human behaviour that is crucial to the future development of implicit user interfaces, and has been planned to tackle the problem from end-to-end. By studying a slice of the research problem, from modelling behaviour to testing a new user interface, it will provide an overview of the theoretical and technical challenges that the development of seamless user-device interaction will entail, and flag key areas for further investigation. From the perspective of effective software development, the project entails a considerable degree of risk: IUMs may be difficult to capture and deploy, and seamless information provision may be challenging to implement in this context. From the perspective of building theory in this area, such results would still have significant value, however. Improving our understanding of the limits of implicit interaction is crucial to moving this important, emergent, field forward.