Agile Views for Video Browsing: Advanced Surrogates, Control Mechanisms, and Usability

这是三年持续奖的第一年资助。该项目将为人们提供灵活的视图-轻松控制不同的表示-数字视频对象，通过提供与人们的体验相协调的多种索引，利用内容的功能，并且易于快速使用和更改。PI将指定这样的接口，创建原型实例化，并开发和应用程序来测试原型和规范的可用性。大多数关于数字视频系统的研究集中在特定对象的检索和一个或几个索引属性上。这个项目在三个方面是独一无二的。首先，它的目标是解决集合级别和项目级别的任务；因此，除了检索任务外，它还旨在帮助人们了解视频集合的结构，什么是可用的，什么是不可用的，以及哪些属性可能对检索有用。第二，它旨在为人们提供一系列替代品，并将这些替代品纳入一个有效和高效的界面；它旨在创造一种环境，在收集一级和单个物品一级提供多种替代品，并提供新的控制机制来管理这些替代品。第三，它的目标是使用这些替代品来评估用户在这些不同任务上的表现；评估浏览行为在任何介质中都是一项挑战，这项工作将建立在之前研究中开发的任务和指标的基础上，超越传统的指标来解决时间和效益之间的权衡。对于这个项目，视频对象将从开放视频存储库中提取。诸如关键帧(在幻灯片放映、故事板和素描中)、音频摘录和关键字的代理将被用作特定视频片段的基本表示，并且将是用户可通过各种交互机制操纵的。还将开发视频集合的其他替代品(如元数据的二维布局和协调的元数据列表)，并将在敏捷视图环境中调查其他视图，即历史(评论)、外围视图和共享视图。将反复评估Agile Views环境(其单独组件和完全集成的界面)的可用性，最后评估用户性能(对象和动作识别以及视频理解)、与观看紧凑率相关的权衡以及用户对界面的满意度。这些评估技术本身将通过提供评估交互式浏览的指标和技术来为研究和开发做出贡献。这项工作的最终目标是提供一个信息丰富的交互环境，使人们能够超越他们固有的视觉和音频能力来浏览视频内容和处理大量的视频信息。

This is the first year funding of a three year continuing award. This project will afford people agile views - effortless control over different representations - for digital video objects, by providing a multiplicity of indexes that are attuned to people's experiences, leverage the features of the content, and are easily and rapidly used and changed. The PI will specify such an interface, create prototype instantiations, and develop and apply procedures for testing the usability of the prototypes and specifications. Most research on digital video systems focuses on the retrieval of specific objects and on one or a few indexing attributes. This project is unique in three ways. First, it aims to address tasks at the collection level as well as at the item level; thus, in addition to the retrieval task, it aims to help people understand a video collection's structure, what is and is not available, and what attributes might be useful for retrieval purposes. Second, it aims to provide people with a range of surrogates and to integrate these into an effective and efficient interface; it aims to create an environment that provides multiple surrogates at the collection level as well as at the individual item level, and to provide novel control mechanisms to manage these alternatives. Third, it aims to assess user performance on these different tasks using these surrogates; evaluating browsing behavior is a challenge in any medium, and this work will build upon tasks and metrics developed in previous studies to go beyond traditional metrics to address time-benefit tradeoff measures. For this project, the video objects will be drawn from the Open Video Repository. Surrogates such as key-frames (in slide shows, storyboards, and skims), audio extracts, and keywords will be used as the basic representa-tions for specific video segments, and will be user-manipulable through a variety of interaction mechanisms. Additional surrogates (such as two-dimensional layouts of metadata and coordinated metadata lists) for collections of videos will also be developed, and additional views, i.e., histories (reviews), peripheral views, and shared views, will also be investigated within the agile views environment. The usability of the agile views environment (its individual components and the completely-integrated interface) will be evaluated iteratively, concluding with assessments of user performance (object and action recognition, and video comprehension), tradeoffs associated with viewing compaction rates, and user satisfaction with the interface. These evaluation techniques will themselves contribute to research and development by providing metrics and techniques for assessing interactive browsing. The ultimate goal of this work is to provide an information-rich and interactive environment that enables people to go beyond their innate visual and audio abilities to browse video content and process large volumes of video information.