Agile Views for Video Browsing: Advanced Surrogates, Control Mechanisms, and Usability

这是一个为期三年的连续奖励的第一年资助。 该项目将为数字视频对象提供灵活的视图-轻松控制不同的表示-通过提供适应人们体验的多种索引，利用内容的功能，并且易于快速使用和更改。 PI将指定这样一个接口，创建原型实例，并开发和应用程序来测试原型和规范的可用性。 大多数数字视频系统的研究集中在特定对象的检索和一个或几个索引属性。 这个项目在三个方面是独一无二的。 首先，它的目的是在集合级别以及在项目级别的任务，因此，除了检索任务，它的目的是帮助人们了解视频集合的结构，什么是可用的，什么是不可用的，什么属性可能是有用的检索目的。 第二，它的目的是为人们提供一系列的代理人，并将这些集成到一个有效的和高效的界面;它的目的是创造一个环境，提供多个代理人在集合级别以及在个别项目的水平，并提供新的控制机制来管理这些替代品。 第三，它的目的是使用这些代理人来评估用户在这些不同任务上的表现;评估浏览行为在任何媒体上都是一个挑战，这项工作将建立在以前研究中开发的任务和指标的基础上，超越传统的指标，以解决时间效益权衡措施。 对于这个项目，视频对象将从开放视频库中提取。 诸如关键帧（在幻灯片、故事板和略读中）、音频摘录和关键字等替代物将用作特定视频片段的基本表示，并且将通过各种交互机制由用户操纵。 还将开发视频集合的其他替代物（如元数据的二维布局和协调元数据列表），以及其他视图，即，历史（回顾）、外围视图和共享视图也将在敏捷视图环境中进行研究。 敏捷视图环境（其各个组件和完全集成的界面）的可用性将被反复评估，最后评估用户性能（对象和动作识别，以及视频理解），与查看压缩率相关的权衡，以及用户对界面的满意度。 这些评价技术本身将有助于研究和发展，提供评估交互式浏览的指标和技术。 这项工作的最终目标是提供一个信息丰富的交互式环境，使人们能够超越其固有的视觉和听觉能力，浏览视频内容和处理大量的视频信息。

This is the first year funding of a three year continuing award. This project will afford people agile views - effortless control over different representations - for digital video objects, by providing a multiplicity of indexes that are attuned to people's experiences, leverage the features of the content, and are easily and rapidly used and changed. The PI will specify such an interface, create prototype instantiations, and develop and apply procedures for testing the usability of the prototypes and specifications. Most research on digital video systems focuses on the retrieval of specific objects and on one or a few indexing attributes. This project is unique in three ways. First, it aims to address tasks at the collection level as well as at the item level; thus, in addition to the retrieval task, it aims to help people understand a video collection's structure, what is and is not available, and what attributes might be useful for retrieval purposes. Second, it aims to provide people with a range of surrogates and to integrate these into an effective and efficient interface; it aims to create an environment that provides multiple surrogates at the collection level as well as at the individual item level, and to provide novel control mechanisms to manage these alternatives. Third, it aims to assess user performance on these different tasks using these surrogates; evaluating browsing behavior is a challenge in any medium, and this work will build upon tasks and metrics developed in previous studies to go beyond traditional metrics to address time-benefit tradeoff measures. For this project, the video objects will be drawn from the Open Video Repository. Surrogates such as key-frames (in slide shows, storyboards, and skims), audio extracts, and keywords will be used as the basic representa-tions for specific video segments, and will be user-manipulable through a variety of interaction mechanisms. Additional surrogates (such as two-dimensional layouts of metadata and coordinated metadata lists) for collections of videos will also be developed, and additional views, i.e., histories (reviews), peripheral views, and shared views, will also be investigated within the agile views environment. The usability of the agile views environment (its individual components and the completely-integrated interface) will be evaluated iteratively, concluding with assessments of user performance (object and action recognition, and video comprehension), tradeoffs associated with viewing compaction rates, and user satisfaction with the interface. These evaluation techniques will themselves contribute to research and development by providing metrics and techniques for assessing interactive browsing. The ultimate goal of this work is to provide an information-rich and interactive environment that enables people to go beyond their innate visual and audio abilities to browse video content and process large volumes of video information.