Investigations into new multimedia and video modalities

自从爱迪生实验室发明了第一台摄像机（活动放映机）以来，社会已经在家庭电影、娱乐、教育和安全方面接受了摄像机。从使用相机制作家庭电影，到我们日常使用的电视，再到纯粹为了娱乐价值而制作的大片，视频在我们的日常生活中扮演着重要的角色。就在二十年前，我们很容易记得只有几个电视频道，而今天我们可以接触到来自世界各地的数百个电视台。这种过剩的视频信息在操作、管理、索引、浏览和搜索我们触手可及的大量视频数据方面带来了独特的问题和研究机会。然而，与超文本和万维网的出现不同，视频几乎没有交互性，从观看者的角度来看，它仍然是一种静态媒体。也就是说我们看视频；我们不和视频互动！本研究计划的核心目标是开发系统，使新一代基于计算机的电视（如高清电视和数字电视）发生根本性变化，使其成为一种互动媒体。通过对计算视频技术的持续研究和对视频数据的超媒体方法的新应用，预计研究结果将有助于使视频成为像今天的文本和万维网一样无处不在和易于访问的信息来源。这项研究代表了一种新的方式的开始，我们将通过它来体验视频。它将促进用户从仅仅是电视机或监视器上视频的静态观察者转变为系统的动态和互动部分，其中输入和反馈被应用于调整系统以满足当前用户的突发事件。

Since Edison Labs developed the first video camera (the Kinetograph), society has embraced video cameras through home movies, entertainment, education and security. From the use of cameras to create home movies, to our daily use of television, to blockbuster films created purely for entertainment value, video plays an important role in our every day life. Just two decades ago, we can easily remember having only a few television channels, whereas today we have access to hundreds of stations from around the world. This glut of video information introduces unique problems and research opportunities in the manipulation, management, indexing, browsing and searching of the volumes of video data we have at our finger tips.  However, unlike its textual counterpart since the advent of hypertext and the World Wide Web, there is little interactivity in video and it remains a static medium from the viewer standpoint.  This is to say we watch video; we do not interact with video! The core objective of this research program is to develop systems to enable radical changes in the new generations of computer based television (such as HDTV and digital television) so that it becomes an interactive medium.  Through continuing research into computational video techniques and the novel application of hyper-media methodologies to video data it is expected that the research results will help to make video become as ubiquitous and easy to access an information source as text and the World Wide Web is today.  This research represents the beginning of a new modality through which we will experience video. It will facilitate changing users from simply being static observers of video on a television set or monitor to being a dynamic and interactive part of a system where input and feedback is applied to adapt the system to meet current user whims.