Investigations into new multimedia and video modalities

自从爱迪生实验室开发了第一台摄像机(Kinetograph)以来，社会通过家庭电影、娱乐、教育和安全等领域拥抱了摄像机。从使用摄像机制作家庭电影，到我们日常使用电视，再到纯粹为了娱乐价值而制作的大片，视频在我们的日常生活中扮演着重要的角色。就在20年前，我们很容易记得只有几个电视频道，而今天我们可以从世界各地收看数百个电视台。这种过剩的视频信息在处理、管理、索引、浏览和搜索我们指尖掌握的海量视频数据方面带来了独特的问题和研究机会。然而，不同于自超文本和万维网出现以来的文本对应内容，视频中的互动性很少，从观众的角度来看，它仍然是一个静态的媒介。这就是说，我们看视频；我们不与视频互动！这项研究计划的核心目标是开发系统，使基于计算机的新一代电视(如HDTV和数字电视)发生根本性变化，使其成为一种交互媒体。通过对计算视频技术的持续研究和对视频数据的超媒体方法的新颖应用，预计研究成果将有助于使视频成为像文本和万维网一样无处不在、易于访问的信息源。这项研究代表着一种新的方式的开始，通过这种方式，我们将体验视频。它将有助于将用户从简单的电视机或监视器上的静态视频观察者转变为系统的动态和交互部分，其中应用输入和反馈来调整系统以满足当前用户的突发奇想。

Since Edison Labs developed the first video camera (the Kinetograph), society has embraced video cameras through home movies, entertainment, education and security. From the use of cameras to create home movies, to our daily use of television, to blockbuster films created purely for entertainment value, video plays an important role in our every day life. Just two decades ago, we can easily remember having only a few television channels, whereas today we have access to hundreds of stations from around the world. This glut of video information introduces unique problems and research opportunities in the manipulation, management, indexing, browsing and searching of the volumes of video data we have at our finger tips.  However, unlike its textual counterpart since the advent of hypertext and the World Wide Web, there is little interactivity in video and it remains a static medium from the viewer standpoint.  This is to say we watch video; we do not interact with video! The core objective of this research program is to develop systems to enable radical changes in the new generations of computer based television (such as HDTV and digital television) so that it becomes an interactive medium.  Through continuing research into computational video techniques and the novel application of hyper-media methodologies to video data it is expected that the research results will help to make video become as ubiquitous and easy to access an information source as text and the World Wide Web is today.  This research represents the beginning of a new modality through which we will experience video. It will facilitate changing users from simply being static observers of video on a television set or monitor to being a dynamic and interactive part of a system where input and feedback is applied to adapt the system to meet current user whims.