Time Information for Multimedia Processing and Analysis

点击翻译按钮获取中文摘要

The amount of multimedia data available digitally is growing daily at an astounding rate. One of the main challenges in multimedia research is to develop algorithms to extract information from these vast collections of multimedia signals and provide more effective tools for interacting with them. Using a variety of techniques from digital signal processing and machine learning it is now possible to analyze millions of images, videos and songs. Another recent trend is the use of rich expressive ways of interacting with computers moving beyond the traditional screen/keyboard/mouse paradigm. These include gestures on touchscreens as well as full body tracking interfaces based on a variety of sensors such as accelerometers, microphone arrays and depth cameras using structured light. There are few examples of work that combine large scale analysis of multimedia archives controlled by rich multi-modal input. Interactive music performances that combine sensors, actuators, computers and humans are one of the few areas where such synergies are taking place.