Creation and Evaluation of Novel Media Experiences

点击翻译按钮获取中文摘要

This proposal has two threads investigating novel means of leveraging human perceptive and cognitive abilities to create and evaluate next generation media experiences. Two media experiences will be investigated: a novel 3D display and interactive video in an educational context. For the first thread, I plan to advance the state of the art of 3D perspective-corrected spherical (3DPS) displays. Touch and gesture input, high-resolution, and multi-person functionality will be added to a spherical, 3D display targeting two aspects of behaviour in 3D: interaction and collaboration. Having high-resolution using multiple projectors with low-latency feedback and fast refresh rate, enables the sensation of an object being physically in the sphere. With this phenomenon, along with gesture and touch interaction on and around the spherical display, the potential for high-fidelity, collaborative 3D interaction can be explored. Leveraging off existing work on interaction with volumetric, cylindrical and cubic displays, new interaction semantics for pointing, selecting, translating, rotating, and sculpting content will be explored. As the display supports multiplexed video, novel co-located and remote collaborative, 3D interaction semantics will be created and evaluated. The second thread advances the state of interactive video (IV) authoring, navigation and sharing in educational environments. The main insight pursued matches interface design for spatio-temporal video content with peoples’ cognitive and affective mechanisms, as and applies it to educational video contexts. Current video players target mostly linear viewing of relatively long video content leading to poor mechanisms for organizing partially viewed video or salient content. However, with online video content becoming ubiquitous and shorter, consumption has become more non-linear and the amount of video viewing has increased by at least an order of magnitude. Finding particular videos, or salient content within videos are significant challenges, especially as existing mechanisms tend to be geared towards semantic memory rather than episodic. Furthermore, user generated content suffers from a model that separates authoring from viewing and sharing, impeding video content creation by non-experts, such as educators and learners. Exploring additional mechanisms, such as affective, temporal and spatial cueing will address this challenge.