Creation and Evaluation of Novel Media Experiences

新颖媒体体验的创造和评估

• 批准号: RGPIN-2015-04971
• 负责人: Fels, Sidney
• 金额: $ 3.64万
• 依托单位: University of British Columbia
• 依托单位国家: 加拿大
• 项目类别: Discovery Grants Program - Individual
• 财政年份: 2018
• 资助国家: 加拿大
• 起止时间: 2018-01-01 至 2019-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=650582
• 关键词: Creation; Evaluation; Novel; Media; Experiences

This proposal has two threads investigating novel means of leveraging human perceptive and cognitive abilities to create and evaluate next generation media experiences. Two media experiences will be investigated: a novel 3D display and interactive video in an educational context. ***For the first thread, I plan to advance the state of the art of 3D perspective-corrected spherical (3DPS) displays. Touch and gesture input, high-resolution, and multi-person functionality will be added to a spherical, 3D display targeting two aspects of behaviour in 3D: interaction and collaboration. Having high-resolution using multiple projectors with low-latency feedback and fast refresh rate, enables the sensation of an object being physically in the sphere. With this phenomenon, along with gesture and touch interaction on and around the spherical display, the potential for high-fidelity, collaborative 3D interaction can be explored. Leveraging off existing work on interaction with volumetric, cylindrical and cubic displays, new interaction semantics for pointing, selecting, translating, rotating, and sculpting content will be explored. As the display supports multiplexed video, novel co-located and remote collaborative, 3D interaction semantics will be created and evaluated.****The second thread advances the state of interactive video (IV) authoring, navigation and sharing in educational environments. The main insight pursued matches interface design for spatio-temporal video content with peoples' cognitive and affective mechanisms, as and applies it to educational video contexts. Current video players target mostly linear viewing of relatively long video content leading to poor mechanisms for organizing partially viewed video or salient content. However, with online video content becoming ubiquitous and shorter, consumption has become more non-linear and the amount of video viewing has increased by at least an order of magnitude. Finding particular videos, or salient content within videos are significant challenges, especially as existing mechanisms tend to be geared towards semantic memory rather than episodic. Furthermore, user generated content suffers from a model that separates authoring from viewing and sharing, impeding video content creation by non-experts, such as educators and learners. Exploring additional mechanisms, such as affective, temporal and spatial cueing will address this challenge. **

该提案有两个主题，研究利用人类感知和认知能力来创建和评估下一代媒体体验的新方法。我们将研究两种媒体体验：新颖的 3D 显示和教育背景下的交互式视频。 ***对于第一个线程，我计划推进 3D 透视校正球面 (3DPS) 显示器的技术水平。触摸和手势输入、高分辨率和多人功能将被添加到球形 3D 显示器中，针对 3D 行为的两个方面：交互和协作。使用具有低延迟反馈和快速刷新率的多台投影仪获得高分辨率，可以实现物体物理上位于球体中的感觉。通过这种现象，再加上球形显示器上及其周围的手势和触摸交互，可以探索高保真、协作 3D 交互的潜力。利用与体积、圆柱形和立方体显示器交互的现有工作，将探索用于指向、选择、平移、旋转和雕刻内容的新交互语义。由于显示器支持多路复用视频、新颖的共置和远程协作，因此将创建和评估 3D 交互语义。****第二个线程推进了教育环境中交互式视频 (IV) 创作、导航和共享的状态。所追求的主要见解是将时空视频内容的界面设计与人们的认知和情感机制相匹配，并将其应用于教育视频环境。当前的视频播放器主要针对相对较长的视频内容的线性观看，导致组织部分观看的视频或显着内容的机制较差。然而，随着在线视频内容变得无处不在且篇幅较短，消费变得更加非线性，视频观看量至少增加了一个数量级。查找特定视频或视频中的显着内容是一项重大挑战，特别是当现有机制倾向于语义记忆而不是情景记忆时。 此外，用户生成的内容受到将创作与观看和共享分开的模型的影响，阻碍了非专家（例如教育工作者和学习者）的视频内容创建。探索情感、时间和空间暗示等其他机制将解决这一挑战。 **