Cinematic Visual Discourse: Representation, Generation, and Evaluation
Cinematic Visual Discourse: Representation, Generation, and Evaluation
复制标题
DOI：
10.1109/tciaig.2010.2046486
复制
发表时间：
2010-06-01
影响因子：
--
通讯作者：
Young, R. Michael
中科院分区：
文献类型：
--
作者：
Jhala, Arnav;Young, R. Michael
在本文中，我们介绍了一个端到端摄像机规划系统Darshak的设计、实现和评估。Darshak在3-D虚拟环境中自动构建给定故事的电影叙事话语。它利用分层偏序因果链接(POCL)规划算法来生成叙事计划，其中包含故事事件和拍摄这些事件的相机指令。剧情模式通常被虚构叙事的作者使用，被形式化为交流计划运算符，为构建故事可视化的电影内容提供了基础。戏剧性的模式是通过抽象的交流操作符来实现的，这些操作符代表了观众对故事及其讲述的信念的操作。在这个基于计划的框架中，相机镜头合成和过渡被定义为执行基元。Darshak的表现是通过一项新的用户研究来评估的，该研究基于评估现有叙事理解认知模型的技术。初步研究发现，视觉化策略的选择对被测观众的理解能力有显著影响。进一步说明了Darshak对视觉化策略的选择对理解的显著影响。
In this paper, we present the design, implementation, and evaluation of an end-to-end camera planning system called Darshak. Darshak automatically constructs cinematic narrative discourse of a given story in a 3-D virtual environment. It utilizes a hierarchical partial-order causal link (POCL) planning algorithm to generate narrative plans that contain story events and camera directives for filming them. Dramatic situation patterns, commonly used by writers of fictional narratives, are formalized as communicative plan operators that provide a basis for structuring the cinematic content of the story's visualization. The dramatic patterns are realized through abstract communicative operators that represent operations on a viewer's beliefs about the story and its telling. Camera shot compositions and transitions are defined in this plan-based framework as execution primitives. Darshak's performance is evaluated through a novel user study based on techniques used to evaluate existing cognitive models of narrative comprehension. Initial study reveals significant effect of the choice of visualization strategies on measured viewer comprehension. It further shows significant effect of Darshak's choice of visualization strategy on comprehension.