The statistics of local motion signals in naturalistic movies.
The statistics of local motion signals in naturalistic movies.
复制标题
自然主义电影中局部运动信号的统计。
DOI：
10.1167/14.4.10
复制
发表时间：
2014
影响因子：
1.8
通讯作者：
Victor,JonathanD
中科院分区：
文献类型：
--
作者：
Nitzany,EyalI;Victor,JonathanD
翻译后摘要：摘要从视觉输入中提取运动在许多视觉任务中起着重要的作用，如分离的数字从地面和空间导航。基于数学和计算考虑（例如，基于亮度的时空相关性的运动和基于闪烁的时空相关性的运动）已经区分了几种局部运动信号，但是关于这些不同种类的信号在真实的世界中的流行知之甚少。为了解决这个问题，我们首先注意到，不同种类的局部运动信号（例如，傅立叶，非傅立叶，滑翔机）的特点是在倾斜的时空区域的二阶和高阶相关性。因此，可以通过测量这些相关性中的每一个在时空补丁中存在的程度以及它们在时空尺度上是否相干来估计自然场景中局部运动信号的流行。我们将这种技术应用于几部流行电影。结果表明，所有三种局部运动信号都存在于自然电影中。虽然在每部电影的过程中，不同种类的运动信号的平衡随片段而变化，但不同种类的运动及其子类型的普遍性的总体模式以及它们之间的相关性在电影中惊人地相似（但在白色噪声电影中不存在）。总之，自然主义电影包含了多样性的局部运动信号发生一致的患病率和模式的协变，表明其高阶时空图像统计的实质性规律。
Abstract:Abstract Extraction of motion from visual input plays an important role in many visual tasks, such as separation of figure from ground and navigation through space. Several kinds of local motion signals have been distinguished based on mathematical and computational considerations (eg, motion based on spatiotemporal correlation of luminance, and motion based on spatiotemporal correlation of flicker), but little is known about the prevalence of these different kinds of signals in the real world. To address this question, we first note that different kinds of local motion signals (eg, Fourier, non-Fourier, and glider) are characterized by second-and higher-order correlations in slanted spatiotemporal regions. The prevalence of local motion signals in natural scenes can thus be estimated by measuring the extent to which each of these correlations are present in space-time patches and whether they are coherent across spatiotemporal scales. We apply this technique to several popular movies. The results show that all three kinds of local motion signals are present in natural movies. While the balance of the different kinds of motion signals varies from segment to segment during the course of each movie, the overall pattern of prevalence of the different kinds of motion and their subtypes, and the correlations between them, is strikingly similar across movies (but is absent from white noise movies). In sum, naturalistic movies contain a diversity of local motion signals that occur with a consistent prevalence and pattern of covariation, indicating a substantial regularity of their high-order spatiotemporal image statistics.