MoSculp: Interactive Visualization of Shape and Time
MoSculp: Interactive Visualization of Shape and Time
复制标题
DOI：
10.1145/3242587.3242592
复制
发表时间：
2018-09
期刊：
影响因子：
--
通讯作者：
Xiuming Zhang;Tali Dekel;Tianfan Xue;Andrew Owens;Qiurui He;Jiajun Wu;Stefanie Mueller;W. Freeman
中科院分区：
文献类型：
--
作者：
Xiuming Zhang;Tali Dekel;Tianfan Xue;Andrew Owens;Qiurui He;Jiajun Wu;Stefanie Mueller;W. Freeman
我们提出了一个系统，可视化复杂的人体运动通过3D运动雕塑表示，传达人体扫描的3D结构，因为它通过空间移动。我们的系统从输入视频中计算运动雕塑，然后以3D感知的方式将其嵌入到场景中。用户还可以直接在3D中探索雕塑或物理打印它。我们的交互式界面允许用户自定义雕塑设计，例如，通过选择材料和照明条件。为了提供这种端到端的工作流程，我们引入了一种算法，该算法可以从一组2D图像中随着时间的推移估计人类的3D几何形状，并开发了一种基于3D感知图像的渲染方法，该方法将雕塑插入到原始视频中。通过自动化的过程中，我们的系统采取的运动雕塑创作的专业艺术家的领域，并使其适用于广泛的现有的视频材料。通过向用户传达3D信息，运动雕塑揭示了肉眼难以感知的时空运动信息，并允许观众解释物体的不同部分如何随着时间的推移相互作用。我们通过用户研究验证了运动雕塑的有效性，发现我们的可视化比现有的频闪和时空可视化方法更能提供有关运动的信息。
We present a system that visualizes complex human motion via 3D motion sculptures-a representation that conveys the 3D structure swept by a human body as it moves through space. Our system computes a motion sculpture from an input video, and then embeds it back into the scene in a 3D-aware fashion. The user may also explore the sculpture directly in 3D or physically print it. Our interactive interface allows users to customize the sculpture design, for example, by selecting materials and lighting conditions. To provide this end-to-end workflow, we introduce an algorithm that estimates a human's 3D geometry over time from a set of 2D images, and develop a 3D-aware image-based rendering approach that inserts the sculpture back into the original video. By automating the process, our system takes motion sculpture creation out of the realm of professional artists, and makes it applicable to a wide range of existing video material. By conveying 3D information to users, motion sculptures reveal space-time motion information that is difficult to perceive with the naked eye, and allow viewers to interpret how different parts of the object interact over time. We validate the effectiveness of motion sculptures with user studies, finding that our visualizations are more informative about motion than existing stroboscopic and space-time visualization methods.