A Soft Proposal Segmentation Network (SPS-Net) for Hand Segmentation on Depth Videos

A Soft Proposal Segmentation Network (SPS-Net) for Hand Segmentation on Depth Videos
复制标题

用于深度视频手部分割的软提议分割网络(SPS-Net)

DOI:
10.1109/access.2019.2900991
复制
发表时间:
2019
期刊:
影响因子:
3.9
通讯作者:
Yang Wu
Yang Wu
中科院分区:
计算机科学3区
文献类型:
--
作者:
Fan Yang;Yang Wu

文献摘要

参考文献

被引文献

相似文献

手部分割是在深度图像上获取准确的3D手部姿态的重要前提,因为它可以显著降低手部姿态估计的复杂性。然而,长期以来,它一直被忽视或被视为一个微不足道的问题,因为大多数手部姿态估计工作都假设手部部分被给定或可以通过深度阈值容易地分割,这在许多现实场景中是不切实际的(例如,侧/自我中心的观点)。为了在各种场景下进行鲁棒的手部分割,我们提出了一个软建议分割网络(SPS-Net)。与现有手部分割方法的一个关键区别是SPS-Net可以利用深度视频上的时间信息。作为一个好处,可以获得显着的性能增益超过现有的方法,证明了两个流行的公共数据集与不同的相机的观点和背景。此外,将SPS-Net与简单的3D手部姿势估计器相结合,我们在Hand 2017挑战赛的3D手部姿势跟踪任务中取得了领先的结果-这是同类挑战赛中唯一的全球开放式挑战赛。
Hand segmentation is an important prerequisite for acquiring accurate 3D hand poses on depth images, as it can significantly reduce the complicity of hand pose estimation. However, it has been ignored or treated as a trivial problem for a long time, since most of the hand pose estimation works suppose the hand part is given or can be easily segmented by a depth threshold, which is not practical in many realistic scenarios (e.g., side/egocentric view). In order to perform the robust hand segmentation in various scenarios, we propose a Soft Proposal Segmentation Network (SPS-Net). A key difference from existing hand segmentation methods is that the SPS-Net can utilize the temporal information on depth videos. As a benefit, significant performance gains over the existing methods can be obtained, as demonstrated on two popular public datasets with diverse camera viewpoints and background. Moreover, integrating SPS-Net with a simple 3D hand pose estimator, we achieved the leading result on the 3D Hand Pose Tracking Task of the Hand2017 Challenge - the only world-wide open challenge of its kind.
使用 3D U-Net 高精度提取气管和支气管
DOI: --
发表时间: 2023
期刊:
影响因子: --
作者:
小笠 竜哉;黒田 陸斗;河田 佳樹;鈴木 秀宣;松元 祐司;土田 敬明;楠本 昌彦;仁木 登
通讯作者: 仁木 登