Deep Transfer Learning of Pick Points on Fabric for Robot Bed-Making
Deep Transfer Learning of Pick Points on Fabric for Robot Bed-Making
复制标题
用于机器人铺床的织物拾取点的深度迁移学习
DOI：
10.1007/978-3-030-95459-8_17
复制
发表时间：
2018
期刊：
影响因子：
--
通讯作者：
Ken Goldberg
中科院分区：
文献类型：
--
作者：
Daniel Seita;Nawid Jamali;Michael Laskey;A. Tanwani;R. Berenstein;Prakash Baskaran;Soshi Iba;J. Canny;Ken Goldberg
服装折叠和纺织品制造中操纵织物的一个基本挑战是计算“拾取点”以有效地修改不确定流形的状态。我们提出了一种有监督的深度迁移学习方法，使用深度图像定位拾取点，以实现颜色和纹理的不变性。我们认为，铺床的任务，其中机器人顺序地抓住，并在采摘点拉，以增加毛毯覆盖。我们用两个移动的机械手机器人，丰田HSR和Fetch，和三个不同颜色和纹理的毯子进行物理实验。我们比较了（1）人类监督，（2）在最上面的毯子点拾取的基线，以及（3）学习拾取点的覆盖结果。在四分之一比例的双床上，使用来自两个机器人的组合数据训练的模型实现了92%的毯子覆盖率，而基线为83%，人类监督员为95%。该模型转移到两个新的毯子，并达到93%的覆盖率。平均覆盖率为92%的193张病床的结果表明，转移不变的机器人采摘点织物上可以有效地学习。
A fundamental challenge in manipulating fabric for clothes folding and textiles manufacturing is computing "pick points" to effectively modify the state of an uncertain manifold. We present a supervised deep transfer learning approach to locate pick points using depth images for invariance to color and texture. We consider the task of bed-making, where a robot sequentially grasps and pulls at pick points to increase blanket coverage. We perform physical experiments with two mobile manipulator robots, the Toyota HSR and the Fetch, and three blankets of different colors and textures. We compare coverage results from (1) human supervision, (2) a baseline of picking at the uppermost blanket point, and (3) learned pick points. On a quarter-scale twin bed, a model trained with combined data from the two robots achieves 92% blanket coverage compared with 83% for the baseline and 95% for human supervisors. The model transfers to two novel blankets and achieves 93% coverage. Average coverage results of 92% for 193 beds suggest that transfer-invariant robot pick points on fabric can be effectively learned.
DOI：
10.1109/icra.2019.8793690
发表时间：
2019-03
期刊：
2019 International Conference on Robotics and Automation (ICRA)
影响因子：
--
作者：
A. Tanwani;Nitesh Mor;J. Kubiatowicz;Joseph E. Gonzalez;Ken Goldberg
通讯作者：
A. Tanwani;Nitesh Mor;J. Kubiatowicz;Joseph E. Gonzalez;Ken Goldberg
DOI：
--
发表时间：
2018-06
期刊：
ArXiv
影响因子：
--
作者：
J. Matas;Stephen James;A. Davison
通讯作者：
J. Matas;Stephen James;A. Davison