Coupling Deep Textural and Shape Features for Sketch Recognition
Coupling Deep Textural and Shape Features for Sketch Recognition
复制标题
DOI：
10.1145/3394171.3413810
复制
发表时间：
2020-10
期刊：
影响因子：
--
通讯作者：
Qi Jia;Xin Fan;Meiyu Yu;Yuqing Liu;Dingrong Wang;Longin Jan Latecki
中科院分区：
文献类型：
--
作者：
Qi Jia;Xin Fan;Meiyu Yu;Yuqing Liu;Dingrong Wang;Longin Jan Latecki
Recognizing freehand sketches with high arbitrariness is such a great challenge that the automatic recognition rate has reached a ceiling in recent years. In this paper, we explicitly explore the shape properties of sketches, which has almost been neglected before in the context of deep learning, and propose a sequential dual learning strategy that combines both shape and texture features. We devise a two-stage recurrent neural network to balance these two types of features. Our architecture also considers stroke orders of sketches to reduce the intra-class variations of input features. Extensive experiments on the TU-Berlin benchmark set show that our method achieves over 90% recognition rate for the first time on this task, outperforming both humans and state-of-the-art algorithms by over 19 and 7.5 percentage points, respectively. Especially, our approach can distinguish the sketches with similar textures but different shapes more effectively than recent deep networks. Based on the proposed method, we develop an on-line sketch retrieval and imitation application to teach children or adults to draw. The application is available as Sketch.Draw.
