Classifying Images Regardless of Depictive Style

无论描述风格如何对图像进行分类

• 批准号: EP/K015966/1
• 负责人: Peter Hall
• 金额: $ 30.81万
• 依托单位: University of Bath
• 依托单位国家: 英国
• 项目类别: Research Grant
• 财政年份: 2013
• 资助国家: 英国
• 起止时间: 2013 至 无数据
• 项目状态: 已结题
• 来源: https://gtr.ukri.org/projects?ref=EP%2FK015966%2F1
• 关键词: Classifying; Images; Regardless; Depictive; Style

Computer's today can recognise objects in photographs. This ability has formed the basis of many familiar applications such as Facebook tagging, Google Image Search, Google Goggles, and automated passport checking at UK borders.Yet a significant restriction remains: computers can only recognise objects in photographs. At least, their ability to recognise objects indrawings and paintings - in artwork of any kind - is strictly limited. If this limitation can be overcome then many more applications willbecome possible.One is a new way to search the web for images in which a drawing (say) is dragged from the desktop into a search bar,and paintings and photographs are given back to the user (at the moment a user gets the same sort of image back as was dragged into thesearch bar).Another is the automated production of catalogues for taxonomy - which is important to scientists faces with tens of thousands ofmicroscopic creatures; species catalogues are hand-drawn right now so automation would be a significant advance for them.The output of the programme would also allow ordinary photographs to be converted to icons. This is not as dry as it sounds, but could help the visually impaired to gain access to photographic content. If photographs and drawings can be linked in the way this project has in mind, thenobjects in photographs could be turned into icons rendered by a set of raised pins. So there would be a symbol for car, say, not unlike that which might be drawn by a child - and in fact this is very close to the icons blind artists draw. This would allow the visually impaired to read photographs in newspapers, or in text books, and allow them to share the holiday snaps of family and friends.This proposal is about building the basic technology that underpins these applications, and quite possibly others too. Key to it is lifting the barrier that computers of today face - allowing them to recognise objects no matter how they are depicted.

今天的计算机可以识别照片中的物体。这种能力已经形成了许多熟悉的应用程序的基础，如Facebook标签，b谷歌图像搜索，谷歌Goggles和英国边境的自动护照检查。然而，一个重要的限制仍然存在：计算机只能识别照片中的物体。至少，他们在素描和油画——任何种类的艺术作品——中识别物体的能力是受到严格限制的。如果这个限制可以克服，那么更多的应用将成为可能。一种是在网络上搜索图像的新方法，比如，将一幅画从桌面上拖到搜索栏中，然后将画和照片返回给用户（此时用户得到的是与拖到搜索栏中相同类型的图像）。另一个是分类目录的自动化生产——这对于面对成千上万的微观生物的科学家来说是很重要的；现在的物种目录都是手工绘制的，所以自动化对它们来说将是一个重大的进步。该程序的输出还将允许将普通照片转换为图标。这并不像听起来那么枯燥，但可以帮助视障人士获得照片内容。如果照片和绘画可以像这个项目所设想的那样联系起来，那么照片中的物体就可以变成一组凸起的大头针所呈现的图标。所以会有一个代表汽车的符号，比如说，和一个孩子可能画的符号没有什么不同——事实上，这与盲人艺术家画的图标非常接近。这将允许视障人士阅读报纸或教科书上的照片，并允许他们分享家人和朋友的假期照片。这个建议是关于构建支持这些应用程序的基本技术，很可能也支持其他应用程序。关键在于消除当今计算机所面临的障碍——使它们能够识别物体，无论它们是如何被描绘出来的。

项目成果

Computer Vision - ECCV 2016 Workshops - Amsterdam, The Netherlands, October 8-10 and 15-16, 2016, Proceedings, Part I

计算机视觉 - ECCV 2016 研讨会 - 荷兰阿姆斯特丹，2016 年 10 月 8-10 日和 15-16 日，会议记录，第一部分

• DOI: 10.1007/978-3-319-46604-0_57
• 发表时间: 2016
• 作者: Westlake N

Cross-depiction problem: Recognition and synthesis of photographs and artwork

• DOI: 10.1007/s41095-015-0017-1
• 发表时间: 2015-04
• 期刊: Computational Visual Media
• 影响因子: 6.9
• 作者: P. Hall;Hongping Cai;Qi Wu;Tadeo Corradi

Beyond Photo-Domain Object Recognition: Benchmarks for the Cross-Depiction Problem

超越照片域对象识别：交叉描述问题的基准

• 发表时间: 2015
• 期刊: 2015 IEEE International Conference on Computer Vision Workshop (ICCVW)
• 作者: Hongping Cai;Qi Wu;P. Hall
• 通讯作者: P. Hall