Semi-Automatic Text and Graphics Extraction of Manga Using Eye Tracking Information
Semi-Automatic Text and Graphics Extraction of Manga Using Eye Tracking Information
复制标题
使用眼动追踪信息半自动漫画文本和图形提取
DOI：
10.1109/das.2016.72
复制
发表时间：
2016
期刊：
影响因子：
--
通讯作者：
and Koichi Kise
中科院分区：
文献类型：
--
作者：
Christophe Rigaud;Thanh-Nam Le;J.-C. Burie;J.-M. Ogier;Shoya Ishimaru;Motoi Iwata;and Koichi Kise
以电子方式存储、分发和阅读漫画书的流行使得漫画分析任务成为一个有趣的研究问题。为了理解它们的布局结构和图形内容，已经开展了不同的工作。然而，结果仍然远未普遍适用，这很大程度上是由于表达风格和页面排列的巨大差异，特别是在漫画（日本漫画）中。在本文中，我们提出了一种漫画图像分析方法，使用漫画阅读过程中记录的眼动追踪数据。由于人类非常有能力解释结构化绘图内容，并根据内容的性质表现出不同的阅读行为，因此他们的眼球运动在文本或图形区域上遵循可区分的模式。因此，眼睛注视数据可以为漫画内容的理解添加丰富的信息。实验结果表明，注视和扫视确实在读者之间形成了一致的模式，并且可以用于漫画文本和图形分析。
The popularity of storing, distributing and reading comic books electronically has made the task of comics analysis an interesting research problem. Different work have been carried out aiming at understanding their layout structure and the graphic content. However the results are still far from universally applicable, largely due to the huge variety in expression styles and page arrangement, especially in manga (Japanese comics). In this paper, we propose a comic image analysis approach using eye-tracking data recorded during manga reading sessions. As humans are extremely capable of interpreting the structured drawing content, and show different reading behaviors based on the nature of the content, their eye movements follow distinguishable patterns over text or graphic regions. Therefore, eye gaze data can add rich information to the understanding of the manga content. Experimental results show that the fixations and saccades indeed form consistent patterns among readers, and can be used for manga textual and graphical analysis.