picotrans: An intelligent icon-driven interface for cross-lingual communication
picotrans: An intelligent icon-driven interface for cross-lingual communication
复制标题
picotrans：用于跨语言交流的智能图标驱动界面
DOI：
10.1145/2448116.2448121
复制
发表时间：
2013
影响因子：
3.4
通讯作者：
and Eiichiro Sumita
中科院分区：
文献类型：
--
作者：
Wei Song;Andrew Finch;Kumiko Tanaka-Ishii;Keiji Yasuda;and Eiichiro Sumita
PicoTrans是一个原型系统，它引入了一种新的基于图标的范例，用于移动设备上的跨语言交流。我们的方法将机器翻译系统与流行的图画书结合在一起。用户通过指向图片来与picoTrans交互，就像它是一本图画书一样；系统从这些图标生成自然语言，用户能够与图标序列交互，以细化生成的单词的含义。当用户对生成的句子表示他们想要表达的内容感到满意时，他们点击翻译按钮，picoTrans就会显示翻译。以这种方式构建沟通过程有很多好处。首先，点击图标是用户在移动设备上输入的一种非常自然的方法；打字很麻烦，语音输入也很错误。其次，用图片和文字注释的图标序列对两个用户都有意义，它为他们之间开辟了第二条沟通渠道，传达了所表达的内容的主旨。我们对PicoTrans进行了一系列评估，以确定：它对领域内句子语料库的覆盖；相对于文本输入所需的按键次数方面的输入效率；以及与使用图画书相比，用户对使用该系统的总体印象。我们的结果表明，使用2000个图标集，我们能够覆盖测试语料库中74%的表达；我们认为这个图标集的大小对于移动设备来说是现实的。我们还发现，与键入输入相比，picoTrans需要更少的按键，并且系统能够在大多数时间从图标序列预测正确的、预期的自然语言句子，使得用户通常不需要与图标序列交互。在用户评价中，我们发现，总体来说，用户更喜欢使用PicoTrans，并且能够更快、更有表现力地进行沟通。此外，用户更有信心能够使用PicoTrans进行有效的沟通。
picoTrans is a prototype system that introduces a novel icon-based paradigm for cross-lingual communication on mobile devices. Our approach marries a machine translation system with the popular picture book. Users interact with picoTrans by pointing at pictures as if it were a picture book; the system generates natural language from these icons and the user is able to interact with the icon sequence to refine the meaning of the words that are generated. When users are satisfied that the sentence generated represents what they wish to express, they tap a translate button and picoTrans displays the translation. Structuring the process of communication in this way has many advantages. First, tapping icons is a very natural method of user input on mobile devices; typing is cumbersome and speech input errorful. Second, the sequence of icons which is annotated both with pictures and bilingually with words is meaningful to both users, and it opens up a second channel of communication between them that conveys the gist of what is being expressed. We performed a number of evaluations of picoTrans to determine: its coverage of a corpus of in-domain sentences; the input efficiency in terms of the number of key presses required relative to text entry; and users' overall impressions of using the system compared to using a picture book. Our results show that we are able to cover 74% of the expressions in our test corpus using a 2000-icon set; we believe that this icon set size is realistic for a mobile device. We also found that picoTrans requires fewer key presses than typing the input and that the system is able to predict the correct, intended natural language sentence from the icon sequence most of the time, making user interaction with the icon sequence often unnecessary. In the user evaluation, we found that in general users prefer using picoTrans and are able to communicate more rapidly and expressively. Furthermore, users had more confidence that they were able to communicate effectively using picoTrans.