Enhancing the Composition Task in Text Entry Studies: Eliciting Difficult Text and Improving Error Rate Calculation
Enhancing the Composition Task in Text Entry Studies: Eliciting Difficult Text and Improving Error Rate Calculation
复制标题
增强文本输入研究中的作文任务：引出困难的文本并改进错误率计算
DOI：
10.1145/3411764.3445199
复制
发表时间：
2021
期刊：
影响因子：
--
通讯作者：
Vertanen, Keith
中科院分区：
文献类型：
--
作者：
Gaines, Dylan;Kristensson, Per Ola;Vertanen, Keith
文本输入研究的参与者通常会复制短语或撰写新的信息。合成任务模仿实际的用户行为，可以让研究人员更好地了解系统在现实中的表现。写作的一个问题是，参与者可能倾向于写简单的文本，即只包含常见单词的文本。这样简单的文本不足以探索控制文本输入方法的所有因素，例如其纠错功能。我们通过两种方式来提高作文任务。首先，我们表明参与者可以根据简单的指令调节他们的作文难度。虽然撰写困难的信息需要更多的时间，但它们更长，有更多的困难词，并导致更多地使用纠错功能。其次，我们比较了两种方法来获得参与者的预期文本，比较这两种方法与先前提出的众包判断程序。我们发现参与者提供的参考更准确。
Participants in text entry studies usually copy phrases or compose novel messages. A composition task mimics actual user behavior and can allow researchers to better understand how a system might perform in reality. A problem with composition is that participants may gravitate towards writing simple text, that is, text containing only common words. Such simple text is insufficient to explore all factors governing a text entry method, such as its error correction features. We contribute to enhancing composition tasks in two ways. First, we show participants can modulate the difficulty of their compositions based on simple instructions. While it took more time to compose difficult messages, they were longer, had more difficult words, and resulted in more use of error correction features. Second, we compare two methods for obtaining a participant’s intended text, comparing both methods with a previously proposed crowdsourced judging procedure. We found participant-supplied references were more accurate.