Text Entry in Virtual Environments using Speech and a Midair Keyboard
Text Entry in Virtual Environments using Speech and a Midair Keyboard
复制标题
DOI：
10.1109/tvcg.2021.3067776
复制
发表时间：
2021-03
影响因子：
5.2
通讯作者：
Jiban Adhikary;K. Vertanen
中科院分区：
文献类型：
--
作者：
Jiban Adhikary;K. Vertanen
在虚拟环境中输入文本可能具有挑战性，特别是在没有辅助输入设备的情况下。我们调查文本输入在虚拟现实中使用手跟踪和语音。我们的系统在虚拟环境中可视化用户的手，允许在自动纠正的半空中键盘上打字。它还支持说出一个句子，然后通过选择语音识别器提出的替代词来纠正错误。我们进行了一项用户研究，参与者写的句子与不讲话。仅使用键盘，用户以每分钟11个字的速度书写，错误率为1.2%。说话和纠正句子更快，更准确，每分钟28个单词，错误率为0.5%。尽管一半的句子包含一个不常见的词汇（例如专有名词），但参与者还是达到了这一表现。对于只有词汇表中单词的句子，使用语音和空中键盘更正的表现更快，每分钟36个单词，错误率低0.3%。
Entering text in virtual environments can be challenging, especially without auxiliary input devices. We investigate text input in virtual reality using hand-tracking and speech. Our system visualizes users' hands in the virtual environment, allowing typing on an auto-correcting midair keyboard. It also supports speaking a sentence and then correcting errors by selecting alternative words proposed by a speech recognizer. We conducted a user study in which participants wrote sentences with and without speech. Using only the keyboard, users wrote at 11 words-per-minute at a 1.2% error rate. Speaking and correcting sentences was faster and more accurate at 28 words-per-minute and a 0.5% error rate. Participants achieved this performance despite half of sentences containing an uncommon out-of-vocabulary word (e.g. proper name). For sentences with only in-vocabulary words, performance using speech and midair keyboard corrections was faster at 36 words-per-minute with a low 0.3% error rate.