Content Is King: Impact of Task Design for Eliciting Participant Agreement in Crowdsourcing for HRI

Content Is King: Impact of Task Design for Eliciting Participant Agreement in Crowdsourcing for HRI
复制标题

内容为王:任务设计对 HRI 众包中获得参与者同意的影响

DOI:
10.1007/978-3-030-62056-1_53
复制
发表时间:
2020
期刊:
International Conference on Social Robotics
影响因子:
--
通讯作者:
A. Bevins, N. McPhaul
A. Bevins, N. McPhaul
中科院分区:
--
文献类型:
--
作者:
A. Bevins, N. McPhaul

文献摘要

参考文献

相似文献

这项工作研究如何众包任务的设计可以影响响应。作为一个形成性的调查路线,这项研究试图了解用户如何通过移动,反应或转移焦点来改变无人机的飞行路径。在设计一个实验时,运行几个原型研究可以帮助生成一个可操作的数据集,但目前还不清楚措辞或调查前后的差异如何影响结果。利用心理学,计算机支持的合作工作和人机交互社区的方法,这项工作探索了众包的最佳实践和经验教训,以减少用于定义新通信模式的可操作数据的时间。在这项工作中学到的经验教训将广泛适用于人机交互社区,甚至在那些有兴趣定义飞行路径的人之外,因为它们提供了一个支架,在此基础上建立未来的实验,寻求使用非拟人机器人进行通信。重要的结果和建议包括:随着问题数量的增加,负面影响增加,完成时间相对一致,基于响应总数而不是视频数量,响应与视频的相关性大于问题,以及需要改变问题长度以保持参与度。
This work investigates how the design of crowdsourced tasks can influence responses. As a formative line of inquiry, this study sought to understand how users would respond either through movement, response, or shift of focus to varying flight paths from a drone. When designing an experiment, running several proto-studies can help with generating a dataset that is actionable, but it has been unclear how differences in things such as phrasing or pre- and post-surveys can impact the results. Leveraging methods from psychology, computer-supported cooperative work, and the human-robot interaction communities this work explored the best practices and lessons learned for crowdsourcing to reduce time to actionable data for defining new communication paradigms. The lessons learned in this work will be applicable broadly within the human-robot interaction community, even outside those who are interested in defining flight paths, because they provide a scaffold on which to build future experiments seeking to communicate using non-anthropomorphic robots. Important results and recommendations include: increased negative affect with increased question quantity, completion time being relatively consistent based on total number of responses rather than number of videos, responses being more related to the video than the question, and necessity of varying question lengths to maintain engagement.
DOI: 10.1007/s12369-009-0013-7
发表时间: 2009-04-01
影响因子: 4.7
作者:
Bartneck, Christoph;Kanda, Takayuki;Al Mahmud, Abdullah
通讯作者: Al Mahmud, Abdullah
人们帮助机器人帮助人类:抓取新物体的众包
DOI: 10.1109/iros.2010.5650464
发表时间: 2010
期刊: 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems
影响因子: --
作者:
A. Sorokin;D. Berenson;S. Srinivasa;M. Hebert
通讯作者: M. Hebert
向用户学习:通过手势传达小型无人机系统状态的启发研究和分类法
DOI: 10.1109/hri.2019.8673010
发表时间: 2019
期刊: 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI
影响因子: --
作者:
Firestone, Justin W.;Quinones, Rubi;Duncan, Brittany A.
通讯作者: Duncan, Brittany A.
DOI: 10.1177/1470785318821025
发表时间: 2019-07-01
影响因子: 3
作者:
Brosnan, Kylie;Babakhani, Nazila;Dolnicar, Sara
通讯作者: Dolnicar, Sara