Gorilla in our midst: An online behavioral experiment builder

Gorilla in our midst: An online behavioral experiment builder
复制标题

DOI:
10.3758/s13428-019-01237-x
复制
发表时间:
2020-02-01
影响因子:
5.4
通讯作者:
Evershed, Jo K.
Evershed, Jo K.
中科院分区:
心理学2区
文献类型:
--
作者:
Anwyl-Irvine, Alexander L.;Massonnie, Jessica;Evershed, Jo K.

文献摘要

被引文献

相似文献

行为研究人员越来越多地在网上进行研究,以获得在实验室环境中难以获得的大量和多样化的样本。然而,在线构建实验存在技术访问障碍,Web浏览器可能会出现一致的时间问题,这是反应时间敏感措施的一个重要问题。例如,为了确保演示和响应记录的准确性和重测可靠性,实验者需要掌握JavaScript等编程语言的工作知识。我们回顾了一些以前和现在的在线行为研究工具,以及它们如何解决可用性和时间问题。然后,我们介绍了大猩猩实验生成器(gorilla.sc),一个完全工具化的实验创作和部署平台,旨在解决许多时间问题,并使可靠的在线实验开放,并可供更广泛的技术能力。为了证明该平台在可访问、可靠和可扩展的研究方面的能力,我们管理了一系列参与者组的任务(小学生和成人),设置(在没有监督的情况下,在家里,在监督下,在学校和公众参与活动中),设备(参与者自己的计算机、研究者提供的计算机)和连接类型(个人互联网连接、移动的电话3G/4G)。我们使用了一个简化的侧翼任务,该任务取自注意力网络任务(Rueda,Posner,& Rothbart,2004)。我们在所有这些人群中复制了“冲突网络”效应,展示了该平台运行反应时间敏感实验的能力。然后讨论了在线运行实验的未解决的局限性,沿着讨论了潜在的解决方案和平台的一些未来功能。
Behavioral researchers are increasingly conducting their studies online, to gain access to large and diverse samples that would be difficult to get in a laboratory environment. However, there are technical access barriers to building experiments online, and web browsers can present problems for consistent timing-an important issue with reaction-time-sensitive-measures. For example, to ensure accuracy and test-retest reliability in presentation and response recording, experimenters need a working knowledge of programming languages such as JavaScript. We review some of the previous and current tools for online behavioral research, as well as how well they address the issues of usability and timing. We then present the Gorilla Experiment Builder (gorilla.sc), a fully tooled experiment authoring and deployment platform, designed to resolve many timing issues and make reliable online experimentation open and accessible to a wider range of technical abilities. To demonstrate the platform's aptitude for accessible, reliable, and scalable research, we administered a task with a range of participant groups (primary school children and adults), settings (without supervision, at home, and under supervision, in both schools and public engagement events), equipment (participant's own computer, computer supplied by the researcher), and connection types (personal internet connection, mobile phone 3G/4G). We used a simplified flanker task taken from the attentional network task (Rueda, Posner, & Rothbart, 2004). We replicated the "conflict network" effect in all these populations, demonstrating the platform's capability to run reaction-time-sensitive experiments. Unresolved limitations of running experiments online are then discussed, along with potential solutions and some future features of the platform.