Collecting response times using Amazon Mechanical Turk and Adobe Flash.
Collecting response times using Amazon Mechanical Turk and Adobe Flash.
复制标题
使用Amazon Mechanical Turk和Adobe Flash收集响应时间。
DOI：
10.3758/s13428-013-0345-y
复制
发表时间：
2014-03
影响因子：
5.4
通讯作者：
Fiez JA
中科院分区：
文献类型：
--
作者：
Simcox T;Fiez JA
像亚马逊的Mechanical Turk（AMT）这样的众包系统允许在短时间内从大量人群中收集数据。这种用法引起了行为科学家的极大兴趣。到目前为止，大多数关于AMT的实验都集中在调查类型的工具上，因为在互联网上运行许多实验范式存在固有的困难。本文研究了使用AdobeFlash与AMT一起运行TMS3代码来呈现刺激和收集响应时间的可行性。首先，Adobe Flash的时序特性进行了研究，使用光电晶体管和两台台式计算机在几种条件下运行，模仿那些可能存在于使用AMT的研究。该实验揭示了该方法的定时能力的一些优点和缺点。接下来，在Adobe Flash中实施的侧翼任务和词汇决策任务管理与AMT招募的参与者。这些任务的预期效果得到了复制。进行功效分析以描述复制这些效应所需的参与者数量。问卷调查被用来调查以前未描述的计算机使用习惯的100名参与者的AMT。我们的结论是，Flash程序与AMT可以成功地用于运行依赖于响应时间的许多实验范例，虽然实验者必须了解的方法的局限性。
Crowdsourcing systems like Amazon's Mechanical Turk (AMT) allow data to be collected from a large sample of people in a short amount of time. This use has garnered considerable interest from behavioral scientists. So far, most experiments conducted on AMT have focused on survey-type instruments because of difficulties inherent in running many experimental paradigms over the Internet. This article investigated the viability of presenting stimuli and collecting response times using Adobe Flash to run ActionScript 3 code in conjunction with AMT. First, the timing properties of Adobe Flash were investigated using a phototransistor and two desktop computers running under several conditions mimicking those that may be present in research using AMT. This experiment revealed some strengths and weaknesses of the timing capabilities of this method. Next, a flanker task and a lexical decision task implemented in Adobe Flash were administered to participants recruited with AMT. The expected effects in these tasks were replicated. Power analyses were conducted to describe the number of participants needed to replicate these effects. A questionnaire was used to investigate previously undescribed computer use habits of 100 participants on AMT. We conclude that a Flash program in conjunction with AMT can be successfully used for running many experimental paradigms that rely on response times, although experimenters must understand the limitations of the method.