Testing for Aberrant Behavior in Response Time Modeling
Testing for Aberrant Behavior in Response Time Modeling
复制标题
DOI：
10.3102/1076998614559412
复制
发表时间：
2014-12-01
影响因子：
2.4
通讯作者：
Tijmstra, Jesper
中科院分区：
文献类型：
--
作者：
Marianti, Sukaesi;Fox, Jean-Paul;Tijmstra, Jesper
许多标准化考试现在通过计算机而不是纸笔形式进行。在基于计算机的测试环境中，不仅可以记录考生对每个问题（项目）的回答，还可以记录考生考虑和回答每个项目所花费的时间。反应时间不仅提供了考生的能力和反应行为的信息，而且还提供了关于项目和测试特征的信息。本研究的重点是使用反应时检测异常考生反应。这种变异的一个例子是一个正确的答案与一个困难的问题短RT。当一个或多个应试者具有对项目的预知时，可以显示这种异常。另一个例子是快速猜测，其中考生对一系列项目显示出异常短的RT。当快速猜测发生在定时测试结束时，它通常表明考生在完成测试之前已经没有时间了。在这项研究中，贝叶斯检验的显着性检测各种类型的异常RT模式的建议和评估。在一项模拟研究中，这些测试成功地识别了异常反应模式。一个真实的数据的例子来说明使用建议的人适合测试的RT。
Many standardized tests are now administered via computer rather than paper-and-pencil format. In a computer-based testing environment, it is possible to record not only the test taker's response to each question (item) but also the amount of time spent by the test taker in considering and answering each item. Response times (RTs) provide information not only about the test taker's ability and response behavior but also about item and test characteristics. This study focuses on the use of RTs to detect aberrant test-taker responses. An example of such aberrance is a correct answer with a short RT on a difficult question. Such aberrance may be displayed when a test taker or test takers have preknowledge of the items. Another example is rapid guessing, wherein the test taker displays unusually short RTs for a series of items. When rapid guessing occurs at the end of a timed test, it often indicates that the test taker has run out of time before completing the test. In this study, Bayesian tests of significance for detecting various types of aberrant RT patterns are proposed and evaluated. In a simulation study, the tests were successful in identifying aberrant response patterns. A real data example is given to illustrate the use of the proposed person-fit tests for RTs.