Time to fill the gaps: a mixed-methods study into the role of the time variable in the construct of computer-administered C-Tests in three languages

C-Test是衡量全球语言水平的高效工具，用于安置和筛选目的，用于第二语言习得研究(SLA)和教育监测(Grotjahn，2019年)。在C测试中，被测试者被要求填补部分删除的单词的空白。新的时间缩减的加速C-测试(S-C-测试)在效率方面似乎更有希望，但尚未得到充分的研究。Grothjahn(2010)认为，与标准的C-Test有很大的时间限制，主要衡量学习者的陈述性和程序性知识的数量不同，S C-Test还衡量了他们技能的自动化水平和信息处理的效率。因此，S C级考试与听力和口语技能的相关性预计高于标准的C级考试，但与写作和阅读的相关性较低。因此，一个部分不同的结构被假设为S-C测试的基础。虽然关于时间在结构中的作用的初步发现是可用的(Fadaeiour&Zohoorian，2017；Zimmermann，2019)，但许多问题仍然没有得到回答，特别是对于计算机化的C-测试。特别是，我们不知道时间变量如何影响测试的信度和学习者的分数取决于他们的熟练程度，以及不同的组成部分(例如，陈述性知识)在不同时间段的C-Test的构建中扮演了什么角色。重要的是，没有系统的证据表明时间对由测试引起的认知过程的影响，并在学习者使用的策略中实现。鉴于时间变量被假设在构建中起关键作用，拟议的多语言研究旨在以全面的方式具体调查这一角色，以使1)不同水平的熟练程度、2)多种语言(英语、德语、俄语)和3)计算机管理的C-Testing通过使用各种方法和收集建立在几种相关类型证据基础上的大量数据集来实现更高程度的概括性。本研究以大学语言学习者为样本(n=540)，旨在为不同时间段的C-Test测试提供证据，以巩固和加深我们对该结构的流动性的了解(Drackert&Timukova，2020 a&b；Sigott，2006)。此外，这将是第一次使用结构方程模型和基于过程的视频策略分析来研究C-Test结构的组成部分结构。更好地理解时间对C-测试结构的影响以及对C-测试结构本身的影响，将有利于C-测试的实际应用。它将允许利益攸关方针对特定目的和群体定制该工具，并将导致关于学习者第二语言熟练程度的更明智的决定。因此，它将使工具更精确、更高效、更具成本效益。

C-Tests are highly-efficient tools for measuring global language proficiency used for placement and screening purposes, in second language acquisition research (SLA) and educational monitoring (Grotjahn, 2019). In a C-Test, testees are required to fill the gaps in partially deleted words. The new time-reduced speeded C-Test (S-C-Test), appears to be even more promising in terms of efficiency, but has not yet been sufficiently investigated. Grothjahn (2010) argues that, in contrast to a canonical C-Test with a generous time limit that primarily measures the amount of learners’ declarative and procedural knowledge, a S-C-Test additionally gauges the level of automaticity of their skills and the efficiency of information processing. Accordingly, a S-C-Test is expected to correlate higher with listening and speaking skills than a canonical C-Test but lower with writing and reading. Consequently, a partially different construct is hypothesized to underlie a S-C-Test. Although initial findings on the role of time in the construct are available (Fadaeipour & Zohoorian, 2017; Zimmermann, 2019), many questions remain unanswered, especially for computerized C-tests. In particular, we do not know how the time variable influences test reliability and learners’ scores depending on their proficiency level as well as what role different components (e.g., declarative knowledge) play in the construct of differently timed C-Tests. Importantly, no systematic evidence is available on the impact of time on the cognitive processes elicited by the test and realized in the strategies used by learners. Given the crucial role the time variable is hypothesized to play in the construct, the proposed multilingual study aims to specifically investigate this role in a comprehensive way to allow for a higher degree of generalizability of the results for 1) different levels of proficiency, 2) multiple languages (English, German, Russian) and 3) computer-administered C-Tests by employing a variety of methods and collecting a substantial data set building on several relevant types of evidence. Using a sample (n=540) of university language learners, the study aims to provide evidence on what differently timed C-Tests measure, building upon and furthering our knowledge about the fluidity of the construct (Drackert & Timukova, 2020 a&b; Sigott, 2006). Moreover, this will be the first study to look into the componential structure of the C-Test construct using structural equation modeling and process-oriented video-based analysis of strategies. The improved understanding of the influence of time on the C-Test construct and of the construct as such will be beneficial for the practical use of C-Tests. It will allow stakeholders to tailor the instrument to specific purposes and groups and will lead to better informed decisions about learners’ L2 proficiency. Consequently, it will make the tool more precise, more efficient, and more cost-effective.