Validity argument for assessing L2 pragmatics in interaction using mixed methods
Validity argument for assessing L2 pragmatics in interaction using mixed methods
复制标题
使用混合方法评估交互中 L2 语用学的有效性论证
DOI：
10.1177/0265532214557113
复制
发表时间：
2015
期刊：
影响因子：
4.1
通讯作者：
S. Youn
中科院分区：
文献类型：
--
作者：
S. Youn
本研究探讨了使用混合方法评估交互中二语语用的有效性，重点关注评估推理。为课堂评估开发了对学术英语背景下的利益相关者有意义且相关的开放角色扮演。为了对涉及交互的语用表现进行有意义的分数解释和准确评估，基于对考生角色扮演表现的定性分析，制定了交互敏感的数据驱动的评分标准。对数据进行的对话分析揭示了各种语用和互动特征，表明互动中不同水平的语用能力。 FACETS 分析表明，角色扮演在 102 名考生的不同程度的语用能力之间稳定地区分。尽管严重程度不同，评估者仍表现出内部一致性。在每个相互作用敏感的评级标准中都报告了稳定的拟合统计数据和明显的困难。研究结果为有效性论证中的评估推论提供了支持。最后，讨论了研究结果对实施涉及交互的语言表现和制定评分标准的影响。
This study investigates the validity of assessing L2 pragmatics in interaction using mixed methods, focusing on the evaluation inference. Open role-plays that are meaningful and relevant to the stakeholders in an English for Academic Purposes context were developed for classroom assessment. For meaningful score interpretations and accurate evaluations of interaction-involved pragmatic performances, interaction-sensitive data-driven rating criteria were developed, based on the qualitative analyses of examinees’ role-play performances. The conversation analysis performed on the data revealed various pragmatic and interactional features indicative of differing levels of pragmatic competence in interaction. The FACETS analysis indicated that the role-plays stably differentiated between the varying degrees of the 102 examinees’ pragmatic abilities. The raters showed internal consistency despite their differing degrees of severity. Stable fit statistics and distinct difficulties were reported within each of the interaction-sensitive rating criteria.The findings served as backing for the evaluation inference in the validity argument. Finally, implications of the findings in operationalizing interaction-involved language performances and developing rating criteria are discussed.
影响因子：
0.4
作者：
Yijin Wu;Wen Ma
通讯作者：
Yijin Wu;Wen Ma