Raters’ L2 background as a potential source of bias in rating oral performance
Raters’ L2 background as a potential source of bias in rating oral performance
复制标题
评估者的 L2 背景是评估口头表现的潜在偏差来源
DOI：
10.1177/0265532212456968
复制
发表时间：
2013
期刊：
影响因子：
4.1
通讯作者：
C. Myford
中科院分区：
文献类型：
--
作者：
Paula M. Winke;S. Gass;C. Myford
基于听者可能比其他人更喜欢某些外国口音的证据(Gass&Varonis，1984；Majal，Fitzmaurice，Bunta，&Balasubramanian，2002；Tauroza&Luk，1997)，以及语言测试评分员在某种程度上可能更好地理解和/或评价母语更为熟悉的考生的言语(Carey，Mannell，&Dunn，2011；Fayer&Krasinski，1987；Scales，Winnerstrom，Richard，&Wu，2006)，我们调查了口音熟悉是否会导致评分者偏见。我们对72名考生的432个托福iBTTM语音样本中的107名评分员进行了评分。感兴趣的评分者是西班牙语、汉语或韩语的第二语言使用者，而测试者由三个母语为西班牙语、汉语和韩语的群体(各24人)组成。我们使用多方面的Rasch测量方法分析了评级。结果表明，第二语言西班牙语评分者对第一语言西班牙语考生的态度更为宽大，中国第二语言评分者对第一语言中国考生的态度也是如此。最后，我们同意习和莫伦(2009,2011)以及Carey等人的观点。评分员培训应将评分员的语言背景作为潜在的评分员影响。此外，我们还讨论了将评分者L2视为可能的偏倚来源的重要性。
Based on evidence that listeners may favor certain foreign accents over others (Gass & Varonis, 1984; Major, Fitzmaurice, Bunta, & Balasubramanian, 2002; Tauroza & Luk, 1997) and that language-test raters may better comprehend and/or rate the speech of test takers whose native languages (L1s) are more familiar on some level (Carey, Mannell, & Dunn, 2011; Fayer & Krasinski, 1987; Scales, Wennerstrom, Richard, & Wu, 2006), we investigated whether accent familiarity (defined as having learned the test takers’ L1) leads to rater bias. We examined 107 raters’ ratings on 432 TOEFL iBTTM speech samples from 72 test takers. The raters of interest were L2 speakers of Spanish, Chinese, or Korean, while the test takers comprised three native-speaker groups (24 each) of Spanish, Chinese, and Korean. We analyzed the ratings using a multifaceted Rasch measurement approach. Results indicated that L2 Spanish raters were significantly more lenient with L1 Spanish test takers, as were L2 Chinese raters with L1 Chinese test takers. We conclude by concurring with Xi and Mollaun (2009, 2011) and Carey et al. that rater training should address raters’ linguistic background as a potential rater effect. Furthermore, we discuss the importance of recognizing rater L2 as a possible source of bias.
影响因子：
2.4
作者：
Bent, T;Bradlow, AR
通讯作者：
Bradlow, AR
西班牙口音语音系统变化的感知学习。
DOI：
10.1121/1.3101452
发表时间：
2009
期刊：
The Journal of the Acoustical Society of America
影响因子：
--
作者：
Sidaras,SabrinaK;Alexander,JessicaED;Nygaard,LynneC
通讯作者：
Nygaard,LynneC