A thorough evaluation of the Language Environment Analysis (LENA) system.
A thorough evaluation of the Language Environment Analysis (LENA) system.
复制标题
对语言环境分析 (LENA) 系统的全面评估。
DOI：
10.3758/s13428-020-01393-5
复制
发表时间：
2021-04
影响因子：
5.4
通讯作者：
Bergelson E
中科院分区：
文献类型：
--
作者：
Cristia A;Lavechin M;Scaff C;Soderstrom M;Rowland C;Räsänen O;Bunce J;Bergelson E
在过去的十年中，数十项涉及数千名儿童的研究在多个研究学科中使用了一种名为LENA®系统的全天录音机和自动算法分析，旨在评估儿童的语言环境。虽然该系统在语言习得领域的流行正在稳步增长，但只有一些关键特征的分散验证工作。在这里，我们评估了LENA®系统在所有关键指标上的准确性：说话者分类、儿童发声计数（CVC）、会话回合计数（CTC）和成人字数（AWC）。我们的评估是基于对片段的手动注释，这些片段是从一天的记录中随机或定期取样的，从（a）与系统原始训练数据相似的人群中收集的（3-36个月的北美英语学习儿童），（B）学习另一种英语方言的儿童（英国），以及（c）在不同语言和社会文化环境中长大的稍大的儿童（玻利维亚农村的Tsimane学习者）。我们发现在一些措施（AWC，CVC）相当高的准确性，在其他方面（CTC，男性成年人和其他儿童的精度）的性能更有问题的水平。统计分析不支持与LENA®原始训练集不同的儿童表现更差的观点。LENA®结果对于给定的研究、教育或临床应用是否足够准确在很大程度上取决于手头的具体情况。因此，我们总结了一系列建议，以帮助研究人员为他们的目标做出这一决定。
In the previous decade, dozens of studies involving thousands of children across several research disciplines have made use of a combined daylong audio-recorder and automated algorithmic analysis called the LENA® system, which aims to assess children’s language environment. While the system’s prevalence in the language acquisition domain is steadily growing, there are only scattered validation efforts on only some of its key characteristics. Here, we assess the LENA® system’s accuracy across all of its key measures: speaker classification, Child Vocalization Counts (CVC), Conversational Turn Counts (CTC), and Adult Word Counts (AWC). Our assessment is based on manual annotation of clips that have been randomly or periodically sampled out of daylong recordings, collected from (a) populations similar to the system’s original training data (North American English-learning children aged 3–36 months), (b) children learning another dialect of English (UK), and (c) slightly older children growing up in a different linguistic and socio-cultural setting (Tsimane’ learners in rural Bolivia). We find reasonably high accuracy in some measures (AWC, CVC), with more problematic levels of performance in others (CTC, precision of male adults and other children). Statistical analyses do not support the view that performance is worse for children who are dissimilar from the LENA® original training set. Whether LENA® results are accurate enough for a given research, educational, or clinical application depends largely on the specifics at hand. We therefore conclude with a set of recommendations to help researchers make this determination for their goals.
登录
查看更多内容
DOI：
10.1073/pnas.1003882107
发表时间：
2010-07-27
影响因子：
11.1
作者：
Oller, D. K.;Niyogi, P.;Warren, S. F.
通讯作者：
Warren, S. F.
影响因子：
5.4
作者：
Bulgarelli, Federica;Bergelson, Elika
通讯作者：
Bergelson, Elika
影响因子：
5.4
作者：
Busch, Tobias;Sangen, Anouk;van Wieringen, Astrid
通讯作者：
van Wieringen, Astrid
影响因子：
2.6
作者：
Gilkerson, Jill;Richards, Jeffrey A.;Paul, Terrance D.
通讯作者：
Paul, Terrance D.
影响因子：
0.9
作者：
Greenwood, Charles R.;Thiemann-Bourque, Kathy;Gilkerson, Jill
通讯作者：
Gilkerson, Jill