Aided Language Measures: Establishing Observer Agreement for Communicators in Early Language Phases.
Aided Language Measures: Establishing Observer Agreement for Communicators in Early Language Phases.
复制标题
DOI：
10.1044/2022_ajslp-21-00341
复制
发表时间：
2022-04
影响因子：
2.6
通讯作者：
Jisun Lee;C. Binger;Nancy Harrington;Seana Evelyn;Jennifer Kent-Walsh;Cindy Gevarter;Jessica Richardson;Debbie L. Hahs-Vaughn
中科院分区：
文献类型：
--
作者：
Jisun Lee;C. Binger;Nancy Harrington;Seana Evelyn;Jennifer Kent-Walsh;Cindy Gevarter;Jessica Richardson;Debbie L. Hahs-Vaughn
目的虽然已经有许多有效、可靠和对发展敏感的措施来监测依赖口头语言进行交流的儿童的语言习得，但对于图形符号沟通者来说却并非如此。这项研究是制定这类措施的第一步，通过审查观察者间协议(IOA)和观察者内部协议(IOA)，旨在监测使用辅助性增强和替代沟通(AAC)的儿童的语言进步。这些措施基于图形符号发声和句子发展框架(Binger等人，2020)，并假设捕捉图形符号交流的各个阶段。方法4名研究生观察员在57个不同的唐氏综合症儿童游戏课程中编码了13项测量，这些儿童的年龄分别为3岁、0-5岁、11岁(岁、月)。对于IOA，会议由两个不同的观察员编码。对于观察员内部的协议，所有会议都由相同的编码员重新编码。完成了语料库级别的分析，以表征样本的性质(例如，样本的平均话语长度)。每一次发言都审查了IOA和观察员内部的协议。结果在所有观察员和措施中，实现了可接受的IOA水平和观察员内部的协议，大多数措施产生了相对较高的协议水平。注意到不同措施之间存在一些差异，经验较少的编码员在选定的措施上表现出较少的一致性。结论结果提供了初步证据，基于图形符号发声和句子发展框架的许多测量可以被可靠地编码。这些发现是开发心理测量学上合理的措施来监测使用AAC的儿童表达语言进展的第一步。补充材料https://doi.org/10.23641/asha.19601551.
PURPOSE Although many valid, reliable, and developmentally sensitive measures exist to monitor the language gains of children who rely on spoken language to communicate, the same is not true for graphic symbol communicators. This study is a first step in developing such measures by examining the interobserver agreement (IOA) and within-observer agreement of 13 measures designed to monitor the language progress of children who use aided augmentative and alternative communication (AAC). These measures are based on the Graphic Symbol Utterance and Sentence Development Framework (Binger et al., 2020) and are hypothesized to capture various phases of graphic symbol communication. METHOD Four graduate student observers coded 13 measures across 57 different play-based sessions of children with Down syndrome ages 3;0-5;11 (years;months). For IOA, sessions were coded by two different observers. For within-observer agreement, all sessions were recoded by the same coders. Corpus-level analyses were completed to characterize the nature of the samples (e.g., average mean length of utterance for the samples). IOA and within-observer agreement were examined for each utterance. RESULTS Across all observers and measures, acceptable levels of IOA and within-observer agreement were achieved, with most measures yielding relatively high levels of agreement. Some differences were noted across measures, with the less experienced coders demonstrating less agreement on select measures. CONCLUSIONS Results provide initial evidence that many measures based on the Graphic Symbol Utterance and Sentence Development Framework can be reliably coded. These findings are a first step in developing psychometrically sound measures to monitor the expressive language progress of children who use AAC. SUPPLEMENTAL MATERIAL https://doi.org/10.23641/asha.19601551.