Computationally analyzing the hierarchical complexity of infants' social coordination on multi scales in natural daily life to investigate infants' cognitive development

本项目旨在量化社会形态和多尺度，以寻找婴儿互动发展中的多组合计算机制。目前的成果集中在三个研究问题中的前两个问题上：Q1。在什么时间尺度下，婴儿会从社会互动环境中接受什么形式的线索？Q2.婴儿如何管理线索与环境的交互作用(S)？提出了一个基于日常交互中婴儿与照顾者之间的韵律对齐的多尺度分析框架。该框架分析了来自Tseltal语料库的一整天的音频数据。结果显示，婴儿和照顾者的发声在每个时间尺度上都是不同的协调。此外，在一个加拿大-英语语料库上也进行了同样的分析，该语料库的音频数据在相似的收集条件下进行。结果显示，母亲的韵律排列出现在英语中，而不是Tseltal，而婴儿与照顾者的排列很弱，但在不同文化中也存在类似的情况。有趣的是，在更长的相互作用序列中，Tseltal二元组比加拿大二元组更有可能显示出韵律排列的增加。基于这些结果的会议论文和海报在(Li，J.，et al.，ICDL2022)和(Li，J.，et al.，SRCD2023)上提交。目前的研究结果强调，婴儿在全球、中间和局部尺度(Q1)上接受来自环境的不同听觉提示。此外，婴儿的行为也不同，对应于不同时间尺度上的这些线索。(第二季度)

This project aims at quantifying social modalities and multi-scales to find the multi-combining computational mechanisms in infants’ interactive development. The current achievements focused on the first two of the three research questions: Q1. What cues in which modality do infants accept from the social-interactive environment in which time scale? Q2. How do infants manage the cues to interact with the environment inter/across time scale(s)?A multi-scales analysis framework was proposed based on the prosodic alignment between infants and caregivers in daily interaction. The framework analyzed the day-long audio data from a Tseltal corpus. The results revealed that infants’ and caregivers’ vocalizations are differently coordinated on each timescale, . Furthermore, the same analysis was conducted on a Canadian-English corpus with audio data under similar collection conditions. The results reveal that maternal prosodic alignment occurs in English but not Tseltal, while infant alignment to caregivers is weak but similarly present across cultures. Interestingly, Tseltal dyads were more likely than Canadian ones to show increases in prosodic alignment over longer sequences of interaction. A conference paper and a poster based on these results were presented at (Li, J., et al., ICDL 2022) and (Li, J., et al., SRCD 2023).Current findings stressed that infants received varied auditory cues from the environment on a global, a middle, and a local scale (Q1). Moreover, infants also behave differently, corresponding to these cues across time scales. (Q2)