Computationally analyzing the hierarchical complexity of infants' social coordination on multi scales in natural daily life to investigate infants' cognitive development

计算分析自然日常生活中婴儿多尺度社会协调的层次复杂性，以研究婴儿的认知发展

• 批准号: 22K20314
• 负责人: Li Jiarui
• 金额: $ 1.5万
• 依托单位: The University of Tokyo
• 依托单位国家: 日本
• 项目类别: Grant-in-Aid for Research Activity Start-up
• 财政年份: 2022
• 资助国家: 日本
• 起止时间: 2022-08-31 至 2024-03-31
• 项目状态: 已结题
• 来源: https://kaken.nii.ac.jp/en/grant/KAKENHI-PROJECT-22K20314/
• 关键词: multi-scale coordination; infant daily interaction; culture differences; Social interaction; Infants development; Multi-scale analysis

This project aims at quantifying social modalities and multi-scales to find the multi-combining computational mechanisms in infants’ interactive development. The current achievements focused on the first two of the three research questions: Q1. What cues in which modality do infants accept from the social-interactive environment in which time scale? Q2. How do infants manage the cues to interact with the environment inter/across time scale(s)?A multi-scales analysis framework was proposed based on the prosodic alignment between infants and caregivers in daily interaction. The framework analyzed the day-long audio data from a Tseltal corpus. The results revealed that infants’ and caregivers’ vocalizations are differently coordinated on each timescale, . Furthermore, the same analysis was conducted on a Canadian-English corpus with audio data under similar collection conditions. The results reveal that maternal prosodic alignment occurs in English but not Tseltal, while infant alignment to caregivers is weak but similarly present across cultures. Interestingly, Tseltal dyads were more likely than Canadian ones to show increases in prosodic alignment over longer sequences of interaction. A conference paper and a poster based on these results were presented at (Li, J., et al., ICDL 2022) and (Li, J., et al., SRCD 2023).Current findings stressed that infants received varied auditory cues from the environment on a global, a middle, and a local scale (Q1). Moreover, infants also behave differently, corresponding to these cues across time scales. (Q2)

本研究旨在通过对社会模式和多尺度的量化研究，寻找婴儿互动发展中的多元组合计算机制。目前的成果主要集中在三个研究问题中的前两个：Q1。在什么样的时间尺度上，婴儿接受来自社会互动环境的什么样的通道？Q2.婴儿如何处理与环境互动的线索跨时间尺度？基于婴儿与照顾者在日常互动中的韵律对齐，提出了一个多尺度分析框架。该框架分析了来自Tseltal语料库的一天的音频数据。结果显示，婴儿和照顾者的发声在每个时间尺度上的协调程度不同。此外，在相似的收集条件下，对具有音频数据的英汉语料库进行了相同的分析。结果表明，母亲的韵律对齐发生在英语，但不Tseltal，而婴儿对齐照顾者是弱的，但同样存在跨文化。有趣的是，Tseltal二对更有可能比加拿大的韵律对齐更长的序列的相互作用，以显示增加。基于这些结果的会议论文和海报在（Li，J.，例如，ICDL 2022）和（Li，J.，例如，目前的研究结果强调，婴儿从环境中接受不同的听觉线索，在全球范围内，中间，和本地规模（Q1）。此外，婴儿的行为也不同，对应于这些线索在不同的时间尺度。（Q2）

项目成果

Multi-scale analysis of vocal coordination in infant-caregiver daily interaction

婴儿与护理人员日常互动中声音协调的多尺度分析

• 发表时间: 2022
• 作者: 藤本花音;蘆田宏;Jiarui Li
• 通讯作者: Jiarui Li

Infant-Caregiver Vocal Coordination in Daily Interaction in Tseltal and Canadian English

采尔塔尔语和加拿大英语日常互动中婴儿与看护者的声音协调

• 发表时间: 2023
• 作者: 野間紘久;大井瞳;山本浩彰;窪田恵美;田中春仁;宮崎友里;井上真里;新川瑤子;大塚公美子;高階光梨;中島俊;久我弘典;横井良典;横井良典;Jiarui Li
• 通讯作者: Jiarui Li