Development of machine learning methods to support collaboration in a neurodiverse team at work

开发机器学习方法以支持神经多元化团队在工作中的协作

• 批准号: 10432554
• 负责人: Sun Wook Kim
• 金额: $ 7.11万
• 依托单位: VIRGINIA POLYTECHNIC INST AND ST UNIV
• 依托单位国家: 美国
• 财政年份: 2022
• 资助国家: 美国
• 起止时间: 2022-05-15 至 2024-04-30
• 项目状态: 已结题
• 来源: https://reporter.nih.gov/project-details/10432554
• 关键词: Adopted; Affect; Artificial Intelligence; Attention; Behavior; Behavioral; Characteristics; Classification; Cognitive; Collaborations; Communication; Complex; Data; Development; Dictionary; Dimensions; Emotional; Employment; Environment; Exhibits; Face; Facial Expression; Foundations; Future; Goals; Guidelines; Independent Living; Individual; Label; Learning; Machine Learning; Measures; Methods; Modeling; Movement; Neurologic; Occupations; Pattern; Persons; Physiological; Prevalence; Problem Solving; Process; Property; Public Sector; Research; Robot; Self-Injurious Behavior; Social intelligence; Support System; System; Technology; Unemployment; Validation; Work; Workplace; adult with autism spectrum disorder; autism spectrum disorder; autistic; autistic children; base; cognitive function; design; experience; heart rate monitor; improved; individuals with autism spectrum disorder; innovation; long short term memory network; machine learning algorithm; machine learning method; markov model; member; multimodal data; sensor; skills; social; social communication; tool; virtual; virtual reality

Project Summary/Abstract Managing growing diversity is an ongoing challenge and opportunity for the U.S. public sector. Public attention to the neurodiversity movement, recognizing neurological differences as the identity of an individual, has been growing over the years. Yet, it is still uncertain how to promote and support this new dimension of diversity especially in the workplace. Adults with autism spectrum disorder (ASD) are substantially underrepresented in the workplace. Emerging work tools and technologies (e.g., collaborative robots, virtual reality [VR]) embedded with artificial intelligence (AI)/machine learning (ML) are greatly affecting fundamental skills required for current and future jobs. Such skills include problem solving, collaboration, social intelligence, and communication. Autistic individuals generally show differences in these and related skills, and have continued to experience barriers in finding and maintaining employment. Our long-term goal is to promote effective collaboration and communication between autistic adults and their coworkers in the workplace. In this project, we will (1) leverage an ML approach to recognize and classify physiological, cognitive, behavioral, emotional, and engagement states of neurodivergent individuals during a collaborative in- person task and (2) learn and predict the dynamics of collaborative behavioral patterns during complex problem solving exhibited in a remote work setting. In Aim 1, to understand collaboration processes and strategies of a neurodiverse team, we will conduct a lab study that involves a simulated assembly task using LEGO® blocks. Multimodal data (e.g., physiological synchrony, facial expression) from each member of three different dyadic teams (autistic-autistic, autistic-nonautistic, and nonautistic-nonautistic) will be collected. Detailed labels (for ML algorithms) will be developed to reflect underlying properties of collaborative processes, and strategies (e.g., sequences of processes) will be modeled with a Hidden Markov model (HMM). In Aim 2, a virtual LEGO® assembly task will be performed by dyadic teams to examine the ML-based approach (developed in Aim 1) in a remote work setting. Completing this developmental project will establish a foundation for future efforts to extend relevant research capabilities and innovative research, such as the advancement of workplace design guidelines and technology, to promote and support an effective neurodiverse workplace.

项目概要/摘要 管理日益增长的多样性对美国公共部门来说是一个持续的挑战和机遇。 公众对神经多样性运动的关注，认识到神经学差异是 个人的身份，多年来一直在增长。但仍不确定如何 促进和支持这种新的多样性，特别是在工作场所。 患有自闭症谱系障碍 (ASD) 的成年人在 工作场所。新兴工作工具和技术（例如协作机器人、虚拟现实 [VR]） 嵌入人工智能（AI）/机器学习（ML）正在极大地影响 当前和未来工作所需的基本技能。这些技能包括解决问题、 协作、社交智能和沟通。自闭症患者通常会表现出 这些技能和相关技能之间存在差异，并且在寻找和 保就业。我们的长期目标是促进有效的合作和 自闭症成人与工作场所同事之间的沟通。在这个项目中，我们 将 (1) 利用机器学习方法来识别和分类生理、认知、行为、 神经分歧个体在协作过程中的情绪和参与状态 人员任务和（2）学习和预测协作行为模式的动态 远程工作环境中表现出复杂的问题解决能力。 在目标 1 中，为了了解神经多元化团队的协作流程和策略，我们将 进行一项实验室研究，其中涉及使用乐高®积木进行模拟组装任务。多式联运 来自三个不同成员的每个成员的数据（例如，生理同步性、面部表情） 将收集二元团队（自闭症-自闭症、自闭症-非自闭症和非自闭症-非自闭症）。 将开发详细的标签（用于 ML 算法）以反映 协作流程和策略（例如流程序列）将使用以下模型进行建模 隐马尔可夫模型（HMM）。在目标 2 中，虚拟乐高®组装任务将由 双元团队在远程工作环境中检查基于 ML 的方法（在目标 1 中开发）。 完成该开发项目将为未来的扩展奠定基础 相关研究能力和创新研究，例如工作场所的进步 设计指南和技术，以促进和支持有效的神经多元化工作场所。