Embodied Social Experiences in Hybrid Shared Spaces

SHARESHARESPACE将展示一种全新的技术，用于促进延展实境（XR）共享混合空间（SHS）中的道德和社会互动，以人类感觉运动交流为基础。我们的核心概念是识别和分割社会感觉运动基元，并在混合环境中重建它们，以建立连续的，具身的，丰富的人类化身体验。为了实现这一目标，将实现三个相互关联的科学技术突破：新颖的计算认知架构，独特的自校准身体传感器网络，以及完全移动的空间增强现实（AR）和虚拟人渲染。我们将创建一个社会运动原语库，并使用它们来设计我们的人工智能体的基于AI的架构。SHARESPACE移动的捕捉技术联合收割机结合了对全身运动学、手部姿势和面部表情的松散耦合视觉惯性跟踪，结合了新颖的神经编码/解码功能，以及本地上下文感知动画和高度逼真的神经渲染。我们的技术将在2个涉及人类和人工智能体在SHS中交互的原则证明和3个健康，体育和艺术的真实用例场景中进行迭代测试。我们将展示一个针对智能体个性化特征（性别，文化和社会倾向）的SHARESPACE全功能原型。SHARESPACE将通过具体举措支持社区建设和开发，包括（i）围绕我们的研究和创新的公众参与，（ii）促进高科技创新和早期转移到我们的深科技公司，作为巩固以人为本和主权欧洲市场领域的前提，如工业AR和SHS，电子健康和远程医疗。我们的长期愿景是通过重建感官运动原语，使社会互动的道德，信任和包容性模式，将XR带到一个全新的存在和社交水平

SHARESHARESPACE will demonstrate a radically new technology for promoting ethical and social interaction in eXtended Reality (XR) Shared Hybrid Spaces (SHS), anchored in human sensorimotor communication. Our core concept is to identify and segment social sensorimotor primitives and reconstruct them in hybrid settings to build continuous, embodied, and rich human- avatar experiences. To achieve this, three interconnected science-towards-technology breakthroughs will be delivered: novel computational cognitive architectures, a unique self-calibrating body sensor network, and a fully mobile spatial Augmented Reality (AR) and virtual human rendering. We will create a library of social motion primitives and use them to design AI-based architectures of our artificial agents. SHARESPACE mobile capturing technologies combine loosely-coupled visual-inertial tracking of full body kinematic, hand pose and facial expression, incorporating novel neural encoding/decoding functionalities, together with local context-aware animations and highly realistic neural rendering. Our technology will be iteratively tested in 2 Proofs-of-principles involving human and artificial agents interacting in SHS, and 3 real-world use case scenarios in Health, Sport and Art. We will demonstrate a fully functional prototype of SHARESPACE tailored to the agents’ personalized characteristics (gender, culture, and social dispositions). SHARESPACE will support community-building and exploitation with concrete initiatives, including (i) public engagement around our research and innovation, (ii) promoting high-tech innovation and early transfer to our deep-tech companies, as premises for the consolidation of human-centric and sovereign European market areas such Industry AR and SHS, eHealth and tele-Health. Our long-term vision is to bring XR to a radically new level of presence and sociality by reconstructing sensorimotor primitives that enable ethical, trusted and inclusive modes of social interaction