Telecommunications and Computer Vision Convergence Tools for Research Infrastructures (CONVERGE)

研究基础设施的电信和计算机视觉融合工具 (CONVERGE)

• 批准号: 10051462
• 金额: $ 53.86万
• 依托单位: QUEEN'S UNIVERSITY OF BELFAST
• 依托单位国家: 英国
• 项目类别: EU-Funded
• 财政年份: 2023
• 资助国家: 英国
• 起止时间: 2023 至 无数据
• 项目状态: 未结题
• 来源: https://gtr.ukri.org/projects?ref=10051462
• 关键词: Telecommunications; Computer; Vision; Convergence; Tools

Telecommunications and computer vision have evolved as separate scientific areas. This is envisioned to change with the advent of wireless communications with radios characterised by line-of-sight ranges which could benefit from visual data to predict the wireless channel dynamics. Computer vision applications will also become more robust if helped by radio-based imaging. This new joint research field relies on wireless communications, computer vision, sensing and machine learning, and it has a high innovation potential because of the large domain of innovative applications it enables and the relevant know-how available in Europe. However, the full potential of this new area can only be evaluated if adequate Research Infrastructures (RI) and tools are available. The main objective of the CONVERGE project is the development of an innovative toolset aligned with the motto “view-to-communicate and communicate-to-view”. This toolset is a world-first and consists of vision-aided large intelligentsurfaces, vision-aided fixed and mobile base stations, a vision-radio simulator and 3D environment modeler, and machine learning algorithms for multimodal data including radio signals, video streams, RF sensing, and traffic traces. This toolset will be deployed into 7 RIs mostly aligned with the ESFRI SLICES-RI and improve their competitiveness. CONVERGE will also provide the scientific community with open datasets of experimental and simulated data obtained with the toolset in the RIs, meet scientific and industrial requirements by addressing relevant 6G verticals, enhance the competitiveness of the involved companies, extend the European influence to world-wide recognised RIs, enable the creation of new RIs, contribute to the development of new environment-friendly tools, and help European Union to address its societal challenges.

电信和计算机视觉已经发展成为独立的科学领域。这被设想为随着无线通信的出现而改变，无线电的特征在于视线范围，其可以受益于视觉数据来预测无线信道动态。如果有基于无线电的成像的帮助，计算机视觉应用也将变得更加强大。这一新的联合研究领域依赖于无线通信、计算机视觉、传感和机器学习，由于其能够实现的创新应用领域广阔，以及欧洲可用的相关专业知识，因此具有很高的创新潜力。然而，只有在有足够的研究机构和工具的情况下，才能评估这一新领域的全部潜力。CONVERGE项目的主要目标是开发一个符合“视图到通信和通信到视图”座右铭的创新工具集。该工具集是世界上第一个，包括视觉辅助大型智能地面、视觉辅助固定和移动的基站、视觉无线电模拟器和3D环境建模器，以及用于多模态数据（包括无线电信号、视频流、RF传感和交通轨迹）的机器学习算法。该工具集将部署到7个主要与ESFRI SLICES-RI一致的RI中，并提高其竞争力。CONVERGE还将为科学界提供使用RI中的工具集获得的实验和模拟数据的开放数据集，通过解决相关的6 G垂直领域来满足科学和工业要求，提高相关公司的竞争力，将欧洲的影响力扩展到全球公认的RI，创建新的RI，为开发新的环保工具做出贡献，并帮助欧盟应对其社会挑战。