Scene Processing With Machine Learnable and Semantically Parametrized Representations RENEWAL

使用机器学习和语义参数化表示进行场景处理 RENEWAL

• 批准号: MR/Y033884/1
• 负责人: Ahmet Oztireli
• 金额: $ 75.36万
• 依托单位: University of Cambridge
• 依托单位国家: 英国
• 项目类别: Fellowship
• 财政年份: 2025
• 资助国家: 英国
• 起止时间: 2025 至 无数据
• 项目状态: 未结题
• 来源: https://gtr.ukri.org/projects?ref=MR%2FY033884%2F1
• 关键词: Scene; Processing; Machine; Learnable; Semantically

Generative artificial intelligence has made a significant leap in developing intuitive natural language based computer interfaces via large language models, and realistic image and video generation from text inputs. These have already started revolutionising creation and editing of code, text, images, videos, presentations, and many other digital media. We will extend these techniques to scene creation and processing by relying on the techniques we have been developing over the years. We will develop text-to-scene models for easy creation, intuitive control, and conversational capture of 3D objects and scenes. We will deploy these models to the new generation of extended reality devices with advanced displays, optics, sensors, and processing units to build a scene creation and editing system that uses voice and brain signals as inputs.

生成式人工智能在通过大型语言模型开发直观的基于自然语言的计算机界面以及从文本输入生成逼真的图像和视频方面取得了重大飞跃。这些技术已经开始革新代码、文本、图像、视频、演示文稿和许多其他数字媒体的创建和编辑。我们将这些技术扩展到场景的创建和处理，依靠我们多年来一直在开发的技术。我们将开发文本到场景模型，以便轻松创建，直观控制和对话捕捉3D对象和场景。我们将这些模型部署到具有先进显示器、光学、传感器和处理单元的新一代扩展现实设备中，以构建使用语音和大脑信号作为输入的场景创建和编辑系统。