ITR - Remote Reality: 4-D Audio-Visual Reconstruction and Compression from Multiple Sensors

ITR - 远程现实：来自多个传感器的 4D 视听重建和压缩

• 批准号: 0312432
• 负责人: Douglas Jones
• 金额: $ 32.67万
• 依托单位: University of Illinois at Urbana-Champaign
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2003
• 资助国家: 美国
• 起止时间: 2003-07-15 至 2007-06-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0312432&HistoricalAwards=false
• 关键词: ITR; Remote; Reality; Audio; Visual

Abstract0312432Douglas JonesU of Illinois, Urbana-ChampaignCurrent audiovisual recording, communication, and playback provides a single, two-dimensional perspectiveof the world as it varies through time. Humans live in a \four-dimensional" world, in which they move about(in 3-D space over time) at their own volition to experience the world from any perspective. Advances insensor, computer, and networking technologies now make possible new systems that employ multiple cam-eras and microphones together with sophisticated processing algorithms to deliver unprecedented immersiverecording and viewing capabilities. Sufficient sensing, networking, and computing power to practically ad-dress this vision already exists; the critical gap in achieving it is the lack of the necessary signal processingtheory and algorithms.This research will develop new signal processing techniques for reconstruction of the audio and visualrecording at an arbitrary location in space and time from multiple acoustic and video sensors, by extendingrecent research in adaptive beamforming, multisensor signal processing of non-stationary signals, and fun-damental new advances in multi-dimensional signal representation. Practical four-dimensional audiovisualrecording, transmission, and playback, or \remote reality", will be demonstrated with low-cost, conven-tional sensors attached to networked computers, thus confirming the practicality of the proposed methodsand applications.

伊利诺伊州的Abstract0312432Douglas Jonesu，Urbana-Champaigncurrent的录音，通信和播放，随着时间的流逝，世界各地都提供了一个单一的，二维的视角。人类生活在一个\四维的“世界中，他们在自己的意志上（在3D空间中）从任何角度来体验世界。进步，现在可以使用多个CAM-EREAS和MICROPHONE的新系统，使得与无效的电脑和无效的无性化和无效的综合性化合物，可以采用多个cam-Eras和Microphone的新系统，并提供了型号的算法。实际上，这种愿景已经存在；多维信号表示的新进展。