Visual Models - Application to Situational Awareness

我的研究解决了计算机视觉的表示问题，特别是如何从传感器网络捕获信息，并创建真实反映一段时间环境的计算机模型。在这项提案中有3个具体的子项目。第一个涉及为与人类协同工作的机器人助手提供情境感知。对象(人+机器)被表示为铰接式3D模型，实时跟踪它们在现实世界中的对应对象。科学的焦点是如何捕获动态行为并对其进行建模，以便系统能够识别或控制每个乘客的活动。在之前与通用汽车研究的基础上，目标是在机器人助手中嵌入更强大和更可靠的情景感知，从而使实际实施成为可能。如果这一愿景成功，未来的装配线将由人-机器人团队合作制造产品，极大地提高生产率，并使加拿大保持在全球市场上的竞争力。*剩余的两个子项目旨在表示使人类能够更准确地了解他们的环境，并使机器人能够在其中发挥作用。在第一个稀疏数据模型中，我们着眼于如何恢复对感官能力有限的环境的描述。具体的例子是根据物理岩心样本定位地下矿藏，相对于图像中发现的矿藏来说，这些样本非常稀少。我们最近开发了一些新的随机建模技术，这些技术显示了将传统的图像重建算法扩展到这些具有挑战性的数据集的前景。如果成功，这项研究将导致更精确的矿藏定位算法，这反过来可能通过降低挖掘、运输和加工的成本对采矿作业产生重大影响。*最后，深度学习子项目试图利用机器学习领域令人印象深刻的技术进步来确定更适合自然形式的表示。我们的重点是使用卷积深度Boltzman机器网络来实现分层生成模型的实际实现，目标是在显著降低复杂性的情况下获得类似的性能。这项研究将有助于与通用汽车合作，建立能够在恶劣天气条件下的越野环境中运行的传感器系统，以及涉及在缺乏GPS的环境中识别结构和地标的资源行业项目。

My research addresses the problem of representations for computer vision, specifically how to capture information from a sensor network and create computer models that faithfully reflect an environment over time. There are 3 specific sub-projects within this proposal. The first deals with providing situational awareness for a robotic assistant working in conjunction with a human. Objects (humans + machines) are represented as articulated 3D models that track their real world counterparts in real time. The scientific focus is how to capture and model dynamic behavior so that the system can identify or control the activities of each occupant. Following on previous work with GM research, the goal is to embed robotic assistants with more powerful and reliable situational awareness so that practical implementations become possible. If this vision is successful, future assembly lines will be comprised of human-robot teams collaborating to manufacture products, greatly scaling up productivity and allowing Canada to remain competitive in the global marketplace.******The remaining 2 sub-projects are aimed at representations that enable humans to have more precise knowledge about their environments, and robots to be able to function within them. In the first, Sparse Data Models, we look at the problem of how to recover descriptions of an environment with limited sensory ability. The specific example is localizing underground mineral deposits from physical core samples, which are very sparse relative to what one finds in images. We recently have developed some new stochastic modeling techniques that show promise for extending conventional image reconstruction algorithms to these challenging datasets. If successful, this research will lead to more precise algorithms for localizing mineral deposits, which in turn could have a significant impact on mining operations by reducing costs for excavation, transport and processing.******Finally, the Deep Learning sub-project is an attempt to leverage impressive technical progress in machine learning to determine representations that are better suited to natural forms. Our focus is on the practical implementation of Hierarchical Generative Models using Convolutional Deep Boltzman machine networks, with the goal of achieving comparable performance with a substantial reduction in complexity. This research will contribute to work with GM in building sensor systems that can operate in off-road environments under adverse weather conditions, as well as resource industry projects that involve identifying structures and landmarks in GPS-deprived environments.*****