Interpretation of environments by incremental learning
通过增量学习解释环境
基本信息
- 批准号:200550554
- 负责人:
- 金额:--
- 依托单位:
- 依托单位国家:德国
- 项目类别:Research Units
- 财政年份:2011
- 资助国家:德国
- 起止时间:2010-12-31 至 2019-12-31
- 项目状态:已结题
- 来源:
- 关键词:
项目摘要
Semantic information is essential to capture and identify inaccessible objects by an autonomous flying vehicle. For instance, it helps to fly with foresight und avoid collisions by identifying objects and anticipating their movements. It improves the 3D reconstruction of the environment by classifying surfaces that are difficult to reconstruct. First and foremost, however, it allows semantic queries by a user that steer the navigation and exploration behavior of a flying vehicle. For inspecting all windows of a building for instance, it is not necessary to reconstruct the entire building, which is time-consuming. Instead, it is sufficient to predict the locations of all observed and unobserved windows based on the current semantic interpretation of the environment. Project P7 aims to extract the necessary information from the incrementally reconstructed environments by machine learning approaches. Since the tasks ranging from semantic collision avoidance to semantic queries have different runtime and complexity requirements for the semantic representation, a multi-layer system will be developed. On the lowest layer image data is classified in real-time, on the highest layer the locations of class instances in an environment are probabilistically predicted, in particular, for regions that have not been explored yet. Since a key aspect of the second stage of the project is the incremental update of the map reconstructed from previous flights, P7 mainly focuses on the development of efficient incremental learning approaches. This is challenging since changes of time and lighting conditions also change the appearance of the training data. Furthermore, it will not be assumed that all classes are known a priori in order to solve complex tasks and to enhance the flexibility of semantic queries. Instead, the user can mark regions in the current map via an intuitive graphical user interface and declare the marked regions as instances of a new class. The goal of P7 is therefore not only the development of classifiers that can be efficiently updated as soon as new training samples of known classes are available, but that also learn efficiently new classes.
语义信息对于自主飞行器捕捉和识别不可接近的物体是必不可少的。例如,它有助于有远见地飞行,并通过识别物体和预测它们的运动来避免碰撞。它通过对难以重建的表面进行分类,改进了环境的3D重建。然而,首先也是最重要的是,它允许用户进行语义查询,以指导飞行器的导航和探索行为。例如,要检查一座建筑的所有窗户,不需要重建整个建筑,这是耗时的。相反,基于环境的当前语义解释来预测所有观察到的和未观察到的窗口的位置就足够了。项目P7旨在通过机器学习的方法从增量重建的环境中提取必要的信息。由于从语义冲突避免到语义查询的任务对语义表示的运行时间和复杂度有不同的要求,因此将开发一个多层系统。在最低层对图像数据进行实时分类,在最高层对环境中的类实例的位置进行概率预测,特别是对于尚未探索的区域。由于该项目第二阶段的一个关键方面是对从以前的飞行重建的地图进行增量更新,因此P7主要侧重于开发有效的增量学习方法。这是具有挑战性的,因为时间和照明条件的变化也改变了训练数据的外观。此外,为了解决复杂任务和增强语义查询的灵活性,不会假设所有类都是先验已知的。相反,用户可以通过直观的图形用户界面标记当前地图中的区域,并将标记的区域声明为新类的实例。因此,P7的目标不仅是开发可以在已知类别的新训练样本可用时立即高效更新的分类器,而且还要高效地学习新类别。
项目成果
期刊论文数量(6)
专著数量(0)
科研奖励数量(0)
会议论文数量(0)
专利数量(0)
3D Semantic Scene Completion from a Single Depth Image Using Adversarial Training
- DOI:10.1109/icip.2019.8803174
- 发表时间:2019-05
- 期刊:
- 影响因子:0
- 作者:Yueh-Tung Chen;Martin Garbade;Juergen Gall
- 通讯作者:Yueh-Tung Chen;Martin Garbade;Juergen Gall
Thinking Outside the Box: Spatial Anticipation of Semantic Categories
跳出框框思考:语义类别的空间预期
- DOI:10.5244/c.31.90
- 发表时间:2017
- 期刊:
- 影响因子:0
- 作者:Garbade
- 通讯作者:Garbade
From categories to subcategories: Large-scale image classification with partial class label refinement
- DOI:10.1109/cvpr.2015.7298619
- 发表时间:2015-06
- 期刊:
- 影响因子:0
- 作者:M. Ristin;Juergen Gall;M. Guillaumin;L. Gool
- 通讯作者:M. Ristin;Juergen Gall;M. Guillaumin;L. Gool
Incremental Learning of Random Forests for Large-Scale Image Classification
- DOI:10.1109/tpami.2015.2459678
- 发表时间:2016-03
- 期刊:
- 影响因子:23.6
- 作者:M. Ristin;M. Guillaumin;Juergen Gall;L. Gool
- 通讯作者:M. Ristin;M. Guillaumin;Juergen Gall;L. Gool
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
数据更新时间:{{ journalArticles.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ monograph.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ sciAawards.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ conferencePapers.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ patent.updateTime }}
Professor Dr. Jürgen Gall其他文献
Professor Dr. Jürgen Gall的其他文献
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
{{ truncateString('Professor Dr. Jürgen Gall', 18)}}的其他基金
PERIAPT: Joint Person Detection, Re-Identification and Pose Tracking in Video
PERIAPT:视频中的联合人员检测、重新识别和姿势跟踪
- 批准号:
410904267 - 财政年份:2019
- 资助金额:
-- - 项目类别:
Research Grants
Anticipating Human Motion and Activities (P3)
预测人体运动和活动(P3)
- 批准号:
332887688 - 财政年份:2017
- 资助金额:
-- - 项目类别:
Research Units
HFVSA: Human Focused Visual Scene Understanding
HFVSA:以人为本的视觉场景理解
- 批准号:
229087185 - 财政年份:2013
- 资助金额:
-- - 项目类别:
Independent Junior Research Groups
Activity Map Completion with Dynamic Objects (P1)
使用动态对象完成活动图(P1)
- 批准号:
333380323 - 财政年份:
- 资助金额:
-- - 项目类别:
Research Units
IP4: Forecasting Phenotypes based on Management Decisions
IP4:基于管理决策预测表型
- 批准号:
498577300 - 财政年份:
- 资助金额:
-- - 项目类别:
Research Units
相似海外基金
Collaborative Research: Maritime to Inland Transitions Towards ENvironments for Convection Initiation (MITTEN CI)
合作研究:海洋到内陆向对流引发环境的转变(MITTEN CI)
- 批准号:
2349935 - 财政年份:2024
- 资助金额:
-- - 项目类别:
Continuing Grant
Collaborative Research: Maritime to Inland Transitions Towards ENvironments for Convection Initiation (MITTEN CI)
合作研究:海洋到内陆向对流引发环境的转变(MITTEN CI)
- 批准号:
2349934 - 财政年份:2024
- 资助金额:
-- - 项目类别:
Continuing Grant
Collaborative Research: Understanding the Influence of Turbulent Processes on the Spatiotemporal Variability of Downslope Winds in Coastal Environments
合作研究:了解湍流过程对沿海环境下坡风时空变化的影响
- 批准号:
2331729 - 财政年份:2024
- 资助金额:
-- - 项目类别:
Continuing Grant
CAREER: Early-life social environments drive behavioral and neural mechanisms of development
职业:早期社会环境驱动行为和神经机制的发展
- 批准号:
2341006 - 财政年份:2024
- 资助金额:
-- - 项目类别:
Continuing Grant
Doctoral Dissertation Research: Do social environments influence the timing of male maturation in a close human relative?
博士论文研究:社会环境是否影响人类近亲的男性成熟时间?
- 批准号:
2341354 - 财政年份:2024
- 资助金额:
-- - 项目类别:
Standard Grant
Stochastic processes in random environments with inhomogeneous scaling limits
具有不均匀缩放限制的随机环境中的随机过程
- 批准号:
24K06758 - 财政年份:2024
- 资助金额:
-- - 项目类别:
Grant-in-Aid for Scientific Research (C)
NESP MaC Project 4.5– Developing an Integrated Pest Management Framework for Feral Pigs in Coastal Environments 2024-2026 (NAILSMA)
NESP MaC 项目 4.5 — 为 2024-2026 年沿海环境中的野猪制定综合害虫管理框架 (NAILSMA)
- 批准号:
global : ba1e00f0-9953-4c17-b990-ba7aed84ce07 - 财政年份:2024
- 资助金额:
-- - 项目类别:
Challenging Health Outcomes/Integrating Care Environments Ph3: A Community Consortium to Tackle Health Disparity for People Living with Mental Illness
挑战健康成果/整合护理环境第三阶段:解决精神疾病患者健康差距的社区联盟
- 批准号:
AH/Z505420/1 - 财政年份:2024
- 资助金额:
-- - 项目类别:
Research Grant
Probabilistic Inference Based Utility Evaluation and Path Generation for Active Autonomous Exploration of USVs in Unknown Confined Marine Environments
基于概率推理的效用评估和路径生成,用于未知受限海洋环境中 USV 主动自主探索
- 批准号:
EP/Y000862/1 - 财政年份:2024
- 资助金额:
-- - 项目类别:
Research Grant
Collaborative Research: Maritime to Inland Transitions Towards ENvironments for Convection Initiation (MITTEN CI)
合作研究:海洋到内陆向对流引发环境的转变(MITTEN CI)
- 批准号:
2349936 - 财政年份:2024
- 资助金额:
-- - 项目类别:
Continuing Grant