Smart vision-based monitoring system for heavy construction and surface mining jobsites

适用于重型建筑和露天采矿作业现场的智能视觉监控系统

• 批准号: RGPIN-2015-03812
• 负责人: RezazadehAzar, Ehsan
• 金额: $ 1.68万
• 依托单位: Lakehead University
• 依托单位国家: 加拿大
• 项目类别: Discovery Grants Program - Individual
• 财政年份: 2018
• 资助国家: 加拿大
• 起止时间: 2018-01-01 至 2019-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=663270
• 关键词: Smart; vision; based; monitoring; system

Construction operations, like other industrial and service processes, require real-time feedback systems to measure key performance indicators, such as productivity, and to take steps to correct problems that interfere with efficient operations. Currently, automated systems are broadly used in many industries and services and have improved productivity substantially. However, the construction industry has been slow to adopt automation. To develop effective automated feedback systems, researchers have tested different sensing technologies to monitor workers and equipment in the uniquely rugged environment of construction jobsites. Earthmoving projects, such as highway construction and surface mining operations, have been a primary initial focus in the industry for developing automated sensing systems. However, monitoring different types of equipment in a dynamic environment is a challenge; systems are challenged to understand the context of a construction site. For example, hydraulic excavators can take any number of shapes, which strains the ability of software to classify the actions of the equipment. Low-cost digital cameras, combined with promising advances in computer vision, make vision-based systems likely candidates for solutions in construction operations. The current systems using vision-based algorithms to monitor heavy operations, however, aren't ideal and require some level of human intervention to operate successfully. For instance, they are not able to understand the scene and the user must determine the action type to be monitored; also, the user has to set the viewfinder of the camera on the operation of interest. The objective of this research program is to bridge the gap between theoretical computer vision and machine learning algorithms on one hand, and practical applications on the other, to develop a generic smart vision-based system to measure the productivity of earthmoving processes in construction and surface mining jobsites. Beyond object recognition and tracking, the proposed research program will investigate development of algorithms for action recognition and understanding the scene based on identified actions, automated control of panning and zooming features of a camera, proactive control of a network of cameras (including the ability to transfer tracking among cameras in the network), productivity estimation, deviation detection, and integration of developed modules. The final result will be an automated framework capable of tracking different kinds of machinery in different types of construction environments. ***This research plan could potentially transform earthmoving monitoring, making it an automated knowledge-based practice and leading to productivity increases, cost savings, improvement in the competitiveness of Canadian mining and heavy civil sectors, and reduction of greenhouse gas emissions of these operations. **

与其他工业和服务流程一样，建筑运营需要实时反馈系统来衡量关键绩效指标，如生产率，并采取措施纠正干扰高效运营的问题。目前，自动化系统广泛应用于许多行业和服务，并大大提高了生产力。然而，建筑业在采用自动化方面进展缓慢。为了开发有效的自动反馈系统，研究人员测试了不同的传感技术，以监测建筑工地独特的恶劣环境中的工人和设备。土方工程，如公路建设和露天采矿作业，一直是该行业开发自动传感系统的主要初始焦点。然而，在动态环境中监控不同类型的设备是一项挑战;系统面临着理解施工现场环境的挑战。例如，液压挖掘机可以采用任何数量的形状，这会使软件对设备动作进行分类的能力受到限制。低成本的数码相机，加上计算机视觉的进步，使基于视觉的系统成为建筑运营解决方案的可能候选者。然而，目前使用基于视觉的算法来监控繁重操作的系统并不理想，需要一定程度的人为干预才能成功操作。例如，他们不能理解场景，用户必须确定要监视的动作类型;此外，用户必须将相机的取景器设置在感兴趣的操作上。本研究项目的目标是一方面弥合理论计算机视觉和机器学习算法与实际应用之间的差距，开发一个通用的基于智能视觉的系统来测量建筑和露天采矿作业现场土方工程的生产率。除了对象识别和跟踪之外，拟议的研究计划将研究基于已识别的动作的动作识别和理解场景的算法的开发，摄像机的平移和缩放功能的自动控制，摄像机网络的主动控制（包括在网络中的摄像机之间转移跟踪的能力），生产力估计，偏差检测以及开发模块的集成。最终的结果将是一个自动化框架，能够在不同类型的施工环境中跟踪不同类型的机械。* 这项研究计划可能会改变土方监测，使其成为一种基于知识的自动化实践，从而提高生产力，节省成本，提高加拿大采矿和重型民用部门的竞争力，并减少这些业务的温室气体排放。**