Vision-Based Target Detection and Localization via a Team of Cooperative UAV and UGVs
Vision-Based Target Detection and Localization via a Team of Cooperative UAV and UGVs
复制标题
DOI:
10.1109/tsmc.2015.2491878
复制
发表时间:
2016-07-01
影响因子:
8.7
通讯作者:
Son, Young-Jun
中科院分区:
文献类型:
--
作者:
Minaeian, Sara;Liu, Jian;Son, Young-Jun
Unmanned vehicles (UVs) play a key role in autonomous surveillance scenarios. A major task needed by these UVs in undertaking autonomous patrol missions is to detect the targets and find their locations in real-time. In this paper, a new vision-based target detection and localization system is presented to make use of different capabilities of UVs as a cooperative team. The scenario considered in this paper is a team of an unmanned aerial vehicle (UAV) and multiple unmanned ground vehicles (UGVs) tracking and controlling crowds on a border area. A customized motion detection algorithm is applied to follow the crowd from the moving camera mounted on the UAV. Due to UAVs lower resolution and broader detection range, UGVs with higher resolution and fidelity are used as the individual human detectors, as well as moving landmarks to localize the detected crowds with unknown independently moving patterns at each time point. The UAVs localization algorithm, proposed in this paper, then converts the crowds' image locations into their real-world positions, using perspective transformation. A rule-of-thumb localization method by a UGV is also presented, which estimates the geographic locations of the detected individuals. Moreover, an agent-based simulation model is developed for system verification, with different parameters, such as flight altitude, number of landmarks, and landmark assignment method. The performance measure considered in this paper is the average Euclidean distance between the estimated locations and simulated geographic waypoints of the crowd. Experimental results demonstrate the effectiveness of the proposed framework for autonomous surveillance by UVs.