AUTHOR=Zhou Yimin , Yu Zhixiong , Ma Zhuang 

TITLE=UAV Based Indoor Localization and Objection Detection

JOURNAL=Frontiers in Neurorobotics

VOLUME=Volume 16 - 2022

YEAR=2022

URL=https://www.frontiersin.org/journals/neurorobotics/articles/10.3389/fnbot.2022.914353

DOI=10.3389/fnbot.2022.914353

ISSN=1662-5218

ABSTRACT=This paper aims to target fast indoor positioning and 3D target detection for unmanned aerial vehicle (UAV) real-time task implementation. With the combined direct method and feature method, a method is proposed for fast and accurate position estimation of UAV. The camera pose is estimated by the visual odometer via the photometric error between the frames. The ORB features are then extended from the keyframes for the map consistency improvement by Bundle Adjustment with local and global optimization. A depth filter is also applied to assist the convergence of the map points with  depth information update from multiple frames. Moreover, the convolutional neural network is used to detect the specific target in an unknown space, while YOLOv3 is applied to obtain the semantic information of the target in the images. Thus the spatial map points of the feature in the keyframes can be associated with the target detection box, while the statistical outlier filter can be simultaneously applied to eliminate the noise points. Experiments with public dataset and field experiments on the UAV platform in indoor environments have been carried out for visual based fast localization and object detection in real-time to prove the efficacy of the proposed method.