Visual SLAM technology based on weakly supervised semantic segmentation in dynamic environment

Jianxin Liu; Menglan Zeng; Yuchao Wang; Wei Liu

doi:10.1117/12.2580074

12 October 2020 Visual SLAM technology based on weakly supervised semantic segmentation in dynamic environment

Jianxin Liu, Menglan Zeng, Yuchao Wang, Wei Liu

Proceedings Volume 11574, International Symposium on Artificial Intelligence and Robotics 2020; 115740Q (2020) https://doi.org/10.1117/12.2580074
Event: International Symposium on Artificial Intelligence and Robotics (ISAIR), 2020, Kitakyushu, Japan

Abstract

A visual simultaneous localization and mapping(vSLAM) system in a dynamic environment are affected by the wrong associated data caused by the moving targets, which causes error in the pose estimation of the mobile robot. Combining semantic segmentation information to remove dynamic feature points is an effective method to improve the accuracy of the SLAM system. However, the existing semantic visual SLAM usually adopts the fully supervised methods to segment the dynamic scenes. The accuracy of this method relies on a large number of training data sets with annotation information, which limits the application of SLAM system. To address this issue, a visual semantic SLAM system (vsSLAM) that applies weakly supervised semantic segmentation to dynamic scenes is proposed to broaden the application range of the system. Firstly, the system extracts the feature points of input image and checks the moving consistency, and then segments the dynamic target with the weakly supervised methods. Secondly, the semantic segmentation results are used to remove the dynamic feature points in the image. Finally, the system uses stable feature points for pose estimation. this paper also uses the Automatic Color Equalization algorithm to pre-process the input image, which improves the accuracy of weakly supervised semantic segmentation. Experiments were performed on the public TUM data sets and lab environment. The results show that the accuracy of the SLAM system based on the weakly supervised network adopted in our work is better than the traditional ORB-SLAM2 system, and also higher than the SLAM system of the weakly supervised network DSRG. The accuracy is close to the fully supervised semantic SLAM system.

Citation Download Citation

Jianxin Liu, Menglan Zeng, Yuchao Wang, and Wei Liu "Visual SLAM technology based on weakly supervised semantic segmentation in dynamic environment", Proc. SPIE 11574, International Symposium on Artificial Intelligence and Robotics 2020, 115740Q (12 October 2020); https://doi.org/10.1117/12.2580074

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
10 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Image segmentation

Dynamical systems

Target detection

Detection and tracking algorithms

Process modeling

RGB color model

Sensors

Show All Keywords

Keywords/Phrases

Search In:

Publication Years