CNN-based end-to-end learning for lane centering

Iffat Ara Ebu; Fahmida Islam; John E. Ball; Christopher T. Goodin

doi:10.1117/12.3013541

7 June 2024 CNN-based end-to-end learning for lane centering

Iffat Ara Ebu, Fahmida Islam, John E. Ball, Christopher T. Goodin

Proceedings Volume 13052, Autonomous Systems: Sensors, Processing, and Security for Ground, Air, Sea, and Space Vehicles and Infrastructure 2024; 130520G (2024) https://doi.org/10.1117/12.3013541
Event: SPIE Defense + Commercial Sensing, 2024, National Harbor, Maryland, United States

Abstract

Lane centering is a significant feature in the automotive industry and an important feature for advanced or autonomous vehicles, providing assistance to help drivers stay in their lane. The objective of this work is to utilize camera images which are processed by a lane-centering algorithm to make steering decisions. A model with a convolutional neural network (CNN) algorithm is used and simulated datasets are trained and tested. The goal is to make the program learn how to steer the vehicle autonomously and achieve end-to-end learning for steering command generation. The CNN can map raw pixels from cameras directly to steering commands without any intermediate feature engineering. A model is utilized which is created by NVIDIA researchers called the NVIDIA PilotNet. This network comprises five convolutional layers for feature extraction, followed by three fully connected layers for predicting the steering commands. The model is trained using two different sets of data to see how well the model performs with different types of data. The first set comes from Udacity’s Self-Driving Car Nanodegree Program, which uses their open-source Vehicle Simulation. Secondly, a dataset from the Mississippi State University Autonomous Vehicular Simulator (MAVS) is used. The training process involves reducing the error between predicted steering angles and the actual steering commands logged by the car. After the model has been trained, it is implemented for testing the car’s autonomous capabilities within the Self Driving Car Nanodegree Program Simulation. In this mode, the car demonstrates the ability to effectively track and navigate along the road lanes.

Conference Presentation

Citation Download Citation

Iffat Ara Ebu, Fahmida Islam, John E. Ball, and Christopher T. Goodin "CNN-based end-to-end learning for lane centering", Proc. SPIE 13052, Autonomous Systems: Sensors, Processing, and Security for Ground, Air, Sea, and Space Vehicles and Infrastructure 2024, 130520G (7 June 2024); https://doi.org/10.1117/12.3013541

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available