Open AccessHow Many Features is an Image Worth? Multi-Channel CNN for Steering Angle Prediction in Autonomous Vehicles
Author(s) -
Jason Munger,
Carlos W. Morato
Publication year - 2021
Language(s) - English
Resource type - Conference proceedings
DOI - 10.5121/csit.2021.111301
Subject(s) - computer science , artificial intelligence , channel (broadcasting) , computer vision , pixel , feature (linguistics) , artificial neural network , image (mathematics) , rgb color model , segmentation , convolutional neural network , image segmentation , deep learning , pattern recognition (psychology) , telecommunications , philosophy , linguistics
This project explores how raw image data obtained from AV cameras can provide a model with more spatial information than can be learned from simple RGB images alone. This paper leverages the advances of deep neural networks to demonstrate steering angle predictions of autonomous vehicles through an end-to-end multi-channel CNN model using only the image data provided from an onboard camera. Image data is processed through existing neural networks to provide pixel segmentation and depth estimates and input to a new neural network along with the raw input image to provide enhanced feature signals from the environment. Various input combinations of Multi-Channel CNNs are evaluated, and their effectiveness is compared to single CNN networks using the individual data inputs. The model with the most accurate steering predictions is identified and performance compared to previous neural networks.