ReLU, Sparseness, and the Encoding of Optic Flow in Neural Networks.

Bibliographic Details
Title: ReLU, Sparseness, and the Encoding of Optic Flow in Neural Networks.
Authors: Layton, Oliver W.1 (AUTHOR) oliver.layton@colby.edu, Peng, Siyuan1,2 (AUTHOR), Steinmetz, Scott T.3 (AUTHOR) ststein@sandia.gov
Source: Sensors (14248220). Dec2024, Vol. 24 Issue 23, p7453. 25p.
Subject Terms: *OPTICAL flow, *MULTILAYER perceptrons, *CONVOLUTIONAL neural networks, *DEEP learning, *ROBOTICS
Abstract: Accurate self-motion estimation is critical for various navigational tasks in mobile robotics. Optic flow provides a means to estimate self-motion using a camera sensor and is particularly valuable in GPS- and radio-denied environments. The present study investigates the influence of different activation functions—ReLU, leaky ReLU, GELU, and Mish—on the accuracy, robustness, and encoding properties of convolutional neural networks (CNNs) and multi-layer perceptrons (MLPs) trained to estimate self-motion from optic flow. Our results demonstrate that networks with ReLU and leaky ReLU activation functions not only achieved superior accuracy in self-motion estimation from novel optic flow patterns but also exhibited greater robustness under challenging conditions. The advantages offered by ReLU and leaky ReLU may stem from their ability to induce sparser representations than GELU and Mish do. Our work characterizes the encoding of optic flow in neural networks and highlights how the sparseness induced by ReLU may enhance robust and accurate self-motion estimation from optic flow. [ABSTRACT FROM AUTHOR]
Copyright of Sensors (14248220) is the property of MDPI and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Academic Search Complete
Full text is not displayed to guests.
More Details
ISSN:14248220
DOI:10.3390/s24237453
Published in:Sensors (14248220)
Language:English