Back to Search Start Over

DEBI-NN: Distance-encoding biomorphic-informational neural networks for minimizing the number of trainable parameters.

Authors :
Papp, Laszlo
Haberl, David
Ecsedi, Boglarka
Spielvogel, Clemens P.
Krajnc, Denis
Grahovac, Marko
Moradi, Sasan
Drexler, Wolfgang
Source :
Neural Networks. Oct2023, Vol. 167, p517-532. 16p.
Publication Year :
2023

Abstract

Modern artificial intelligence (AI) approaches mainly rely on neural network (NN) or deep NN methodologies. However, these approaches require large amounts of data to train, given, that the number of their trainable parameters has a polynomial relationship to their neuron counts. This property renders deep NNs challenging to apply in fields operating with small, albeit representative datasets such as healthcare. In this paper, we propose a novel neural network architecture which trains spatial positions of neural soma and axon pairs, where weights are calculated by axon-soma distances of connected neurons. We refer to this method as distance-encoding biomorphic-informational (DEBI) neural network. This concept significantly minimizes the number of trainable parameters compared to conventional neural networks. We demonstrate that DEBI models can yield comparable predictive performance in tabular and imaging datasets, where they require a fraction of trainable parameters compared to conventional NNs, resulting in a highly scalable solution. • DEBI-NNs train 3D coordinates of artificial soma and axon pairs. • DEBI-NNs require significantly less parameters to train compared to conventional NNs. • DEBI-NNs yield identical predictive performance results to NNs in medical datasets. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
08936080
Volume :
167
Database :
Academic Search Index
Journal :
Neural Networks
Publication Type :
Academic Journal
Accession number :
173010377
Full Text :
https://doi.org/10.1016/j.neunet.2023.08.026