Back to Search
Start Over
DEBI-NN: Distance-encoding biomorphic-informational neural networks for minimizing the number of trainable parameters.
- Source :
-
Neural Networks . Oct2023, Vol. 167, p517-532. 16p. - Publication Year :
- 2023
-
Abstract
- Modern artificial intelligence (AI) approaches mainly rely on neural network (NN) or deep NN methodologies. However, these approaches require large amounts of data to train, given, that the number of their trainable parameters has a polynomial relationship to their neuron counts. This property renders deep NNs challenging to apply in fields operating with small, albeit representative datasets such as healthcare. In this paper, we propose a novel neural network architecture which trains spatial positions of neural soma and axon pairs, where weights are calculated by axon-soma distances of connected neurons. We refer to this method as distance-encoding biomorphic-informational (DEBI) neural network. This concept significantly minimizes the number of trainable parameters compared to conventional neural networks. We demonstrate that DEBI models can yield comparable predictive performance in tabular and imaging datasets, where they require a fraction of trainable parameters compared to conventional NNs, resulting in a highly scalable solution. • DEBI-NNs train 3D coordinates of artificial soma and axon pairs. • DEBI-NNs require significantly less parameters to train compared to conventional NNs. • DEBI-NNs yield identical predictive performance results to NNs in medical datasets. [ABSTRACT FROM AUTHOR]
- Subjects :
- *ARTIFICIAL intelligence
*AXONS
*MACHINE learning
*NEURONS
Subjects
Details
- Language :
- English
- ISSN :
- 08936080
- Volume :
- 167
- Database :
- Academic Search Index
- Journal :
- Neural Networks
- Publication Type :
- Academic Journal
- Accession number :
- 173010377
- Full Text :
- https://doi.org/10.1016/j.neunet.2023.08.026