Back to Search Start Over

Neuromorphic overparameterisation and few-shot learning in multilayer physical neural networks

Authors :
Kilian D. Stenning
Jack C. Gartside
Luca Manneschi
Christopher T. S. Cheung
Tony Chen
Alex Vanstone
Jake Love
Holly Holder
Francesco Caravelli
Hidekazu Kurebayashi
Karin Everschor-Sitte
Eleni Vasilaki
Will R. Branford
Source :
Nature Communications, Vol 15, Iss 1, Pp 1-15 (2024)
Publication Year :
2024
Publisher :
Nature Portfolio, 2024.

Abstract

Abstract Physical neuromorphic computing, exploiting the complex dynamics of physical systems, has seen rapid advancements in sophistication and performance. Physical reservoir computing, a subset of neuromorphic computing, faces limitations due to its reliance on single systems. This constrains output dimensionality and dynamic range, limiting performance to a narrow range of tasks. Here, we engineer a suite of nanomagnetic array physical reservoirs and interconnect them in parallel and series to create a multilayer neural network architecture. The output of one reservoir is recorded, scaled and virtually fed as input to the next reservoir. This networked approach increases output dimensionality, internal dynamics and computational performance. We demonstrate that a physical neuromorphic system can achieve an overparameterised state, facilitating meta-learning on small training sets and yielding strong performance across a wide range of tasks. Our approach’s efficacy is further demonstrated through few-shot learning, where the system rapidly adapts to new tasks.

Subjects

Subjects :
Science

Details

Language :
English
ISSN :
20411723
Volume :
15
Issue :
1
Database :
Directory of Open Access Journals
Journal :
Nature Communications
Publication Type :
Academic Journal
Accession number :
edsdoj.1b9a5b0ed0ff4844bcb8ea4ebed5879d
Document Type :
article
Full Text :
https://doi.org/10.1038/s41467-024-50633-1