Search

This research paper focuses on quaternion neural networks (QNNs) - a type of neural network wherein the weights, biases, and input values are all represented as quaternion numbers. Previous studies have shown that QNNs outperform real-valued neural networks in basic tasks and have potential in high-dimensional problem spaces. However, research on QNNs has been fragmented, with contributions from different mathematical and engineering domains leading to unintentional overlap in QNN literature. This work aims to unify existing research by evaluating four distinct QNN backpropagation algorithms, including the novel GHR-calculus backpropagation algorithm, and providing concise, scalable implementations of each algorithm using a modern compiled programming language. Additionally, the authors apply a robust Design of Experiments (DoE) methodology to compare the accuracy and runtime of each algorithm. The experiments demonstrate that the Clifford Multilayer Perceptron (CMLP) learning algorithm results in statistically significant improvements in network test set accuracy while maintaining comparable runtime performance to the other three algorithms in four distinct regression tasks. By unifying existing research and comparing different QNN training algorithms, this work develops a state-of-the-art baseline and provides important insights into the potential of QNNs for solving high-dimensional problems. • Clifford Multilayer Perceptrons outperform other quaternion neural network methods. • Multilayer GHR Calc. networks approximate real nonlinear functions reasonably well. • Classic QNN backpropagation techniques are outdated and should be avoided. [ABSTRACT FROM AUTHOR]

The known Complex Step Derivative (CSD) method allows easy and accurate differentiation up to machine precision of real analytic functions by evaluating them with a small imaginary step next to the real number line. The current paper proposes that derivatives of holomorphic functions can be calculated in a similar fashion by taking a small step in a quaternionic direction instead. It is demonstrated that in so doing the CSD properties of high accuracy and convergence are carried over to derivatives of holomorphic functions. To demonstrate the ease of implementation, numerical experiments were performed using complex quaternions, the geometric algebra of space, and a 2 × 2 matrix representation thereof. [ABSTRACT FROM AUTHOR]