Back to Search Start Over

Consistent treatment of incompletely converged iterative linear solvers in reverse-mode algorithmic differentiation.

Authors :
Akbarzadeh, Siamak
Hückelheim, Jan
Müller, Jens-Dominik
Source :
Computational Optimization & Applications; Nov2020, Vol. 77 Issue 2, p597-616, 20p
Publication Year :
2020

Abstract

Algorithmic differentiation (AD) is a widely-used approach to compute derivatives of numerical models. Many numerical models include an iterative process to solve non-linear systems of equations. To improve efficiency and numerical stability, AD is typically not applied to the linear solvers. Instead, the differentiated linear solver call is replaced with hand-produced derivative code that exploits the linearity of the original call. In practice, the iterative linear solvers are often stopped prematurely to recompute the linearisation of the non-linear outer loop. We show that in the reverse-mode of AD, the derivatives obtained with partial convergence become inconsistent with the original and the tangent-linear models, resulting in inaccurate adjoints. We present a correction term that restores consistency between adjoint and tangent-linear gradients if linear systems are only partially converged. We prove the consistency of this correction term and show in numerical experiments that the accuracy of adjoint gradients of an incompressible flow solver applied to an industrial test case is restored when the correction term is used. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
09266003
Volume :
77
Issue :
2
Database :
Complementary Index
Journal :
Computational Optimization & Applications
Publication Type :
Academic Journal
Accession number :
145950077
Full Text :
https://doi.org/10.1007/s10589-020-00214-x