A knowledge distillation based cross-modal learning framework for the lithium-ion battery state of health estimation

The accurate prediction of a lithium-ion battery’s State of Health is of critical importance for efficient battery health management. Existing data-driven estimation methodologies grapple with issues such as high model complexity and a dearth of guidance from prior knowledge, which impose constraints on their efficacy. This work introduces a novel cross-modal distillation network for battery State of Health estimation, structured around a TransformerEncoder as the teacher network and a Convolutional Neural Network as the student network. Initially, the teacher model is pre-trained offline using State of Health degradation data to learn the degradation patterns. The directly measurable feature data (such as voltage, temperature, and current) is subsequently fed into the student network for online training and computation of a hard loss. the student network’s output is then directed into the pre-trained the teacher network to compute a soft loss, thereby offering prior knowledge of degradation laws and steering the optimization process of the student network. Rigorous experiments are conducted utilizing various datasets, with the outcomes validating the superior estimation accuracy and degradation rule adherence of the model. Notably, among five different models, this model demonstrates the best performance on almost all datasets, achieving an RMSE of 0.0097 and an MAE of 0.0065 on Cell1 of the Oxford dataset. Moreover, the model also demonstrates robust performance across different usage scenarios, inclusive of multi-battery estimation. Furthermore, this paper also introduces a fine tuning method for State of Health predictions only using the first half of the data. Comparative analysis with other models underscores the competitiveness of the proposed model, showcasing its potential for broader application.