Back to Search Start Over

Masked pretraining strategy for neural potentials.

Masked pretraining strategy for neural potentials.

Authors :
Zhang, Zehua
Li, Zijie
Barati Farimani, Amir
Source :
AIP Advances; Sep2024, Vol. 14 Issue 9, p1-10, 10p
Publication Year :
2024

Abstract

We propose a masked pretraining method for Graph Neural Networks (GNNs) to improve their performance on fitting potential energy surfaces, particularly in water and small organic molecule systems. GNNs are pretrained by recovering the spatial information of masked-out atoms from molecules selected with certain ratios and then transferred and fine-tuned on atomic force fields. Through such pretraining, GNNs learn meaningful prior about the structural and underlying physical information of molecule systems that are useful for downstream tasks. With comprehensive experiments and ablation studies, we show that the proposed method improves both the accuracy and convergence speed of GNNs compared to their counterparts trained from scratch or with other pretraining techniques. This approach showcases its potential to enhance the performance and data efficiency of GNNs in fitting molecular force fields. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
21583226
Volume :
14
Issue :
9
Database :
Complementary Index
Journal :
AIP Advances
Publication Type :
Academic Journal
Accession number :
180117146
Full Text :
https://doi.org/10.1063/5.0202647