Back to Search
Start Over
Compositionally restricted attention-based network for materials property predictions
- Source :
- npj Computational Materials, Vol 7, Iss 1, Pp 1-10 (2021)
- Publication Year :
- 2021
- Publisher :
- Nature Portfolio, 2021.
-
Abstract
- Abstract In this paper, we demonstrate an application of the Transformer self-attention mechanism in the context of materials science. Our network, the Compositionally Restricted Attention-Based network (CrabNet), explores the area of structure-agnostic materials property predictions when only a chemical formula is provided. Our results show that CrabNet’s performance matches or exceeds current best-practice methods on nearly all of 28 total benchmark datasets. We also demonstrate how CrabNet’s architecture lends itself towards model interpretability by showing different visualization approaches that are made possible by its design. We feel confident that CrabNet and its attention-based framework will be of keen interest to future materials informatics researchers.
Details
- Language :
- English
- ISSN :
- 20573960
- Volume :
- 7
- Issue :
- 1
- Database :
- Directory of Open Access Journals
- Journal :
- npj Computational Materials
- Publication Type :
- Academic Journal
- Accession number :
- edsdoj.84ef20134dd54902b0ccba0b112204ea
- Document Type :
- article
- Full Text :
- https://doi.org/10.1038/s41524-021-00545-1