1. Magnushammer: A Transformer-based Approach to Premise Selection
- Author
-
Mikuła, Maciej, Antoniak, Szymon, Tworkowski, Szymon, Jiang, Albert Qiaochu, Zhou, Jin Peng, Szegedy, Christian, Kuciński, Łukasz, Miłoś, Piotr, and Wu, Yuhuai
- Subjects
FOS: Computer and information sciences ,Computer Science - Machine Learning ,Computer Science - Logic in Computer Science ,Artificial Intelligence (cs.AI) ,Computer Science - Artificial Intelligence ,Machine Learning (cs.LG) ,Logic in Computer Science (cs.LO) - Abstract
Premise selection is a fundamental problem of automated theorem proving. Previous works often use intricate symbolic methods, rely on domain knowledge, and require significant engineering effort to solve this task. In this work, we show that Magnushammer, a neural transformer-based approach, can outperform traditional symbolic systems by a large margin. Tested on the PISA benchmark, Magnushammer achieves $59.5\%$ proof rate compared to a $38.3\%$ proof rate of Sledgehammer, the most mature and popular symbolic-based solver. Furthermore, by combining Magnushammer with a neural formal prover based on a language model, we significantly improve the previous state-of-the-art proof rate from $57.0\%$ to $71.0\%$.
- Published
- 2023