Back to Search Start Over

FIMO: A Challenge Formal Dataset for Automated Theorem Proving

Authors :
Liu, Chengwu
Shen, Jianhao
Xin, Huajian
Liu, Zhengying
Yuan, Ye
Wang, Haiming
Ju, Wei
Zheng, Chuanyang
Yin, Yichun
Li, Lin
Zhang, Ming
Liu, Qun
Publication Year :
2023

Abstract

We present FIMO, an innovative dataset comprising formal mathematical problem statements sourced from the International Mathematical Olympiad (IMO) Shortlisted Problems. Designed to facilitate advanced automated theorem proving at the IMO level, FIMO is currently tailored for the Lean formal language. It comprises 149 formal problem statements, accompanied by both informal problem descriptions and their corresponding LaTeX-based informal proofs. Through initial experiments involving GPT-4, our findings underscore the existing limitations in current methodologies, indicating a substantial journey ahead before achieving satisfactory IMO-level automated theorem proving outcomes.<br />Comment: Added a hyperlink to the dataset made accessible on GitHub

Details

Database :
arXiv
Publication Type :
Report
Accession number :
edsarx.2309.04295
Document Type :
Working Paper