Best subset of groups selection (BSGS) is the process of selecting a small part of nonoverlapping groups to achieve the best interpretability on the response variable. It has attracted increasing attention and has far-reaching applications in practice. However, due to the computational intractability of BSGS in high-dimensional settings, developing efficient algorithms for solving BSGS remains a research hotspot. In this paper, we propose a group-splicing algorithm that iteratively detects the relevant groups and excludes the irrelevant ones. Moreover, coupled with a novel group information criterion, we develop an adaptive algorithm to determine the optimal model size. Under certain conditions, it is certifiable that our algorithm can identify the optimal subset of groups in polynomial time with high probability. Finally, we demonstrate the efficiency and accuracy of our methods by comparing them with several state-of-the-art algorithms on both synthetic and real-world data sets. History: Accepted by Andrea Lodi, Area Editor for Design & Analysis of Algorithms-Discrete. Funding: This work was supported by National Natural Science Foundation of China [Grants 72171216, 71921001, and 71991474], the Key Research and Development Program of Guangdong [Grant 2019B020228001], the Science and Technology Program of Guangzhou, China [Grant 202002030129], The Fundamental Research Funds for the Central Universities and the Research Funds of Renmin University of China [Grant 22XNH161], and the Outstanding Graduate Student Innovation and Development Program of Sun Yat-Sen University [Grant 19lgyjs64]. Supplemental Material: The online appendix and video are available at https://doi.org/10.1287/ijoc.2022.1241. [ABSTRACT FROM AUTHOR]