General-purpose hierarchical optimisation of machine learning pipelines with grammatical evolution.

• HML-Opt allows a researcher to define a complex space of machine learning pipelines. • HML-Opt automatically finds the best pipelines within time and memory constraints. • Meaningful statistics and insights are extracted from the experimentation process. • Freely available source code is provided for the research community. This paper introduces Hierarchical Machine Learning Optimisation (HML-Opt), an AutoML framework that is based on probabilistic grammatical evolution. HML-Opt has been designed to provide a flexible framework where a researcher can define the space of possible pipelines to solve a specific machine learning problem, which can range from high-level decisions about representation and features to low-level hyper-parameter values. The evaluation of HML-Opt is presented via two different case studies, both of which demonstrate that it is competitive with existing AutoML tools on a variety of benchmarks. Furthermore, HML-Opt can be applied to novel problems, such as knowledge extraction from natural language text, whereas other techniques are insufficiently flexible to capture the complexity of these scenarios. The source code for HML-Opt is available online for the research community. [ABSTRACT FROM AUTHOR]