Back to Search Start Over

A Novel Integer Linear Programming Approach for Global l0 Minimization.

Authors :
Delle Donne, Diego
Kowalski, Matthieu
Liberti, Leo
Source :
Journal of Machine Learning Research. 2023, Vol. 24, p1-28. 28p.
Publication Year :
2023

Abstract

Given a vector y ∈ Rn and a matrix H ∈ Rnxm, the sparse approximation problem P0/p asks for a point x such that ∥y - Hx∥p ≤ α, for a given scalar α, minimizing the size of the support ∥x∥0 := #{j | xj ≠ 0}. Existing convex mixed-integer programming formulations for P0/p are of a kind referred to as "big-M", meaning that they involve the use of a bound M on the values of x. When a proper value for M is not known beforehand, these formulations are not exact, in the sense that they may fail to recover the wanted global minimizer. In this work, we study the polytopes arising from these formulations and derive valid inequalities for them. We first use these inequalities to design a branch-and-cut algorithm for these models. Additionally, we prove that these inequalities are sufficient to describe the set of feasible supports for P0/p. Based on this result, we introduce a new (and the first to our knowledge) M-independent integer linear programming formulation for P0/p, which guarantees the recovery of the global minimizer. We propose a practical approach to tackle this formulation, which has exponentially many constraints. The proposed methods are then compared in computational experimentation to test their potential practical contribution. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
15324435
Volume :
24
Database :
Academic Search Index
Journal :
Journal of Machine Learning Research
Publication Type :
Academic Journal
Accession number :
176355268