Variational Barzilai-Borwein Method

The Barzilai-Borwein (BB) method is an effective gradient method for solving unconstrained optimization problems. Based on the observation of two classical BB step sizes, by constructing a variational least squares model, we propose a new class of BB step sizes, each of which still has the quasi-Newton property. The original BB step sizes are two special cases of the new step sizes. Numerical experiments verify the effectiveness of the new step sizes.