Waveform Inversion (FWI).

Stochastic gradient descent competes with the L-BFGS algorithm, which is also widely used. Stochastic gradient descent has been used since at least 1960 for training linear regression models, originally under the name ADALINE.

Another stochastic gradient descent algorithm is the least mean squares (LMS) adaptive filter.

Extensions and variants

1.Previous
3.Next