Levenberg–Marquardt
Last updated
Last updated
Levenberg-Marquardt is also an optimization used for non-linear least square problems.
The LMA interpolates between the (GNA) and the method of . LMA can also be viewed as using a approach.
The (non-negative) damping factor is adjusted at each iteration. If reduction of cost is rapid, a smaller value can be used, bringing the algorithm closer to the , whereas if an iteration gives insufficient reduction in the residual, can be increased, giving a step closer to the gradient-descent direction.