Lagrange Multiplier

Nice was to look at lagrange, which might also be related to implicit function theorem:

minxf(x)s.t.C(x)=0\min_x f(x) \quad \text{s.t.} \quad C(x)=0

To solve the above minimization problem, we can use lagrange multiplier as follows

L(x,λ)=f(x)+λC(x)g(λ)=L(x(λ),λ)wherex=argminxL(x,λ)\mathcal{L}(x,\lambda) = f(x) + \lambda C(x) \\ g(\lambda) = \mathcal L(x^*(\lambda), \lambda) \quad \text{where} \quad x^* = \arg \min_x \mathcal L(x, \lambda)

Last updated