Registry Synced

Advanced Optimization

36 words
1 min read

Reading compass

Now · 8.1 Newton-Raphson for GLM

Advanced Optimization

8.1 Newton-Raphson for GLM

Iteratively re-weighted least squares (IRLS):
β(t+1)=(XTWX)−1XTWz\boldsymbol{\beta}^{(t+1)} = (\mathbf{X}^T\mathbf{W}\mathbf{X})^{-1}\mathbf{X}^T\mathbf{W}\mathbf{z}

8.2 BFGS (Quasi-Newton)

Approximates Hessian using gradient information, avoiding O(p3)O(p^3) computation. Join Discord PreviousNumerical Linear AlgebraNextNumerical Optimization
Document outline

Keep your place and jump directly to a heading.

Table of contents

No note selected

Open a chapter to see its outline, backlinks, and sources here.