Numerical Linear Algebra
92 words
1 min read
Visual companion
Python
Type and operator map
Python Week 1: the first filter for runtime behavior
View
Revision summary
What this note is really saying
Short form
# Numerical Linear Algebra ## 7.1 QR Decomposition $\mathbf{X} = \mathbf{Q}\mathbf{R}$ where $\mathbf{Q}$ is orthogonal, $\mathbf{R}$ is upper triangular. Used for numerically stable least squares: $\hat{\boldsymbol{\beta}} = \mathbf{R}^{-1}\mathbf{Q}^T\mathbf{y}$ ## 7.2 Singular Value Decomposition $\mathbf{X} = \m...

Numerical Linear Algebra
7.1 QR Decomposition
X=QR where Q is orthogonal, R is upper triangular.
Used for numerically stable least squares: β^=R−1QTy
pythonimport numpy as np X = np.random.randn(100, 5) y = np.random.randn(100) Q, R = np.linalg.qr(X) beta = np.linalg.solve(R, Q.T @ y)
7.2 Singular Value Decomposition
X=UΣVT — used for PCA, pseudoinverse, and handling rank deficiency.
7.3 Cholesky Decomposition
For positive definite A=LLT (lower triangular). Used in Kalman filters and GP regression.
Join Discord
PreviousStochastic ProcessesNextOptimization Methods