numpy-linalg
Linear algebra operations in NumPy, including matrix multiplication, SVD, system solving, and least squares fitting. Triggers: linalg, matrix multiplication, SVD, eigenvalues, matrix decomposition, lstsq, multi_dot.
When & Why to Use This Skill
This Claude skill provides high-performance linear algebra capabilities powered by NumPy's linalg module. It enables seamless execution of complex mathematical operations including Singular Value Decomposition (SVD), matrix multiplication optimization, and solving systems of linear equations, significantly enhancing productivity for data science, machine learning, and engineering workflows.
Use Cases
- Solving complex systems of linear equations (Ax = b) for scientific computing and structural engineering simulations.
- Implementing dimensionality reduction and noise reduction in datasets via Singular Value Decomposition (SVD).
- Optimizing computational efficiency in deep learning pipelines by using multi_dot to find the most efficient matrix multiplication order.
- Performing regression analysis and finding best-fit solutions for overdetermined systems using least-squares optimization.
| name | numpy-linalg |
|---|---|
| description | Linear algebra operations in NumPy, including matrix multiplication, SVD, system solving, and least squares fitting. Triggers: linalg, matrix multiplication, SVD, eigenvalues, matrix decomposition, lstsq, multi_dot. |
Overview
NumPy's linalg module provides high-performance implementations for standard linear algebra routines. It leverages optimized backends (like BLAS/LAPACK) for operations such as Singular Value Decomposition (SVD), batch equation solving, and least-squares optimization.
When to Use
- Solving systems of linear equations ($Ax = b$).
- Dimensionality reduction or matrix reconstruction using SVD.
- Optimizing chains of matrix multiplications to reduce FLOPs.
- Finding best-fit solutions for overdetermined systems.
Decision Tree
- Multiplying two matrices?
- Use the
@operator (modern standard).
- Use the
- Multiplying 3+ matrices?
- Use
np.linalg.multi_dotto optimize multiplication order.
- Use
- Is the matrix square and full-rank?
- Yes: Use
np.linalg.solve. - No: Use
np.linalg.lstsqfor a best-fit solution.
- Yes: Use
Workflows
Solving Multiple Linear Systems in Batch
- Organize coefficient matrices into a stack of shape (K, M, M).
- Organize ordinate values into a stack of shape (K, M).
- Call
np.linalg.solve(a, b)to compute all solutions simultaneously.
Rank-Reduced Reconstruction via SVD
- Perform Singular Value Decomposition using
np.linalg.svd(a, full_matrices=False). - Set small singular values in 's' to zero to perform noise reduction.
- Reconstruct the matrix using
(u * s) @ vh.
- Perform Singular Value Decomposition using
Least Squares Fitting for Overdetermined Systems
- Construct the matrix 'A' of variables and vector 'b' of results.
- Use
np.linalg.lstsq(A, b)to find the solution that minimizes the Euclidean 2-norm. - Retrieve the coefficients and residuals from the returned tuple.
Non-Obvious Insights
- Modern Operator: The
@operator is preferred overdot()for 2D matrix products for readability and intent. - Multi-Dot Optimization:
multi_dotuses dynamic programming to find the optimal parenthesization of matrix products, which can significantly speed up calculations with varying matrix sizes. - Batch Processing: Most
linalgfunctions support "stacked" arrays, processing multiple independent problems in leading dimensions automatically.
Evidence
- "The @ operator... is preferable to other methods when computing the matrix product between 2d arrays." Source
- "a must be square and of full-rank... if either is not true, use lstsq for the least-squares best “solution”." Source
Scripts
scripts/numpy-linalg_tool.py: Demonstrates SVD reconstruction and batch solving.scripts/numpy-linalg_tool.js: Simulated vector normalization logic.
Dependencies
numpy(Python)