Chapter 2: Linear Algebra Refresher

A quick refresher on linear algebra concepts essential for neural networks:

  • Scalars, Vectors, Matrices, and Tensors: The fundamental data structures.
  • Multiplying Matrices and Vectors: Dot products are everywhere!
  • Identity and Inverse Matrices: $A^{-1}A = I$
  • Linear Dependence and Span: Understanding the column space of a matrix.
  • Eigendecomposition: Decomposing a matrix into its eigenvalues and eigenvectors.