Chapter 34 — Further Reading

Inner product spaces are where the "abstract" textbooks shine, because the whole point is to work without coordinates. Axler is the standout reference for this chapter — his coordinate-free treatment is exactly the spirit of what we did here.

Core textbooks

  • Sheldon Axler, Linear Algebra Done Right (4th ed.), Chapter 6 ("Inner Product Spaces") — the primary companion to this chapter. Axler develops inner products, norms, orthonormal bases, the Gram–Schmidt procedure, and orthogonal projections in exactly the axiomatic, coordinate-free style we adopted, over both $\mathbb{R}$ and $\mathbb{C}$ from the start. His proof of Cauchy–Schwarz and his treatment of the orthonormal-basis coordinate formula ($c_j=\langle\mathbf{v},\mathbf{e}_j\rangle$ — note he conjugates the second argument, the mathematicians' convention) are the natural next read after §34.6 and §34.7. If you read one source on this chapter, read this. Chapter 6 also previews the spectral theorem in inner-product-space language, tying back to our Chapter 27.

  • Gilbert Strang, Introduction to Linear Algebra (5th/6th ed.), and Linear Algebra and Its Applications. Strang stays closer to $\mathbb{R}^n$ and the dot product, but his sections on orthogonality, projections, and the connection to least squares are the concrete grounding that this chapter generalizes. Best read as a refresher on why the dot product mattered (Chapters 18–20 of our book) before climbing to the abstraction. His treatment of weighted least squares is the applied face of our §34.3.

  • Stephen Boyd & Lieven Vandenberghe, Introduction to Applied Linear Algebra (VMLS). The most application-forward of the three; excellent on norms, distance, angle, and least squares as used in data science and engineering. Its perspective makes the weighted-inner-product and generalized-least-squares material of §34.3 concrete, and it is freely available online.

On complex inner products and Hilbert spaces

  • Kreyszig, Introductory Functional Analysis with Applications, Chapters 1–3. The gentle bridge from finite-dimensional inner product spaces into Hilbert spaces. If the Math-Major Sidebar on completeness in §34.9 left you wanting the real theory — Cauchy sequences, completeness, the projection theorem in infinite dimensions, orthonormal bases of $L^2$ — this is the standard accessible entry point.

  • Reed & Simon, Methods of Modern Mathematical Physics, Vol. I: Functional Analysis. The rigorous, physics-motivated treatment of Hilbert spaces, including the Riesz–Fischer completeness theorem and the spectral theory behind quantum mechanics. A graduate-level companion for the §34.8–§34.9 material; read after Kreyszig.

  • For the quantum side: any of the standard quantum-mechanics texts (Griffiths, Introduction to Quantum Mechanics; Nielsen & Chuang, Quantum Computation and Quantum Information, Chapter 2) develop the qubit, the Born rule, and measurement exactly as inner-product geometry in $\mathbb{C}^2$ and $\mathbb{C}^{2^n}$. Nielsen & Chuang in particular is the canonical reference for the distinguishability/overlap ideas of Case Study 2. The geometric foundation continues in Hilbert space in quantum mechanics.

On orthogonal polynomials (Case Study 1)

  • Trefethen, Approximation Theory and Approximation Practice. A beautiful, modern, computation-first account of Chebyshev polynomials and why they make polynomial approximation stable — the theory behind chebfun and the §34.4/Case Study 1 material. Pairs perfectly with hands-on experiments.

  • NIST Digital Library of Mathematical Functions (dlmf.nist.gov), Chapter 18 ("Orthogonal Polynomials"). The authoritative free reference for Legendre, Chebyshev, Hermite, and Laguerre polynomials — their weights, recurrence relations, and orthogonality intervals. Use it to see how many famous families are just Gram–Schmidt in different weighted function inner products.

Free online resources

  • MIT OpenCourseWare 18.06 (Strang) and 18.065 (Strang, Matrix Methods). Video lectures; 18.06 for the orthogonality foundations, 18.065 for the applied/data-science angle on projection and least squares.
  • 3Blue1Brown, Essence of Linear Algebra. For rebuilding the geometric intuition (dot products, change of basis) that this chapter generalizes; the abstraction lands better when the $\mathbb{R}^n$ pictures are vivid.
  • The infinite sums that completeness justifies — convergence of Fourier and power series — are developed in any calculus sequence; see function series for the limit-of-partial-sums foundation behind §34.9.

Where to go next in this book

Chapter 35 frees the matrix from $\mathbb{R}^n$ (abstract linear maps, kernel and image), the natural partner to freeing the dot product here. Chapter 40 surveys functional analysis, where the Hilbert spaces of §34.9 become the working setting for differential operators — linear algebra and analysis fused.