Chapter 6 — Further Reading

Annotated pointers for going deeper on subspaces, span, and linear independence. The three "anchor" textbooks below are referenced throughout this book; we map each chapter to the relevant sections so you can read in parallel. Section numbers follow the most widely circulated editions and may shift slightly between printings.

The three anchor textbooks

  • Gilbert Strang, Introduction to Linear Algebra (5th ed.), §3.1–3.5. Strang's treatment is the closest in spirit to this chapter: geometry-first, with the column space and null space introduced early and the four fundamental subspaces as the organizing frame. §3.1 (spaces of vectors) and §3.2 (the null space) are essential; §3.4 (independence, basis, and dimension) covers what we begin here and Chapter 15 completes. If you read only one outside source, read this. His companion MIT OpenCourseWare lectures (below) narrate the same material.
  • Sheldon Axler, Linear Algebra Done Right (4th ed.), Chapter 2 (Finite-Dimensional Vector Spaces). Axler is the rigorous, proof-first complement. His §2A (span and linear independence) and §2B (bases) give the cleanest abstract development of exactly this chapter's content, entirely free of matrices and determinants — a bracing contrast to Strang. The famous "Linear Dependence Lemma" (our §6.9 theorem, sharpened) is stated and used to build the theory of dimension. Math majors should read this alongside the proofs in §6.8–6.9.
  • Stephen Boyd & Lieven Vandenberghe, Introduction to Applied Linear Algebra (VMLS), Chapters 5 and 6. The applied, data-oriented view. Chapter 5 (linear independence) motivates the concept through applications and introduces the idea computationally; their treatment of Gram matrices and independence checks connects directly to the rank-based testing of §6.5. Freely and legally downloadable as a PDF — see below. Best matched to the CS/data-science learning path and to Case Study 1.

Free online resources

  • 3Blue1Brown, Essence of Linear Algebra, "Linear combinations, span, and basis vectors" (Chapter 2 of the series). The single best visual companion to this chapter. Grant Sanderson animates exactly the span pictures we drew by hand — a vector tracing a line, two vectors sweeping a plane, the collapse to a line when vectors are parallel. Watch this before re-reading §6.3 if the geometry has not yet clicked. The follow-up on basis vectors previews Chapter 15.
  • MIT OpenCourseWare, 18.06 Linear Algebra (Gilbert Strang), Lectures 5–10. Strang's lectures on vector spaces, subspaces, the null space, and independence/basis/dimension. Lecture 9 ("Independence, basis, and dimension") maps almost exactly onto this chapter plus Chapter 15. Full video, transcripts, and problem sets, free.
  • Khan Academy, Linear Algebra, "Vectors and spaces" unit. Gentler, exercise-rich coverage of subspaces, span, and linear (in)dependence, with immediate auto-graded practice. Good for shoring up the ⭐ and ⭐⭐ exercises if you want more reps before the harder tiers.
  • Boyd & Vandenberghe, VMLS free PDF and Julia/Python companion. The full textbook and its companion code (with numpy-friendly examples) are posted by the authors at no cost. The companion notebooks show independence and rank computations in code, reinforcing the C-track exercises.

On the applications in this chapter

  • Multicollinearity (Case Study 1). Any applied regression text covers this; for the linear-algebra core, see Strang §4.3 (least squares) and the condition-number discussion in Chapter 38 of this book. The classic practitioner's diagnostic, the variance inflation factor, is a direct quantification of how close feature columns are to dependent. For the deeper data-science framing, follow the chapter's link on feature spaces in machine learning.
  • Color spaces and the RGB basis (Case Study 2). For the linear algebra of color, see any computer-graphics text's chapter on color (e.g., the color appendix of Hughes et al., Computer Graphics: Principles and Practice). The "three cone types $\Rightarrow$ dimension 3" fact comes from the trichromatic theory of human color vision (Young–Helmholtz) [verify]; the change-of-basis matrices between RGB, YCbCr, and CMY are standard and reappear in Chapter 16.
  • Degrees of freedom and the Jacobian (Exercise 6.30). Any introductory robotics text (e.g., the kinematics chapters of standard robot-manipulation references) treats the Jacobian and singular configurations; the linear-algebra content is exactly the rank/independence test of §6.5, applied to the Jacobian's columns.

A note on where this is going

Subspaces, span, and independence are foundational rather than terminal topics — their real payoff is in the next several chapters. If you want to see why they matter so much, skim ahead: Chapter 13 defines the column space as the span of a matrix's columns (this chapter, renamed) and the null space as the dependence relations among them; Chapter 14 completes Strang's four-subspaces picture with rank–nullity; and Chapter 15 builds the basis and dimension you have been pointed toward throughout. For the cleanest abstract path through all of this, Axler Chapters 2–3 are unmatched; for the most geometric, Strang Chapter 3 and the 3Blue1Brown series together.