Uvero — STEM Learning

Least Squares and Orthogonal Projection

When $Ax=b$ is inconsistent, least squares finds the vector $Ax$ closest to $b$ by projecting onto the column space. The residual is orthogonal to every column: $A^T(A\hat x-b)=0$ . The distinction between a formal hypothesis and an intuitive picture is made explicit so that calculations can be justified, not merely patterned.

Worked reasoning

Orthogonality of the residual gives $A^T(A\hat x-b)=0$ .
Rearrange to the normal equations.

Which equations define a least-squares solution?

$A^TA\hat x=A^Tb$

$A\hat x=0$

$A^Tb=0$

$AA^T\hat x=b$

Which statement best captures the central mathematical idea in Least Squares and Orthogonal Projection?

The residual is orthogonal to every column: $A^T(A\hat x-b)=0$ .

A familiar formula remains valid after its hypotheses, domain or convergence conditions are removed.

A memorised formula is valid even when its conditions are not met.

The diagram or notation replaces the need to justify each mathematical step.

When starting a problem about Least Squares and Orthogonal Projection, which move is most reliable?

Write the governing definition and list its hypotheses before calculating in least squares and orthogonal projection.

Round every value before identifying the mathematical structure.

Choose the longest available formula and substitute immediately.

Assume the desired conclusion and work backwards without checking equivalence.

Which statement is a misconception that must be rejected when working with Least Squares and Orthogonal Projection?

A familiar formula remains valid after its hypotheses, domain or convergence conditions are removed.

The residual is orthogonal to every column: $A^T(A\hat x-b)=0$ .

Write the governing definition and list its hypotheses before calculating in least squares and orthogonal projection.

Test a representative example and a boundary or counterexample, then verify the conclusion directly from the definition.