Key Sequence

Review even more! Linear Regression, give some intuition, discuss logistic regression and give an optimization method for it.

Notation

Recall the notation:

• \(\qty(x^{(i)}, y^{(i)})\), ith example
• \(x^{(i)} \in \mathbb{R}^{m+1}\), where \(x_0^{(i)}, \forall i = 1\)
• \(y^{(i)} \in \mathbb{R}\)

\(n\) — number of examples; \(m\) — number of features

New Concepts

• Locally-Weighted Regression
• logistic regression
• Newton’s Method
• parametricity of learning algorithms
  • Non-Parametric Learning Algorithms
  • Parametric Learning Algorithm

Important Results / Claims

• probabilistic intuition for least-squares error

Questions

Interesting Factoids

Scratch

Homo Sapiens are animals that depend on ecosystems. Our social system depends on ecosystems.

A primer on Vector Calculus.

trace

constituents

for square \(A \in \mathbb{R}^{m\times m}\), we write:

requirements

\(\text{tr}\qty(A) = \sum_{i}^{} A_{ii}\) is the sum of the diagonals

additional information

properties of traces

\begin{equation} \text{tr}\qty(AB) = \text{tr}\qty(BA) \end{equation}

\begin{equation} \text{tr}\qty(ABC) = \text{tr}\qty(CAB) \end{equation}

\begin{equation} \nabla_{A} \qty [\text{tr}\qty(AB)] = B^{T} \end{equation}

As a function of \(n\), what is the runtime of the “worst” input?

• pros: very strong guarantee
• cons: too strong of an upper bound, may have better algorithm for Beyond Worst-Case Analysis