Key Sequence

Notation

New Concepts

• multi-variant Gaussian density
• Generative Learning Algorithm

Important Results / Claims

• applying Bayes rule to make prediction makes the sigmoid function

Generative and Discriminate Algorithm

Discriminative Algorithm

Learns \(p\qty(y|x)\), or better yet just \(h\qty(x) \in \qty {0,1}\).

“what’s the distribution over labels”

Generative Algorithm

Learns \(p\qty(x|y)\) as well as a “class prior” \(p\qty(y)\). To make classification decisions, you apply Bayes rule. THINK: Naive Bayes.