Notation

New Concepts

• supervised learning
  • training set
  • cost function
    • least-squares error
• machine learning evaluation
  • root-mean-square error (this is least-squares error with normalization, so “units work well” for test benchmarks)
• linear regression
• gradient descent
  • stochastic gradient descent
• normal equation

Important Results / Claims

• gradient descent for least-squares error
• when does gradient descent provably work?

Questions

• Why can’t we use root-mean-square error for the training objective? It seems like its just more normalization…

Key Sequence

Notation

New Concepts

• Optimal Stopping Problem
• reinforcement learning
  • model-based reinforcement learning
  • model-free reinforcement learning

Important Results / Claims

Questions

Interesting Factoids

Key Sequence

Notation

New Concepts

• POMDP
  • belief
  • observation model
    • error model
    • discrete state filter

Important Results / Claims

Questions

Interesting Factoids

Key Sequence

Notation

New Concepts

• belief
  • filters
    • Kalman Filter
    • Particle Filter
• POMDP
  • belief-state MDP
  • conditional plan
  • alpha vector

Important Results / Claims

• conditional plan evaluation

Questions

Interesting Factoids

Key Sequence

Notation

New Concepts

• belief-state MDP
  • optimal value function for POMDP with alpha vector
  • one-step lookahead in POMDP
• alpha vector pruning

Important Results / Claims

• POMDP value-iteration

Questions

Interesting Factoids