Key Sequence

Notation

New Concepts

• POMDP
  • belief
  • observation model
    • error model
    • discrete state filter

Important Results / Claims

Questions

Interesting Factoids

Key Sequence

Notation

New Concepts

• belief
  • filters
    • Kalman Filter
    • Particle Filter
• POMDP
  • belief-state MDP
  • conditional plan
  • alpha vector

Important Results / Claims

• conditional plan evaluation

Questions

Interesting Factoids

Key Sequence

Notation

New Concepts

• belief-state MDP
  • optimal value function for POMDP with alpha vector
  • one-step lookahead in POMDP
• alpha vector pruning

Important Results / Claims

• POMDP value-iteration

Questions

Interesting Factoids

Key Sequence

Notation

New Concepts

• POMDP Approximation lower bound
  • BAWS
  • blind lower bound
  • Point-Based Value Iteration
  • Randomized PBVI
• Online POMDP Methods

Important Results / Claims

• point selection

Questions

• how do you use alpha-vectors in Rollout with Lookahead? forward search? in a sense: how do you get the value function
• what is best-action worst-state reward converting into alpha vectors?
• bandit quiz question

Interesting Factoids

Key Sequence

Notation

New Concepts

• controller
  • finite state controller
• multiagent reasoning
  • prisoner’s dilemma
  • traveler’s dilemma
  • response model
• Dominant Strategy Equilibrium
• Nash Equilibrium

Important Results / Claims

• finite state controller evaluation
• joint policy agent utility

Questions

Interesting Factoids