Key Sequence

Notation

New Concepts

• POMDP Approximation lower bound
  • BAWS
  • blind lower bound
  • Point-Based Value Iteration
  • Randomized PBVI
• Online POMDP Methods

Important Results / Claims

• point selection

Questions

• how do you use alpha-vectors in Rollout with Lookahead? forward search? in a sense: how do you get the value function
• what is best-action worst-state reward converting into alpha vectors?
• bandit quiz question

Interesting Factoids

Key Sequence

Notation

New Concepts

• controller
  • finite state controller
• multiagent reasoning
  • prisoner’s dilemma
  • traveler’s dilemma
  • response model
• Dominant Strategy Equilibrium
• Nash Equilibrium

Important Results / Claims

• finite state controller evaluation
• joint policy agent utility

Questions

Interesting Factoids

Key Sequence

Notation

New Concepts

• Bayes Net + conditional independence
• Baysian Net inference
• factor
• factor operations
  • factor product
  • factor marginalization
  • factor conditioning
• Naive Bayes + inference with Naive Bayes
• Direct Sampling and Likelihood Weighted Sampling

Important Results / Claims

• parameter
• checking for conditional independence
• sum-product elimination
• Direct Sampling a Baysian Network

Questions

Interesting Factoids

Key Sequence

Notation

New Concepts

• inference
  • Inference for Gaussian Models
• approximate inference
  • Direct Sampling
  • Likelihood Weighted Sampling
• parameter learning
  • Maximum Likelihood Parameter Learning
  • Baysian Parameter Learning
    • Dirichlet Distribution

Important Results / Claims

• “there is usually a tradeoff between the computational time you are willing to devote, and th
• Bayesian Learning on Binary Distributions

Questions

• for Likelihood Weighted Sampling, where do the conditional probability values come from

Interesting Factoids

Key Sequence

Notation

New Concepts

• Beta Distribution

Important Results / Claims

Questions

Interesting Factoids