POMDP-lite
Last edited: August 8, 2025What if our initial state never change or is deterministically changing? For instance, say, for localization. This should make solving a POMDP easier.
POMDP-lite
- \(X\) fully observable states
- \(\theta\) hidden parameter: finite amount of values \(\theta_{1 \dots N}\)
- where \(S = X \times \theta\)
we then assume conditional independence between \(x\) and \(\theta\). So: \(T = P(x’|\theta, x, a)\), where \(P(\theta’|\theta,x,a) = 1\) (“our hidden parameter is known or deterministically changing”)
POMDPs Index
Last edited: August 8, 2025a class about POMDPs
| Theme | Topics |
|---|---|
| Robot dogs | NeBula, AISR NeBula |
| Applications | POMDSoar, |
| Offline Solvers | PBVI, HSVI, Perseus |
| Offline Solvers | SARSOP, E-PCA, CALP |
| Policy Graphs | Hansen, MCVI, PGA |
| Online Solvers | AEMS, POMCP, DESPOT |
| Moar Online Methods | IS-DESPOT, POMCPOW, AdaOPS |
| POMDPish | MOMDP, POMDP-lite, rho-POMDPs |
| Memoryless + Policy Search | Sarsa (Lambda), JSJ, Pegasus |
| Hierarchical Decomposition | Option, MaxQ, LTRDP |
| Hybrid Planning | HybPlan, LetsDrive, BetaZero |
| LQR + Shared Autonomy | iLQR, Hindsight, TrustPOMDP |
| Multi-Agent | Factored MDPs, FV-POMCPs, G-DICE |
Other Content
Population Based Training
Last edited: August 8, 2025Jury based work
POS Tagging
Last edited: August 8, 2025- closed class words - words with fixed memberships (prepositions, conjunctivas, etc.); not being created or added much, used for grammatical function
- open class words - words that are set as content, and are focused on content
power (math)
Last edited: August 8, 2025For some \(a \in \mathbb{F}\), we define \(a^m\) to be \(a\) multiplied with itself \(m\) times.
additional information
- \((a^m)^n = a^{mn}\)
- \((ab)^m = a^mb^m\)
