MOMDP are POMDPs where some parts of the state are fully observable.

Motivation

scaling up POMDPs is really hard: exponential curse of dimensionality. Even discretization will cause the number of beliefs to really blow up.

Some of the state isn’t uncertain, some others are bounded uncertainty: this REDUCES scale a lot.

Solving

Solving the algorithm uses SARSOP, or any point-based system. Instead of sampling the full belief state, however, we sample from a tuple \((x, b_{y})\), whereby \(x\) is the observable part and \(b_{y}\) is the unobservable part.

We can abstract common part of language features such as state and exception. It allows programming these features in pure lambda calculus.

A monad \(M a\) is an abstract type—

the “normal” type is \(a\), and we have the semantics hidden in \(M\).

• return: \(a \to Ma\)
• bind: \(M a \to (a \to M b) \to M b\) — it takes a monad, a function that takes the unwrapped thing and hands back a new monad, and returns that

bind is written with \(v \gg = f\) for monad \(v\) and function \(f: a\to M b\)

Monetarist theory is a theory of economics proposed by Milton Freedman which asserts that Keynsian economics only applies in the limited case that central bank need to keep the money supply growing; otherwise, the free market can handle itself.

Therefore the Monetarist theorists propose that the stock market crash of 1929 was caused that the US monetary fund did a bad job of actually controlling the funds, and didn’t inject enough money into economy.

monitor pattern is a multithreading pattern to help prevent race conditions and deadlocks.

associate a single lock with a collection of variables (a “class”), having one lock associated with the group.

any time when you want to access anything in that group, you unlock the mutex associated with the group. meaning, there’s only one mutex which can be used to change shared state.

Bridge Crossing

There is cars that are crossing a one lane bridge: each car in a thread, they have to coordinate when/where to cross the bridge.

The fallout of the Rosa Parks incident, which is when many of Montgomery residents.

The boycotts were developed by Martin Luther King.