Posts

value iteration, in practice

Last edited: August 8, 2025

Say we have a system:

  1. States: 4—school, internship, job, jungle
  2. Actions: 2—stay, graduate

create transition model

Create tables of size \(S \times S\) (that is, 4x4), one for each action. These are our transition models. Rows are the states where we took the action, columns are the states which are the results of the action, and the values are the probability of that transition happening given you took the action.

value of information

Last edited: August 8, 2025

VOI is a measure of how much observing something changes your action if you are a rational agent.

The value of information a measure for how much observing an additional variable is expected to increase our utility. VOI can never be negative, and does not take into account the COST of performing the observation.

constituents

  • \(o\): an observation
  • \(O’\): a possible observation to run which yield \(o’_{j}\) different outcomes

requirements

\begin{equation} VOI(O’|o) = (\sum_{o’} P(o’|o) EU^{*}(o, o’)) - EU^{*}(o) \end{equation}

variance

Last edited: August 8, 2025

variance (also known as second central moment) is a way of measuring spread:

\begin{align} Var(X) &= E[(X-E(X))^{2}] \\ &= E[X^{2}] - (E[X])^{2} \\ &= \qty(\sum_{x}^{} x^{2} p\qty(X=x)) - (E[X])^{2} \end{align}

“on average, how far is the probability of \(X\) from its expectation

The expression(s) are derived below. Recall that standard deviation is a square root of the variance.

computing variance:

\begin{align} Var(X) &= E[(X - \mu)^{2}] \\ &= \sum_{x}^{} (x-\mu)^{2} p(X) \end{align}

based on the law of the Unconscious statistician. And then, we do algebra:

vc thing

Last edited: August 8, 2025
  1. Secrets of Silicon Valley - Horowitz
    1. Looking for people who have feel for the problem: people need to believe in the problem
    2. Team: can people come with execution? people that are good at startups which are usually not good at later stage stuff
      1. Buy a startup and kick out the founders
      2. This is very typical
    3. Team and idea are easy to decouple
  2. Vetting problems
    1. Lack of market
    2. Technically insatiability
    3. “Unbelievable stupidity”: calcium is so cheap
    4. Idea goes through many morphs; getting the credit back
  3. People wiling to have a meeting?
  4. Decoupling value proposition

=> iStudio as a service

vector

Last edited: August 8, 2025

A vector is an element of a vector space. They are also called a point.