Posts

turing machine (overview)

Last edited: August 8, 2025

turing machine is a computational system that has a memory tape, and can go through the input multiple times; they don’t have to accept or reject states, turing machines can run forever and can have loops.

For the main topic, see turing machine

decidable vs. recognizable languages

  • there are not enough Turing Machines to compute every language (so there are non-recognizable/non-decidable languages)
  • halting problem and ATM, meaning strings where Turing Machines can’t decide them

self-reference

  • turing Machines can view and produce its own code.
  • foundations of mathematics can be shown using these systems

Kolomogorov Complexity

see Kolomogorov Complexity

Two Statements About Uniformity

Last edited: August 8, 2025

\(\text{BPP} \subseteq p / poly\)

Remember the advice-taking TM formulation of circuits.

Now, a language \(L \in \text{BPP}\) if \(\exists\) a polytime TM \(M\) such that:

  • \(x \in L\) implies \(P\qty [M\qty(x, v) \text{ accepts}] \geq \frac{2}{3}\)
  • \(x \not\in L\) implies \(P\qty [M\qty(x, v) \text{rejects}] \geq \frac{2}{3}\)

Intuition: we want to use \(r\) as advice. But, we need a “random” advice for each \(x\) which we don’t have. But; consider the following parameterization of BPP: we notice that if we have \(\frac{1}{3}\) chance of “bad” advice, we know that we can bump the failure down by trying a more, trending towards \(2^{-O\qty(k)}\). Using \(O\qty(k)\), by the union bound, we know at least one advice is good for all input \(x\).

two-dimensional heat equation

Last edited: August 8, 2025

what if heat, but plate

\begin{equation} \pdv{u}{t} = \pdv[2]{u}{x} + \pdv[2]{u}{y} \end{equation}

For some heat distribution that has arbitrary shape, on some domain \(\Omega \times [0, \infty]_{t}\) (i.e. argumentation of some space dimensions by time).

If \(\Omega\) is a general blob, you are actually kinda fucked. Because the bounds on \(x\) depend on \(y\), and \(y\) on \(x\), so you can’t just separate them into a product.

two's complement

Last edited: August 8, 2025

Say we want to find the number which is the additive inverse (“negative”) of a number.

We can just flip each of the digit, and then add 1:

  • take \(0101\), invert it to get \(1010\)
  • adding these two numbers will give you \(1111\). If we just added one more \(0001\), it will flip over to be \(0000\).
  • Therefore, \(1010+0001 = 1011\) is the additive inverse of \(0101\).

The left most bit being one: still a mark of whether or not something is negative. It just works backwards:

type theory

Last edited: August 8, 2025

type theory was originally aimed creating a basis of all of mathematics. it got out-competed in math by set theory. it formalizes…

  1. programs
  2. propositions (types)
  3. proofs that programs satisfies these propositions

and does so in one system.

key features

  • it creates an isomorphism between programs/types with proofs/propositions
  • it creates a hierarchy which allows defining types, type operations, proofs into the same system at different levels
  • it allows possibly-undecidable expressive dependent types to be constructed

musing

  • this is a foundation of mathematics, and in particular constructive mathematics
  • its pretty powerful to prove anything we want to prove—so can be used to verify the correctness of all sofware

properties of type systems

type stratification

Consider a type of all types Type,