Martinc 2021
Last edited: August 8, 2025DOI: 10.3389/fnagi.2021.642647
One-Liner
Combined bag-of-words on transcript + ADR on audio to various classifiers for AD; ablated BERT’s decesion space for attention to make more easy models in the future.
Novelty
- Pre-processed each of the two modalities before fusing it (late fusion)
- Archieved \(93.75\%\) accuracy on AD detection
- The data being forced-aligned and fed with late fusion allows one to see what sounds/words the BERT model was focusing on by just focusing on the attention on the words
Notable Methods
- Used classic cookie theft data
- bag of words to do ADR but for words
- multimodality but late fusion with one (hot-swappable) classifier
Key Figs
How they did it

This is how the combined the forced aligned (:tada:) audio and transcript together.
Martingale Model
Last edited: August 8, 2025The Martingale Model states: if we observed the closing price of the market yesterday, we expect that the market is going to open at the close price yesterday.
Formally:
\begin{equation} E\qty [X_{k}|X_{k-1}, X_{k-2},\ldots] = X_{k-1} \end{equation}
“irrespective of what you know, no matter how long the history, the best expectation of today’s price is yesterday’s price.”
This is not a for sure! modeling statement: this is simply the expected value!! That means, after \(\infty\) times of re-running the universe starting “yesterday”, the new opening price will converge to the last closing price.
math5 how
Last edited: August 8, 2025mathematics
Last edited: August 8, 2025hehehe
formal system
a formal system describes a formal language for…
- writing finite mathematical statements
- have a definition of what statements are true
- has a definition of a proof of a statement
examples
Every Turing Machine \(M\) defines some formal system \(\mathcal{F}\) such that \(\Sigma^{*}\) string \(w\) represents the statement “\(M\) accepts \(w\)”
- “true statements \(\mathcal{F}\)” is \(L(M)\)
- a proof that \(M\) accepts \(w\) can be defined to be an accepting computation history on \(M\) for \(w\)
interesting
a formal system \(\mathcal{F}\) is “interesting” if:
matricies
Last edited: August 8, 2025matricies are like buckets of numbers. ok, ok, seriously:
matricies are a way of encoding the basis of domain proof: that if Linear Maps are determined uniquely by where they map the basis anyways, why don’t we just make a mathematical object that represents that to encode the linear maps.
definition
Let \(n\), \(m\) be positive integer. An \(m\) by \(n\) matrix \(A\) is a rectangular array of elements of \(\mathbb{F}\) with \(m\) rows and \(n\) columns:
