GenSLMs

GenSLMs are a LLM, but genome sequence

1. Take genome sequence
2. Throw transformers at it
3. create “semantic embedding”
4. autoregression happens

This is trained as a foundational model to organize the genomic sequence

Turns out, the embedding space above can be used to discover relations. See proteins can be encoded as hierarchies