One possible approach for using homomorphic encryption, developed specifically for imaging data.

1. extract relevant features locally
2. resulting data is encrypted using FHE
3. train model remotely using FHE encrypted data
4. send model back, and data owners decrypt the inference results locally

RAG for generic risk conversations.

1. tag transcripts with the relevant themes a la action research
2. use llama2 to embed the given information
3. then send the overall information to a larger language model

People generally preferred grounded GPT responses over human responses. Sometimes, in 2 of the features, humans preferred the non grounded responses.

SnowMed CT: large medical ontology

1. created pairwise distance matrix on SnowMed CT
2. created weighted graphs using the SnowMed information
3. Node2Vec! Suddenly you have an embedding for each disease.

Two Tasks:

Patient Disease Embeddings

Using the node2vec with snowmed

Similar Patient Retrial

Reveal hidden co-morbidities via Jaccard Coefficient

Updates

• dropping dropout: https://proceedings.mlr.press/v202/geiping23a/geiping23a.pdf
• CAW-coref: revised! do we need more space for things such as a figure?
  • stanza 1.9.0 staged! https://huggingface.co/stanfordnlp/stanza-en

Yay mend works!

.mean() vs. .sum() for the dW maps?

PPL Isn’t the Only Possible Metric

even if our model is better ppl, its worse at squad than Facebook (granted its been trained a lot less); will run with new pretraining model (expect that no dropout will be better (see paper above)).