Rabbitholes

Projects

Titan-LLaMA: Retrofitting Pre-Trained LLMs with External Neural Memory Modules

Final Project for 6.7960, Massachusetts Institute of Technology

Why test-time training?

I was first introduced to test-time training (TTT) by Ekin Akyürek et al.’s SoTA performance on ARC-AGI (Akyürek et al. 2024). This idea was nonintuitive but compelling…

Creating the Parliamentary Debate Engine

Good companies are not hard to find, but cheap ones are. To have high conviction that we will get paid, we need to understand why the market is wrong and how to validate our…