LLM Architecture & Training Design

All research

Research on novel concepts in LLM architecture and training design. Reinforcement-learning-driven training control, self-discovering architectures, and forensic interpretability of trained transformers.

Series

Each series is a coherent sequence of papers on a single topic within this subject area.

01 Training Substrate (4 papers) Reinforcement-learning-driven control of the training loop, self-discovering architectures, and the layer-role taxonomy that surfaces when those mechanisms are applied at scale.