The Index

Topics

Explore the ideas, systems, and engineering problems behind modern ML infrastructure.

01

Training Systems

Trainers, optimizers, recipes, debugging large runs.2 articles02

Architecture

Transformers, MoE, SSMs, hybrids, and what's next.2 articles