Blog
Thinking in public about AI, systems, and ideas
Dec 22, 2025•6 min read
What Building a Tiny Transformer Taught Me So Far
Lessons from implementing a character-level Transformer and probing what actually matters
TransformerAblationDeep Learning
Dec 19, 2025•6 min read
Scaling Laws and AGI
What scaling laws do(and do not) tell us about general intelligence
LLMScaling LawsAGIObjectives