Archives

2026  5

February  2

The Results Are In (And My Wallet Is Empty)

February 6, 2026 · 6 min · GPUburnout

10 Training Challenges and How I Solved Them

February 2, 2026 · 5 min · GPUburnout

January  3

Scaling Up: From Tiny Model to GPT-2 Small

January 27, 2026 · 4 min · GPUburnout

Data Preparation: Building a 12GB Training Corpus

January 22, 2026 · 4 min · GPUburnout

Why I Decided to Build a Language Model from Scratch

January 15, 2026 · 3 min · GPUburnout
GPUburnout
GPUburnout
Will Code for Tokens
134M Params
2.8B Tokens
7x Speedup