The Results Are In (And My Wallet Is Empty)
Final loss curves, the damage to my compute budget, and 22 lessons I paid dearly to learn.
GPUburnout
Will Code for Tokens
134M
Params
2.8B
Tokens
7x
Speedup
Final loss curves, the damage to my compute budget, and 22 lessons I paid dearly to learn.