The Results Are In (And My Wallet Is Empty)
Final loss curves, the damage to my compute budget, and 22 lessons I paid dearly to learn.
GPUburnout
Will Code for Tokens
S1
GPT-2 134M
S2
Llama 1B
Final loss curves, the damage to my compute budget, and 22 lessons I paid dearly to learn.