10 Training Challenges and How I Solved Them
A comprehensive guide to every way I shot myself in the foot training GPT-2 Small. Learn from my pain.
GPUburnout
Will Code for Tokens
134M
Params
2.8B
Tokens
7x
Speedup
A comprehensive guide to every way I shot myself in the foot training GPT-2 Small. Learn from my pain.