11 Training Challenges and How I Solved Them
A comprehensive guide to every way I shot myself in the foot training GPT-2 Small. Learn from my pain.
GPUburnout
Will Code for Tokens
S1
GPT-2 134M
S2
Llama 1B
A comprehensive guide to every way I shot myself in the foot training GPT-2 Small. Learn from my pain.