Data Preparation: Building a 12GB Training Corpus
Where I learned that 90% of ML is just cleaning data and crying about file sizes.
GPUburnout
Will Code for Tokens
134M
Params
2.8B
Tokens
7x
Speedup
Where I learned that 90% of ML is just cleaning data and crying about file sizes.