All tasks
Task · babylm-replay

Data-efficient pretraining

Pretrain a language model from scratch on 10M words

LLM TrainingInspired byQ Labs

Loading the dataset browser…