A minimal, hackable LLM training harness covering tokenization, pretraining, finetuning, evaluation, and inference, designed to train GPT-2-class models affordably on a single GPU node.
60398A minimal, hackable LLM training harness covering tokenization, pretraining, finetuning, evaluation, and inference, designed to train GPT-2-class models affordably on a single GPU node.