A minimal PyTorch implementation for training your own small LLM from scratch. Designed for educational purposes and simplicity, featuring efficient training, flash attention, and modern sampling techniques.
- Free • Open Source
- Python
- Windows
- Mac
- Linux
- BSD
- PyTorch






































































































