A minimal PyTorch implementation for training your own small LLM from scratch. Designed for educational purposes and simplicity, featuring efficient training, flash attention, and modern sampling techniques.
Cost / License
- Free
- Open Source
Platforms
- Python
- Windows
- Mac
- Linux
- BSD
- PyTorch
SMOL-GPT is the most popular Windows, Mac & Linux alternative to Liner.ai.
SMOL-GPT is the most popular Open Source & free alternative to Liner.ai.
- SMOL-GPT is Free and Open Source
















