Cactus
2 likes
Cross-platform framework for deploying LLM/VLM/TTS models locally on smartphones.
Cost / License
- Free
- Open Source
Application type
Platforms
- Self-Hosted
- Android
- Android Tablet
- iPhone
- iPad
Features
- Text to Speech
- React Native
Cactus News & Activities
Highlights All activities
Recent activities
POX added Cactus as alternative to Ludwig AI, Fireworks AI, Sim Studio and Haystack NLP Framework- POX added Cactus
Cactus information
Developed by
Cactus Compute Licensing
Open Source and Free product.Written in
Alternatives
18 alternatives listedSupported Languages
- English
AlternativeTo Categories
AI Tools & Services, DevelopmentApple AppStore
- Updated
- 4.75 avg rating
GitHub repository
- 4,419 Stars
- 327 Forks
- 25 Open Issues
- Updated
No comments or reviews, maybe you want to be first?
Featured in Lists
Wake up the NPU on your device
List by bugmenot with 46 apps, updated
What is Cactus?
Cross-platform framework for deploying LLM/VLM/TTS models locally in your app.
- Available in Flutter and React-Native for cross-platform developers.
- Supports any GGUF model you can find on Huggingface; Qwen, Gemma, Llama, DeepSeek etc.
- Run LLMs, VLMs, Embedding Models, TTS models and more.
- Accommodates from FP32 to as low as 2-bit quantized models, for efficiency and less device strain.
- MCP tool-calls to make AI performant and helpful (set reminder, gallery search, reply messages) etc.
- Fallback to massive cloud models for complex tasks and upon device failures.
- Chat templates with Jinja2 support and token streaming.
