Cactus
2 likes
Cross-platform framework for deploying LLM/VLM/TTS models locally on smartphones.
Cost / License
- Free
- Open Source
Application type
Platforms
- Self-Hosted
- Android
- Android Tablet
- iPhone
- iPad
Features
- Text to Speech
- React Native
Tags
- ai-model
- flutter
- ai-model-integration
- vlms
- Software Framework
Cactus News & Activities
Highlights All activities
Recent activities
POX added Cactus as alternative to Ludwig AI, Fireworks AI, Sim Studio and Haystack NLP Framework- POX added Cactus
Cactus information
Developed by
Cactus Compute Licensing
Open Source and Free product.Written in
Alternatives
13 alternatives listedSupported Languages
- English
AlternativeTo Categories
AI Tools & Services, DevelopmentApple AppStore
- Updated
- 4.75 avg rating
GitHub repository
- 3,877 Stars
- 239 Forks
- 40 Open Issues
- Updated
No comments or reviews, maybe you want to be first?
Post comment/reviewWhat is Cactus?
Cross-platform framework for deploying LLM/VLM/TTS models locally in your app.
- Available in Flutter and React-Native for cross-platform developers.
- Supports any GGUF model you can find on Huggingface; Qwen, Gemma, Llama, DeepSeek etc.
- Run LLMs, VLMs, Embedding Models, TTS models and more.
- Accommodates from FP32 to as low as 2-bit quantized models, for efficiency and less device strain.
- MCP tool-calls to make AI performant and helpful (set reminder, gallery search, reply messages) etc.
- Fallback to massive cloud models for complex tasks and upon device failures.
- Chat templates with Jinja2 support and token streaming.
