NexaSDK is described as 'Run frontier LLMs and VLMs with day-0 model support across GPU, NPU, and CPU, with comprehensive runtime coverage for PC (Python/C++), mobile (Android & iOS), and Linux/IoT (Arm64 & x86 Docker). Supporting OpenAI GPT-OSS, IBM Granite-4, Qwen-3-VL, Gemma-3n, Ministral-3, and more' and is an app. There are more than 10 alternatives to NexaSDK for a variety of platforms, including Windows, Linux, Mac, Self-Hosted and Android apps. The best NexaSDK alternative is Ollama, which is both free and Open Source. Other great apps like NexaSDK are Jan.ai, AnythingLLM, LM Studio and LocalAI .
A modern web interface for managing and interacting with vLLM servers (www.github.com/vllm-project/vllm). Supports both GPU and CPU modes, with special optimizations for macOS Apple Silicon and enterprise deployment on OpenShift/Kubernetes.
LLM Hub is an open-source Android app for on-device LLM chat and image generation. It's optimized for mobile usage (CPU/GPU/NPU acceleration) and supports multiple model formats so you can run powerful models locally and privately.
Australia
United States