NexaSDK is described as 'Run frontier LLMs and VLMs with day-0 model support across GPU, NPU, and CPU, with comprehensive runtime coverage for PC (Python/C++), mobile (Android & iOS), and Linux/IoT (Arm64 & x86 Docker). Supporting OpenAI GPT-OSS, IBM Granite-4, Qwen-3-VL, Gemma-3n, Ministral-3, and more' and is an app. There are more than 10 alternatives to NexaSDK for a variety of platforms, including Windows, Linux, Mac, Self-Hosted and Android apps. The best NexaSDK alternative is Ollama, which is both free and Open Source. Other great apps like NexaSDK are Jan.ai, AnythingLLM, LM Studio and LocalAI .
Supports local deployment of Llama 3, Code Llama, and other language models, enabling users to customize and create personalized models. Ideal for AI development, it offers flexibility for offline AI needs and integrates AI writing and chatbot tools in local setups.
Open-source offline AI platform supports local LLMs including Llama, Gemma, Qwen, GPT-oss, integrates cloud services like OpenAI and Anthropic, enables custom assistant creation, offers OpenAI-compatible API on localhost, operates across diverse hardware and ensures privacy.
Open-source privacy-focused chatbot platform allowing unlimited document uploads, multi-user and single-user modes, AI-powered chat with documents, vector database and LLM compatibility, customizable interface, message history, secure desktop deployment, and full user controls.
Drop-In OpenAI replacement, On-device, local-first, Generate text/image/speech/music/etc... Backend Agnostic: (llama.cpp, diffusers, bark.cpp, etc...), Optional Distributed Inference(P2P/Federated).
MLC LLM is a machine learning compiler and high-performance deployment engine for large language models. The mission of this project is to enable everyone to develop, optimize, and deploy AI models natively on everyone’s platforms.
Experience the power of RWKV models directly on your device. Completely offline, privacy-first, and efficient. No internet required.
Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs.
The main goal of llama.cpp is to enable LLM inference with minimal setup and state-of-the-art performance on a wide range of hardware - locally and in the cloud.
AI00 RWKV Server is an inference API server for the RWKV language model based upon the web-rwkv inference engine.
Run LLMs on AMD Ryzen™ AI NPUs in minutes. Just like Ollama - but purpose-built and deeply optimized for the AMD NPUs.
United States
Singapore
China
Bulgaria
EU
