Large Language Model (LLM) Tools Page 5 of 16

ChatRTX is a locally-run AI chatbot developed by NVIDIA that leverages the power of RTX GPUs to deliver fast, private, and offline conversational AI. It uses models like Mistral or LLaMA and can be customized with your own documents and data.

LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar.

Spillway is an open-source, self-hosted AI gateway for teams that use cloud and local language models. It runs as a single Docker container with an admin UI and SQLite storage.

Auto-GPT is an experimental open-source application showcasing the capabilities of the GPT-4 language model. This program, driven by GPT-4, chains together LLM "thoughts", to autonomously achieve whatever goal you set.

Run LLMs on device or connect to various commercial or open source APIs. ChatterUI aims to provide a mobile-friendly interface with fine-grained control over chat structuring.

StableLM is an open-source language model developed by Stability AI that can generate text and code for various downstream applications. StableLM showcases the power of small, efficient models that can generate high-performing text and code locally on personal devices.

Stop sending your project context into a new AI tab every time you need a different model.

AI-powered CLI that analyzes your hardware and recommends optimal LLM models you can run locally, with full Ollama integration.

Askimo is an open-source, privacy-first AI desktop application designed to help users work with multiple AI models from a single, consistent interface. It supports popular AI providers such as OpenAI, Anthropic (Claude), Gemini, Ollama, LocalAI, Docker AI, LM Studio, and X AI...

Your versatile AI partner. Designed to amplify your productivity and streamline your tasks on macOS.

A friendly, human-like AI chatbot powered by Google Gemini.

Merlin AI is a free Chrome extension that unifies top AI models to help you instantly write, summarize, translate, code, and manage tasks directly in your browser.

Local AI agents on your Mac. Private, offline, free. Open models run on Apple Silicon; add ChatGPT, Claude or Gemini only when you choose.

MLC LLM is a machine learning compiler and high-performance deployment engine for large language models. The mission of this project is to enable everyone to develop, optimize, and deploy AI models natively on everyone’s platforms.

Kev is a family of small decision models built on Qwen3.5 and based on the architecture described in Jev's Architecture Unmasked. You can use the pretrained weights or train your own. The API matches TypeSafe's System One, so you can point their Python SDK at your local...

AI Sparks Studio is a user interface that allows you to efficiently utilize your own API access to state-of-the-art AI models like ChatGPT, GPT-4, Whisper or ElevenLabs.

Transform institutional knowledge into frontier-grade LLMs—without infrastructure burden or cloud lock-in.

Boost your app with AI: In-app chatbot capabilities and intelligent text generation, all open-sourced for React devs.

AI coding agent for the terminal — hash-anchored edits, optimized tool harness, LSP, Python, browser, subagents, and more.

Cross-platform framework for deploying LLM/VLM/TTS models locally on smartphones.

OfflineLLM is unlimited, private, offline, 24/7, free access to AI. Augment your day-to-day life by using this Ai chatbot for a multiplicity of applications.

Connect your local or hosted instance using your URL and API key. Once connected, all available models are loaded automatically. You can switch between them at any time, start new chats, or continue existing ones in a clean and focused interface.

Open-source orchestration for zero-human companies.

SmolChat allows you to download and run popular LLMs on your Android device, locally, without needing an internet connection. Customize the model used for each chat, tune settings like temperature and min-p, and pin your favourite chats on the home-screen with shortcuts.

Camel Chat is a feature-rich Flutter application designed to provide a seamless interface for communicating with large language models (LLMs) served via an Ollama server. It offers a user-friendly way to interact with open-source AI models on your own hardware.