Large Language Model (LLM) Tools Page 4 of 16

Custom Swift and Metal runtime enabling 26B instruction-tuned model inference in around 2 GB RAM by streaming weights from SSD, optimized for Apple Silicon Macs.

Qwen Code is an AI-powered command-line workflow tool designed for developers, adapted from Gemini CLI and optimized for Qwen3-Coder models.

SillyTavern is a user interface you can install on your computer (and Android phones) that allows you to interact with text generation AIs and chat/roleplay with characters you or the community create.

A large language model tool developed by AMD, offering superior performance with open access to weights and data, bridging gaps in AI model advancements.

AgentGPT allows you to configure and deploy Autonomous AI agents. Name your own custom AI and have it embark on any goal imaginable. It will attempt to reach the goal by thinking of tasks to do, executing them, and learning from the results.

Offline AI companion for Mac and Windows. Your model, memory, and image generation stay on your machine - no account, no subscription, no server to disappear.

Pi is a new kind of AI, one that isn’t just smart but also has good EQ. We think of Pi as a digital companion on hand whenever you want to learn something new, when you need a sounding board to talk through a tricky moment in your day, or just pass the time with a curious and...

Amazon Nova is a new generation of foundation models with frontier intelligence and industry leading price performance. Generate text, code, and images with natural language prompts.

Hermes Agent is a mobile-first AI agent app from Nous Research for running local models and practical Android workflows on your phone.

Open-source LLM-ops platform combining prompt management, an AI gateway, tracing, a tool catalog, and evaluation in one self-hostable platform.

Find out which AI models your machine can actually run.

A traditional operating system takes instructions. An AI operating system takes objectives. Personal Computer gives Perplexity Computer and the Comet Assistant always-on, local access to your machine's files, apps, and sessions through a continuously running compact desktop.

Supports multi-shot 1080p video generation from text or images, with smooth motion, detailed cinematic visual style, and accurate prompt interpretation.

KoboldCpp is an easy-to-use AI text-generation software for GGML models. It's a single self contained distributable from Concedo, that builds off llama.cpp, and adds a versatile Kobold API endpoint, additional format support, backward compatibility, as well as a fancy UI...

NodeTool is the open-source creative AI workspace — every major model from every major provider, called with your own keys, wired into one node-based canvas you run on your machine.

Multimodal Offline LLM Chat App with MNN.

RikkaHub is an Android APP that supports for multiple LLM providers.

Drop-In OpenAI replacement, On-device, local-first, Generate text/image/speech/music/etc... Backend Agnostic: (llama.cpp, diffusers, bark.cpp, etc...), Optional Distributed Inference(P2P/Federated).

Hundreds of models & providers. One command to find what runs on your hardware.

Run open-source LLMs on your computer. You can download and make custom characters for your models. Works offline. The new name is Back yard though it is the same.

OpenCV provides a real-time optimized Computer Vision library, tools, and hardware. It also supports model execution for Machine Learning (ML) and Artificial Intelligence (AI).

Experience the power of RWKV models directly on your device. Completely offline, privacy-first, and efficient. No internet required.

A Gradio web UI for Large Language Models. Supports transformers, GPTQ, llama.cpp (GGUF), Llama models.

Crush is an open-source, terminal-based AI coding agent built in Go by Charm (charmbracelet), designed to bring agentic coding directly into your shell with a polished TUI experience.

Warden is a minimalist, simple and beautiful macOS AI chat app, that supports most AI providers: ChatGPT, Anthropic (Claude), xAI (Grok), Google Gemini, Perplexity, Groq, Local LLMs through Ollama, OpenRouter, and almost any OpenAI-compatible APIs.