Large Language Model (LLM) Tools Page 6 of 15

A modern web interface for managing and interacting with vLLM servers (www.github.com/vllm-project/vllm). Supports both GPU and CPU modes, with special optimizations for macOS Apple Silicon and enterprise deployment on OpenShift/Kubernetes.

1-bit Bonsai 8B implements a proprietary 1-bit model design across the entire network: embeddings, attention layers, MLP layers, and the LM head are all 1-bit. There are no higher-precision escape hatches. It is a true 1-bit model, end to end, across 8.2 billion parameters.

A dev-first open source autonomous AI agent framework. Enabling developers to build, manage & run useful autonomous agents quickly and reliably.

MLC LLM is a machine learning compiler and high-performance deployment engine for large language models. The mission of this project is to enable everyone to develop, optimize, and deploy AI models natively on everyone’s platforms.

Browse Anything is an AI agent (computer use agent) that can browse the web, automate tasks, extract data, generate reports, and much more, all from a simple prompt. Think of it as your personal web assistant, powered by AI.

A friendly, human-like AI chatbot powered by Google Gemini.

Inferencer lets you run, host and deeply control the latest SOTA AI models (OSS, DeepSeek, Qwen, Kimi, GLM, MiniMax and more) from your own computer.

Unifies plugin and dataset integration with a single API, offers visual orchestration for AI application creation, analytics, annotation, and prompt engineering.

Copilot sidebar ported from Microsoft Edge to Chrome.

llamafile lets you distribute and run LLMs with a single file, providing an OpenAI-compatible API as well as a KoboldAI API.

A versatile AI-powered application designed to meet the diverse needs of users seeking intelligent interaction and functionality. This app offers a free AI chat feature, enabling users to engage in conversations with advanced AI models, providing insights, answers, and...

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024).

A distraction-free LLM chat web app optimized for Kindle. The perfect companion for your book. Powered by Mixtral from Mistral AI. Mainly tested on Kindle Paperwhites.

Chat with generative language models locally on your computer with zero setup. LocalChat is a simple, easy to set up local AI chat built on top of llama.cpp. It requires no technical knowledge and enables users to experience ChatGPT-like behavior on their own machines — fully...

Leverage a no-code platform for AI voice assistants that enables calls and appointment scheduling, enhancing engagement and personalization for all businesses.

The Yi series models are the next generation of open-source large language models trained from scratch by 01.AI.

Cross-platform framework for deploying LLM/VLM/TTS models locally on smartphones.

User-friendly, privacy-first & highly customizable native ChatGPT app for macOS. Support OpenAI, Azure OpenAI, Anthropic Claude & OpenRouter. Local LLMs via Ollama.

Experience the power of AI at your fingertips with Private LLM, AI chatbot that runs on your iPhone, iPad and Mac without needing an internet connection.

An honest AI assistant that grounds answers in real knowledge and live search — no hallucinations, no API key required. Works offline. Open source.

An end-to-end MLLM that accept any-form referring and ground anything in response.

A modern Windows desktop client built with Rust and Tauri for downloading and managing AI models from HuggingFace with built-in mirror site switching.

Nouswise is a new AI-powered search engine that focuses on user-selected sources, reliable, accurate, line-by-line citations for each answer. It integrates the stages of the creative process—reading, researching, note-taking, organizing and writing—into a single, seamless space...

Camel Chat is a feature-rich Flutter application designed to provide a seamless interface for communicating with large language models (LLMs) served via an Ollama server. It offers a user-friendly way to interact with open-source AI models on your own hardware.

LangChain is a framework for developing applications powered by language models. We believe that the most powerful and differentiated applications will not only call out to a language model, but will also be: